2023-09-28 12:22:13,743 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-28 12:22:13,967 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9 2023-09-28 12:22:13,967 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-28 12:22:13,968 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-28 12:22:14,008 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-28 12:22:14,261 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-28 12:22:14,262 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/cluster_f5b5db01-ec3b-43d5-fd0c-5c90c5632a48, deleteOnExit=true 2023-09-28 12:22:14,262 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-28 12:22:14,262 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/test.cache.data in system properties and HBase conf 2023-09-28 12:22:14,263 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/hadoop.tmp.dir in system properties and HBase conf 2023-09-28 12:22:14,263 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/hadoop.log.dir in system properties and HBase conf 2023-09-28 12:22:14,264 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-28 12:22:14,264 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-28 12:22:14,264 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-28 12:22:14,592 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-28 12:22:14,597 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-28 12:22:14,598 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-28 12:22:14,598 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-28 12:22:14,598 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-28 12:22:14,599 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-28 12:22:14,599 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-28 12:22:14,599 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-28 12:22:14,600 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-28 12:22:14,600 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-28 12:22:14,601 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/nfs.dump.dir in system properties and HBase conf 2023-09-28 12:22:14,601 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/java.io.tmpdir in system properties and HBase conf 2023-09-28 12:22:14,601 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-28 12:22:14,602 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-28 12:22:14,602 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-28 12:22:15,106 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-28 12:22:15,111 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-28 12:22:15,444 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-28 12:22:15,637 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-28 12:22:15,651 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-28 12:22:15,690 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-28 12:22:15,725 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/java.io.tmpdir/Jetty_localhost_43489_hdfs____.7scr9c/webapp 2023-09-28 12:22:15,873 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43489 2023-09-28 12:22:15,886 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-28 12:22:15,887 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-28 12:22:16,410 WARN [Listener at localhost/35969] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-28 12:22:16,488 WARN [Listener at localhost/35969] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-28 12:22:16,512 WARN [Listener at localhost/35969] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-28 12:22:16,565 INFO [Listener at localhost/35969] log.Slf4jLog(67): jetty-6.1.26 2023-09-28 12:22:16,573 INFO [Listener at localhost/35969] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/java.io.tmpdir/Jetty_localhost_39377_datanode____.vwb88c/webapp 2023-09-28 12:22:16,674 INFO [Listener at localhost/35969] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39377 2023-09-28 12:22:17,074 WARN [Listener at localhost/34831] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-28 12:22:17,097 WARN [Listener at localhost/34831] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-28 12:22:17,101 WARN [Listener at localhost/34831] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-28 12:22:17,104 INFO [Listener at localhost/34831] log.Slf4jLog(67): jetty-6.1.26 2023-09-28 12:22:17,113 INFO [Listener at localhost/34831] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/java.io.tmpdir/Jetty_localhost_46223_datanode____.ixnpm0/webapp 2023-09-28 12:22:17,239 INFO [Listener at localhost/34831] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46223 2023-09-28 12:22:17,253 WARN [Listener at localhost/43849] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-28 12:22:17,275 WARN [Listener at localhost/43849] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-28 12:22:17,279 WARN [Listener at localhost/43849] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-28 12:22:17,281 INFO [Listener at localhost/43849] log.Slf4jLog(67): jetty-6.1.26 2023-09-28 12:22:17,291 INFO [Listener at localhost/43849] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/java.io.tmpdir/Jetty_localhost_40017_datanode____.t6rflr/webapp 2023-09-28 12:22:17,430 INFO [Listener at localhost/43849] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40017 2023-09-28 12:22:17,444 WARN [Listener at localhost/44031] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-28 12:22:17,677 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x99e42cb063580cf5: Processing first storage report for DS-5e415af4-31b2-4fac-9e4e-423f6f8123a5 from datanode b1d48ce5-9a61-4e82-942d-61abe6523395 2023-09-28 12:22:17,679 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x99e42cb063580cf5: from storage DS-5e415af4-31b2-4fac-9e4e-423f6f8123a5 node DatanodeRegistration(127.0.0.1:41987, datanodeUuid=b1d48ce5-9a61-4e82-942d-61abe6523395, infoPort=32849, infoSecurePort=0, ipcPort=44031, storageInfo=lv=-57;cid=testClusterID;nsid=1931463575;c=1695903735202), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-28 12:22:17,679 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd72fc270d1e1a560: Processing first storage report for DS-ac00ba0d-c87d-47a2-8750-1c8e467b18c8 from datanode 68ce23cf-aee2-4c1f-a48d-418a0ae52c54 2023-09-28 12:22:17,680 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd72fc270d1e1a560: from storage DS-ac00ba0d-c87d-47a2-8750-1c8e467b18c8 node DatanodeRegistration(127.0.0.1:32921, datanodeUuid=68ce23cf-aee2-4c1f-a48d-418a0ae52c54, infoPort=43975, infoSecurePort=0, ipcPort=43849, storageInfo=lv=-57;cid=testClusterID;nsid=1931463575;c=1695903735202), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-28 12:22:17,680 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9a138a928d5212e6: Processing first storage report for DS-3e9a2b3f-841c-4e61-a6d1-9bbadd43f4d1 from datanode 9faeacd2-c233-4faf-ac73-e190841d9d6d 2023-09-28 12:22:17,680 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9a138a928d5212e6: from storage DS-3e9a2b3f-841c-4e61-a6d1-9bbadd43f4d1 node DatanodeRegistration(127.0.0.1:37189, datanodeUuid=9faeacd2-c233-4faf-ac73-e190841d9d6d, infoPort=40459, infoSecurePort=0, ipcPort=34831, storageInfo=lv=-57;cid=testClusterID;nsid=1931463575;c=1695903735202), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-28 12:22:17,680 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x99e42cb063580cf5: Processing first storage report for DS-190e38fa-b4e7-4df8-86ee-4e6de8220f0c from datanode b1d48ce5-9a61-4e82-942d-61abe6523395 2023-09-28 12:22:17,680 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x99e42cb063580cf5: from storage DS-190e38fa-b4e7-4df8-86ee-4e6de8220f0c node DatanodeRegistration(127.0.0.1:41987, datanodeUuid=b1d48ce5-9a61-4e82-942d-61abe6523395, infoPort=32849, infoSecurePort=0, ipcPort=44031, storageInfo=lv=-57;cid=testClusterID;nsid=1931463575;c=1695903735202), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-28 12:22:17,680 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd72fc270d1e1a560: Processing first storage report for DS-ad72dbad-600e-4139-bf9d-4ea4d24b2e93 from datanode 68ce23cf-aee2-4c1f-a48d-418a0ae52c54 2023-09-28 12:22:17,680 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd72fc270d1e1a560: from storage DS-ad72dbad-600e-4139-bf9d-4ea4d24b2e93 node DatanodeRegistration(127.0.0.1:32921, datanodeUuid=68ce23cf-aee2-4c1f-a48d-418a0ae52c54, infoPort=43975, infoSecurePort=0, ipcPort=43849, storageInfo=lv=-57;cid=testClusterID;nsid=1931463575;c=1695903735202), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-28 12:22:17,681 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9a138a928d5212e6: Processing first storage report for DS-8c577d18-34a8-44a9-83d0-ae855ffe80af from datanode 9faeacd2-c233-4faf-ac73-e190841d9d6d 2023-09-28 12:22:17,681 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9a138a928d5212e6: from storage DS-8c577d18-34a8-44a9-83d0-ae855ffe80af node DatanodeRegistration(127.0.0.1:37189, datanodeUuid=9faeacd2-c233-4faf-ac73-e190841d9d6d, infoPort=40459, infoSecurePort=0, ipcPort=34831, storageInfo=lv=-57;cid=testClusterID;nsid=1931463575;c=1695903735202), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-28 12:22:17,918 DEBUG [Listener at localhost/44031] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9 2023-09-28 12:22:18,025 INFO [Listener at localhost/44031] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/cluster_f5b5db01-ec3b-43d5-fd0c-5c90c5632a48/zookeeper_0, clientPort=65025, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/cluster_f5b5db01-ec3b-43d5-fd0c-5c90c5632a48/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/cluster_f5b5db01-ec3b-43d5-fd0c-5c90c5632a48/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-28 12:22:18,048 INFO [Listener at localhost/44031] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=65025 2023-09-28 12:22:18,056 INFO [Listener at localhost/44031] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 12:22:18,058 INFO [Listener at localhost/44031] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 12:22:18,753 INFO [Listener at localhost/44031] util.FSUtils(471): Created version file at hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326 with version=8 2023-09-28 12:22:18,753 INFO [Listener at localhost/44031] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/hbase-staging 2023-09-28 12:22:19,170 INFO [Listener at localhost/44031] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-28 12:22:19,699 INFO [Listener at localhost/44031] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-09-28 12:22:19,733 INFO [Listener at localhost/44031] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-28 12:22:19,734 INFO [Listener at localhost/44031] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-28 12:22:19,734 INFO [Listener at localhost/44031] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-28 12:22:19,734 INFO [Listener at localhost/44031] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-28 12:22:19,734 INFO [Listener at localhost/44031] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-28 12:22:19,884 INFO [Listener at localhost/44031] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-28 12:22:19,961 DEBUG [Listener at localhost/44031] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-28 12:22:20,054 INFO [Listener at localhost/44031] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45395 2023-09-28 12:22:20,067 INFO [Listener at localhost/44031] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 12:22:20,069 INFO [Listener at localhost/44031] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 12:22:20,093 INFO [Listener at localhost/44031] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45395 connecting to ZooKeeper ensemble=127.0.0.1:65025 2023-09-28 12:22:20,151 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:453950x0, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-28 12:22:20,154 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:45395-0x100f27ca02f0000 connected 2023-09-28 12:22:20,197 DEBUG [Listener at localhost/44031] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-28 12:22:20,198 DEBUG [Listener at localhost/44031] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-28 12:22:20,211 DEBUG [Listener at localhost/44031] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-28 12:22:20,219 DEBUG [Listener at localhost/44031] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45395 2023-09-28 12:22:20,220 DEBUG [Listener at localhost/44031] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45395 2023-09-28 12:22:20,220 DEBUG [Listener at localhost/44031] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45395 2023-09-28 12:22:20,221 DEBUG [Listener at localhost/44031] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45395 2023-09-28 12:22:20,221 DEBUG [Listener at localhost/44031] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45395 2023-09-28 12:22:20,230 INFO [Listener at localhost/44031] master.HMaster(444): hbase.rootdir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326, hbase.cluster.distributed=false 2023-09-28 12:22:20,297 INFO [Listener at localhost/44031] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-28 12:22:20,298 INFO [Listener at localhost/44031] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-28 12:22:20,298 INFO [Listener at localhost/44031] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-28 12:22:20,298 INFO [Listener at localhost/44031] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-28 12:22:20,298 INFO [Listener at localhost/44031] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-28 12:22:20,298 INFO [Listener at localhost/44031] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-28 12:22:20,303 INFO [Listener at localhost/44031] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-28 12:22:20,306 INFO [Listener at localhost/44031] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35175 2023-09-28 12:22:20,309 INFO [Listener at localhost/44031] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-28 12:22:20,315 INFO [Listener at localhost/44031] mob.MobFileCache(125): MobFileCache disabled 2023-09-28 12:22:20,316 INFO [Listener at localhost/44031] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 12:22:20,318 INFO [Listener at localhost/44031] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 12:22:20,320 INFO [Listener at localhost/44031] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35175 connecting to ZooKeeper ensemble=127.0.0.1:65025 2023-09-28 12:22:20,325 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:351750x0, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-28 12:22:20,326 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35175-0x100f27ca02f0001 connected 2023-09-28 12:22:20,326 DEBUG [Listener at localhost/44031] zookeeper.ZKUtil(164): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-28 12:22:20,327 DEBUG [Listener at localhost/44031] zookeeper.ZKUtil(164): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-28 12:22:20,328 DEBUG [Listener at localhost/44031] zookeeper.ZKUtil(164): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-28 12:22:20,329 DEBUG [Listener at localhost/44031] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35175 2023-09-28 12:22:20,329 DEBUG [Listener at localhost/44031] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35175 2023-09-28 12:22:20,331 DEBUG [Listener at localhost/44031] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35175 2023-09-28 12:22:20,332 DEBUG [Listener at localhost/44031] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35175 2023-09-28 12:22:20,333 DEBUG [Listener at localhost/44031] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35175 2023-09-28 12:22:20,345 INFO [Listener at localhost/44031] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-28 12:22:20,345 INFO [Listener at localhost/44031] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-28 12:22:20,346 INFO [Listener at localhost/44031] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-28 12:22:20,346 INFO [Listener at localhost/44031] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-28 12:22:20,346 INFO [Listener at localhost/44031] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-28 12:22:20,346 INFO [Listener at localhost/44031] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-28 12:22:20,346 INFO [Listener at localhost/44031] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-28 12:22:20,348 INFO [Listener at localhost/44031] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39937 2023-09-28 12:22:20,348 INFO [Listener at localhost/44031] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-28 12:22:20,349 INFO [Listener at localhost/44031] mob.MobFileCache(125): MobFileCache disabled 2023-09-28 12:22:20,350 INFO [Listener at localhost/44031] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 12:22:20,352 INFO [Listener at localhost/44031] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 12:22:20,354 INFO [Listener at localhost/44031] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39937 connecting to ZooKeeper ensemble=127.0.0.1:65025 2023-09-28 12:22:20,357 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:399370x0, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-28 12:22:20,358 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39937-0x100f27ca02f0002 connected 2023-09-28 12:22:20,359 DEBUG [Listener at localhost/44031] zookeeper.ZKUtil(164): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-28 12:22:20,360 DEBUG [Listener at localhost/44031] zookeeper.ZKUtil(164): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-28 12:22:20,360 DEBUG [Listener at localhost/44031] zookeeper.ZKUtil(164): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-28 12:22:20,361 DEBUG [Listener at localhost/44031] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39937 2023-09-28 12:22:20,362 DEBUG [Listener at localhost/44031] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39937 2023-09-28 12:22:20,365 DEBUG [Listener at localhost/44031] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39937 2023-09-28 12:22:20,365 DEBUG [Listener at localhost/44031] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39937 2023-09-28 12:22:20,369 DEBUG [Listener at localhost/44031] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39937 2023-09-28 12:22:20,381 INFO [Listener at localhost/44031] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-28 12:22:20,381 INFO [Listener at localhost/44031] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-28 12:22:20,381 INFO [Listener at localhost/44031] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-28 12:22:20,381 INFO [Listener at localhost/44031] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-28 12:22:20,381 INFO [Listener at localhost/44031] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-28 12:22:20,381 INFO [Listener at localhost/44031] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-28 12:22:20,381 INFO [Listener at localhost/44031] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-28 12:22:20,383 INFO [Listener at localhost/44031] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40363 2023-09-28 12:22:20,383 INFO [Listener at localhost/44031] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-28 12:22:20,384 INFO [Listener at localhost/44031] mob.MobFileCache(125): MobFileCache disabled 2023-09-28 12:22:20,385 INFO [Listener at localhost/44031] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 12:22:20,386 INFO [Listener at localhost/44031] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 12:22:20,388 INFO [Listener at localhost/44031] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40363 connecting to ZooKeeper ensemble=127.0.0.1:65025 2023-09-28 12:22:20,392 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:403630x0, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-28 12:22:20,393 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40363-0x100f27ca02f0003 connected 2023-09-28 12:22:20,393 DEBUG [Listener at localhost/44031] zookeeper.ZKUtil(164): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-28 12:22:20,394 DEBUG [Listener at localhost/44031] zookeeper.ZKUtil(164): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-28 12:22:20,394 DEBUG [Listener at localhost/44031] zookeeper.ZKUtil(164): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-28 12:22:20,397 DEBUG [Listener at localhost/44031] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40363 2023-09-28 12:22:20,401 DEBUG [Listener at localhost/44031] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40363 2023-09-28 12:22:20,401 DEBUG [Listener at localhost/44031] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40363 2023-09-28 12:22:20,402 DEBUG [Listener at localhost/44031] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40363 2023-09-28 12:22:20,402 DEBUG [Listener at localhost/44031] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40363 2023-09-28 12:22:20,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,45395,1695903738972 2023-09-28 12:22:20,414 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-28 12:22:20,415 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,45395,1695903738972 2023-09-28 12:22:20,436 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-28 12:22:20,436 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-28 12:22:20,436 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-28 12:22:20,436 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-28 12:22:20,437 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 12:22:20,438 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-28 12:22:20,439 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,45395,1695903738972 from backup master directory 2023-09-28 12:22:20,439 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-28 12:22:20,444 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,45395,1695903738972 2023-09-28 12:22:20,444 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-28 12:22:20,444 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-28 12:22:20,445 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,45395,1695903738972 2023-09-28 12:22:20,448 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-28 12:22:20,449 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-28 12:22:20,554 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/hbase.id with ID: 4bc6851d-84ba-43b8-9f12-9f3eb32b5758 2023-09-28 12:22:20,596 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 12:22:20,612 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 12:22:20,672 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x4b44492b to 127.0.0.1:65025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 12:22:20,711 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6116c760, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 12:22:20,739 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-28 12:22:20,741 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-28 12:22:20,760 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-28 12:22:20,760 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-28 12:22:20,763 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-28 12:22:20,768 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-28 12:22:20,770 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-28 12:22:20,806 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/MasterData/data/master/store-tmp 2023-09-28 12:22:20,850 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 12:22:20,850 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-28 12:22:20,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-28 12:22:20,851 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-28 12:22:20,851 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-28 12:22:20,851 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-28 12:22:20,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-28 12:22:20,851 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-28 12:22:20,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/MasterData/WALs/jenkins-hbase4.apache.org,45395,1695903738972 2023-09-28 12:22:20,875 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45395%2C1695903738972, suffix=, logDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/MasterData/WALs/jenkins-hbase4.apache.org,45395,1695903738972, archiveDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/MasterData/oldWALs, maxLogs=10 2023-09-28 12:22:20,939 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32921,DS-ac00ba0d-c87d-47a2-8750-1c8e467b18c8,DISK] 2023-09-28 12:22:20,939 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37189,DS-3e9a2b3f-841c-4e61-a6d1-9bbadd43f4d1,DISK] 2023-09-28 12:22:20,939 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41987,DS-5e415af4-31b2-4fac-9e4e-423f6f8123a5,DISK] 2023-09-28 12:22:20,948 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-28 12:22:21,020 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/MasterData/WALs/jenkins-hbase4.apache.org,45395,1695903738972/jenkins-hbase4.apache.org%2C45395%2C1695903738972.1695903740889 2023-09-28 12:22:21,021 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41987,DS-5e415af4-31b2-4fac-9e4e-423f6f8123a5,DISK], DatanodeInfoWithStorage[127.0.0.1:32921,DS-ac00ba0d-c87d-47a2-8750-1c8e467b18c8,DISK], DatanodeInfoWithStorage[127.0.0.1:37189,DS-3e9a2b3f-841c-4e61-a6d1-9bbadd43f4d1,DISK]] 2023-09-28 12:22:21,021 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-28 12:22:21,022 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 12:22:21,025 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-28 12:22:21,026 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-28 12:22:21,089 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-28 12:22:21,097 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-28 12:22:21,131 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-28 12:22:21,143 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 12:22:21,148 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-28 12:22:21,150 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-28 12:22:21,164 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-28 12:22:21,168 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 12:22:21,169 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66606862, jitterRate=-0.007480412721633911}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 12:22:21,169 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-28 12:22:21,171 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-28 12:22:21,192 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-28 12:22:21,192 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-28 12:22:21,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-28 12:22:21,197 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-09-28 12:22:21,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 36 msec 2023-09-28 12:22:21,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-28 12:22:21,273 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-28 12:22:21,280 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-28 12:22:21,305 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-28 12:22:21,310 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-28 12:22:21,312 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-28 12:22:21,317 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-28 12:22:21,321 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-28 12:22:21,325 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 12:22:21,327 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-28 12:22:21,328 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-28 12:22:21,342 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-28 12:22:21,346 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-28 12:22:21,347 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-28 12:22:21,347 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-28 12:22:21,346 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-28 12:22:21,347 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 12:22:21,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,45395,1695903738972, sessionid=0x100f27ca02f0000, setting cluster-up flag (Was=false) 2023-09-28 12:22:21,369 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 12:22:21,376 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-28 12:22:21,377 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45395,1695903738972 2023-09-28 12:22:21,385 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 12:22:21,390 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-28 12:22:21,392 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45395,1695903738972 2023-09-28 12:22:21,394 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp 2023-09-28 12:22:21,407 INFO [RS:0;jenkins-hbase4:35175] regionserver.HRegionServer(951): ClusterId : 4bc6851d-84ba-43b8-9f12-9f3eb32b5758 2023-09-28 12:22:21,407 INFO [RS:2;jenkins-hbase4:40363] regionserver.HRegionServer(951): ClusterId : 4bc6851d-84ba-43b8-9f12-9f3eb32b5758 2023-09-28 12:22:21,407 INFO [RS:1;jenkins-hbase4:39937] regionserver.HRegionServer(951): ClusterId : 4bc6851d-84ba-43b8-9f12-9f3eb32b5758 2023-09-28 12:22:21,416 DEBUG [RS:2;jenkins-hbase4:40363] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-28 12:22:21,416 DEBUG [RS:0;jenkins-hbase4:35175] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-28 12:22:21,416 DEBUG [RS:1;jenkins-hbase4:39937] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-28 12:22:21,425 DEBUG [RS:2;jenkins-hbase4:40363] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-28 12:22:21,425 DEBUG [RS:0;jenkins-hbase4:35175] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-28 12:22:21,425 DEBUG [RS:1;jenkins-hbase4:39937] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-28 12:22:21,425 DEBUG [RS:0;jenkins-hbase4:35175] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-28 12:22:21,425 DEBUG [RS:2;jenkins-hbase4:40363] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-28 12:22:21,425 DEBUG [RS:1;jenkins-hbase4:39937] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-28 12:22:21,429 DEBUG [RS:1;jenkins-hbase4:39937] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-28 12:22:21,429 DEBUG [RS:2;jenkins-hbase4:40363] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-28 12:22:21,429 DEBUG [RS:0;jenkins-hbase4:35175] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-28 12:22:21,433 DEBUG [RS:1;jenkins-hbase4:39937] zookeeper.ReadOnlyZKClient(139): Connect 0x43591350 to 127.0.0.1:65025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 12:22:21,434 DEBUG [RS:0;jenkins-hbase4:35175] zookeeper.ReadOnlyZKClient(139): Connect 0x5050f720 to 127.0.0.1:65025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 12:22:21,434 DEBUG [RS:2;jenkins-hbase4:40363] zookeeper.ReadOnlyZKClient(139): Connect 0x32647569 to 127.0.0.1:65025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 12:22:21,442 DEBUG [RS:0;jenkins-hbase4:35175] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e97035a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 12:22:21,442 DEBUG [RS:1;jenkins-hbase4:39937] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d9ee54b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 12:22:21,443 DEBUG [RS:0;jenkins-hbase4:35175] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5aa89c50, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-28 12:22:21,443 DEBUG [RS:1;jenkins-hbase4:39937] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49a17820, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-28 12:22:21,445 DEBUG [RS:2;jenkins-hbase4:40363] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ca39d55, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 12:22:21,445 DEBUG [RS:2;jenkins-hbase4:40363] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@389c1e19, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-28 12:22:21,467 DEBUG [RS:1;jenkins-hbase4:39937] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:39937 2023-09-28 12:22:21,471 INFO [RS:1;jenkins-hbase4:39937] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-28 12:22:21,471 INFO [RS:1;jenkins-hbase4:39937] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-28 12:22:21,471 DEBUG [RS:2;jenkins-hbase4:40363] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:40363 2023-09-28 12:22:21,472 DEBUG [RS:0;jenkins-hbase4:35175] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:35175 2023-09-28 12:22:21,472 INFO [RS:2;jenkins-hbase4:40363] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-28 12:22:21,473 INFO [RS:0;jenkins-hbase4:35175] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-28 12:22:21,473 INFO [RS:0;jenkins-hbase4:35175] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-28 12:22:21,473 INFO [RS:2;jenkins-hbase4:40363] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-28 12:22:21,494 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-28 12:22:21,494 DEBUG [RS:1;jenkins-hbase4:39937] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-28 12:22:21,494 DEBUG [RS:2;jenkins-hbase4:40363] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-28 12:22:21,494 DEBUG [RS:0;jenkins-hbase4:35175] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-28 12:22:21,496 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 12:22:21,496 INFO [RS:0;jenkins-hbase4:35175] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 12:22:21,496 INFO [RS:1;jenkins-hbase4:39937] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 12:22:21,497 DEBUG [RS:1;jenkins-hbase4:39937] regionserver.HRegionServer(1022): About to register with Master. 2023-09-28 12:22:21,496 INFO [RS:2;jenkins-hbase4:40363] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 12:22:21,497 DEBUG [RS:2;jenkins-hbase4:40363] regionserver.HRegionServer(1022): About to register with Master. 2023-09-28 12:22:21,497 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-28 12:22:21,497 DEBUG [RS:0;jenkins-hbase4:35175] regionserver.HRegionServer(1022): About to register with Master. 2023-09-28 12:22:21,500 INFO [RS:2;jenkins-hbase4:40363] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45395,1695903738972 with isa=jenkins-hbase4.apache.org/172.31.14.131:40363, startcode=1695903740380 2023-09-28 12:22:21,500 INFO [RS:1;jenkins-hbase4:39937] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45395,1695903738972 with isa=jenkins-hbase4.apache.org/172.31.14.131:39937, startcode=1695903740345 2023-09-28 12:22:21,500 INFO [RS:0;jenkins-hbase4:35175] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45395,1695903738972 with isa=jenkins-hbase4.apache.org/172.31.14.131:35175, startcode=1695903740297 2023-09-28 12:22:21,519 DEBUG [RS:0;jenkins-hbase4:35175] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-28 12:22:21,519 DEBUG [RS:1;jenkins-hbase4:39937] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-28 12:22:21,519 DEBUG [RS:2;jenkins-hbase4:40363] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-28 12:22:21,585 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34147, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-28 12:22:21,585 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39407, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-28 12:22:21,585 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54905, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-28 12:22:21,597 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45395] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-28 12:22:21,606 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-28 12:22:21,608 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45395] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-28 12:22:21,609 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45395] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-28 12:22:21,619 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-28 12:22:21,619 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-28 12:22:21,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-28 12:22:21,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-28 12:22:21,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-09-28 12:22:21,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 12:22:21,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-28 12:22:21,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 12:22:21,621 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1695903771621 2023-09-28 12:22:21,623 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-28 12:22:21,629 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-28 12:22:21,630 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-28 12:22:21,630 DEBUG [RS:2;jenkins-hbase4:40363] regionserver.HRegionServer(2830): Master is not running yet 2023-09-28 12:22:21,630 DEBUG [RS:1;jenkins-hbase4:39937] regionserver.HRegionServer(2830): Master is not running yet 2023-09-28 12:22:21,631 WARN [RS:2;jenkins-hbase4:40363] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-28 12:22:21,630 DEBUG [RS:0;jenkins-hbase4:35175] regionserver.HRegionServer(2830): Master is not running yet 2023-09-28 12:22:21,631 WARN [RS:1;jenkins-hbase4:39937] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-28 12:22:21,631 WARN [RS:0;jenkins-hbase4:35175] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-28 12:22:21,634 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-28 12:22:21,636 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-28 12:22:21,640 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-28 12:22:21,641 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-28 12:22:21,641 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-28 12:22:21,641 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-28 12:22:21,642 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-28 12:22:21,643 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-28 12:22:21,645 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-28 12:22:21,645 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-28 12:22:21,649 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-28 12:22:21,649 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-28 12:22:21,651 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695903741651,5,FailOnTimeoutGroup] 2023-09-28 12:22:21,651 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695903741651,5,FailOnTimeoutGroup] 2023-09-28 12:22:21,651 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-28 12:22:21,651 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-28 12:22:21,652 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-28 12:22:21,653 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-28 12:22:21,682 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-28 12:22:21,683 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-28 12:22:21,683 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326 2023-09-28 12:22:21,706 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 12:22:21,708 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-28 12:22:21,711 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/meta/1588230740/info 2023-09-28 12:22:21,712 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-28 12:22:21,713 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 12:22:21,713 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-28 12:22:21,715 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/meta/1588230740/rep_barrier 2023-09-28 12:22:21,716 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-28 12:22:21,717 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 12:22:21,717 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-28 12:22:21,720 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/meta/1588230740/table 2023-09-28 12:22:21,720 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-28 12:22:21,721 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 12:22:21,723 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/meta/1588230740 2023-09-28 12:22:21,724 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/meta/1588230740 2023-09-28 12:22:21,728 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-28 12:22:21,731 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-28 12:22:21,732 INFO [RS:1;jenkins-hbase4:39937] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45395,1695903738972 with isa=jenkins-hbase4.apache.org/172.31.14.131:39937, startcode=1695903740345 2023-09-28 12:22:21,732 INFO [RS:0;jenkins-hbase4:35175] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45395,1695903738972 with isa=jenkins-hbase4.apache.org/172.31.14.131:35175, startcode=1695903740297 2023-09-28 12:22:21,732 INFO [RS:2;jenkins-hbase4:40363] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45395,1695903738972 with isa=jenkins-hbase4.apache.org/172.31.14.131:40363, startcode=1695903740380 2023-09-28 12:22:21,737 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 12:22:21,738 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60900553, jitterRate=-0.09251104295253754}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-28 12:22:21,738 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-28 12:22:21,738 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-28 12:22:21,738 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-28 12:22:21,738 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-28 12:22:21,738 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-28 12:22:21,738 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-28 12:22:21,740 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-28 12:22:21,740 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-28 12:22:21,741 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45395] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:21,746 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-28 12:22:21,746 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-28 12:22:21,749 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45395] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:21,750 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45395] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:21,751 DEBUG [RS:1;jenkins-hbase4:39937] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326 2023-09-28 12:22:21,752 DEBUG [RS:1;jenkins-hbase4:39937] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35969 2023-09-28 12:22:21,752 DEBUG [RS:1;jenkins-hbase4:39937] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-28 12:22:21,751 DEBUG [RS:0;jenkins-hbase4:35175] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326 2023-09-28 12:22:21,753 DEBUG [RS:0;jenkins-hbase4:35175] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35969 2023-09-28 12:22:21,753 DEBUG [RS:0;jenkins-hbase4:35175] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-28 12:22:21,754 DEBUG [RS:2;jenkins-hbase4:40363] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326 2023-09-28 12:22:21,754 DEBUG [RS:2;jenkins-hbase4:40363] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35969 2023-09-28 12:22:21,754 DEBUG [RS:2;jenkins-hbase4:40363] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-28 12:22:21,760 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-28 12:22:21,762 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-28 12:22:21,765 DEBUG [RS:2;jenkins-hbase4:40363] zookeeper.ZKUtil(162): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:21,765 WARN [RS:2;jenkins-hbase4:40363] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-28 12:22:21,766 INFO [RS:2;jenkins-hbase4:40363] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-28 12:22:21,766 DEBUG [RS:2;jenkins-hbase4:40363] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/WALs/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:21,766 DEBUG [RS:0;jenkins-hbase4:35175] zookeeper.ZKUtil(162): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:21,766 DEBUG [RS:1;jenkins-hbase4:39937] zookeeper.ZKUtil(162): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:21,766 WARN [RS:0;jenkins-hbase4:35175] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-28 12:22:21,766 WARN [RS:1;jenkins-hbase4:39937] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-28 12:22:21,767 INFO [RS:0;jenkins-hbase4:35175] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-28 12:22:21,767 INFO [RS:1;jenkins-hbase4:39937] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-28 12:22:21,768 DEBUG [RS:0;jenkins-hbase4:35175] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/WALs/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:21,768 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35175,1695903740297] 2023-09-28 12:22:21,768 DEBUG [RS:1;jenkins-hbase4:39937] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/WALs/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:21,768 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40363,1695903740380] 2023-09-28 12:22:21,768 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39937,1695903740345] 2023-09-28 12:22:21,786 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-28 12:22:21,787 DEBUG [RS:2;jenkins-hbase4:40363] zookeeper.ZKUtil(162): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:21,787 DEBUG [RS:1;jenkins-hbase4:39937] zookeeper.ZKUtil(162): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:21,787 DEBUG [RS:0;jenkins-hbase4:35175] zookeeper.ZKUtil(162): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:21,787 DEBUG [RS:2;jenkins-hbase4:40363] zookeeper.ZKUtil(162): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:21,788 DEBUG [RS:0;jenkins-hbase4:35175] zookeeper.ZKUtil(162): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:21,788 DEBUG [RS:1;jenkins-hbase4:39937] zookeeper.ZKUtil(162): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:21,788 DEBUG [RS:2;jenkins-hbase4:40363] zookeeper.ZKUtil(162): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:21,788 DEBUG [RS:0;jenkins-hbase4:35175] zookeeper.ZKUtil(162): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:21,789 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-28 12:22:21,789 DEBUG [RS:1;jenkins-hbase4:39937] zookeeper.ZKUtil(162): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:21,800 DEBUG [RS:1;jenkins-hbase4:39937] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-28 12:22:21,800 DEBUG [RS:2;jenkins-hbase4:40363] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-28 12:22:21,800 DEBUG [RS:0;jenkins-hbase4:35175] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-28 12:22:21,811 INFO [RS:1;jenkins-hbase4:39937] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-28 12:22:21,811 INFO [RS:2;jenkins-hbase4:40363] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-28 12:22:21,811 INFO [RS:0;jenkins-hbase4:35175] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-28 12:22:21,836 INFO [RS:2;jenkins-hbase4:40363] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-28 12:22:21,837 INFO [RS:0;jenkins-hbase4:35175] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-28 12:22:21,837 INFO [RS:1;jenkins-hbase4:39937] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-28 12:22:21,841 INFO [RS:2;jenkins-hbase4:40363] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-28 12:22:21,841 INFO [RS:1;jenkins-hbase4:39937] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-28 12:22:21,841 INFO [RS:0;jenkins-hbase4:35175] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-28 12:22:21,841 INFO [RS:1;jenkins-hbase4:39937] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-28 12:22:21,841 INFO [RS:2;jenkins-hbase4:40363] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-28 12:22:21,841 INFO [RS:0;jenkins-hbase4:35175] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-28 12:22:21,843 INFO [RS:2;jenkins-hbase4:40363] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-28 12:22:21,843 INFO [RS:1;jenkins-hbase4:39937] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-28 12:22:21,843 INFO [RS:0;jenkins-hbase4:35175] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-28 12:22:21,851 INFO [RS:2;jenkins-hbase4:40363] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-28 12:22:21,851 INFO [RS:1;jenkins-hbase4:39937] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-28 12:22:21,851 INFO [RS:0;jenkins-hbase4:35175] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-28 12:22:21,851 DEBUG [RS:2;jenkins-hbase4:40363] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 12:22:21,851 DEBUG [RS:1;jenkins-hbase4:39937] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 12:22:21,852 DEBUG [RS:2;jenkins-hbase4:40363] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 12:22:21,852 DEBUG [RS:0;jenkins-hbase4:35175] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 12:22:21,852 DEBUG [RS:2;jenkins-hbase4:40363] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 12:22:21,852 DEBUG [RS:1;jenkins-hbase4:39937] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 12:22:21,852 DEBUG [RS:2;jenkins-hbase4:40363] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 12:22:21,852 DEBUG [RS:0;jenkins-hbase4:35175] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 12:22:21,852 DEBUG [RS:2;jenkins-hbase4:40363] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 12:22:21,852 DEBUG [RS:1;jenkins-hbase4:39937] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 12:22:21,852 DEBUG [RS:2;jenkins-hbase4:40363] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-28 12:22:21,852 DEBUG [RS:0;jenkins-hbase4:35175] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 12:22:21,852 DEBUG [RS:2;jenkins-hbase4:40363] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 12:22:21,852 DEBUG [RS:1;jenkins-hbase4:39937] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 12:22:21,853 DEBUG [RS:2;jenkins-hbase4:40363] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 12:22:21,853 DEBUG [RS:1;jenkins-hbase4:39937] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 12:22:21,853 DEBUG [RS:2;jenkins-hbase4:40363] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 12:22:21,853 DEBUG [RS:1;jenkins-hbase4:39937] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-28 12:22:21,853 DEBUG [RS:2;jenkins-hbase4:40363] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 12:22:21,853 DEBUG [RS:0;jenkins-hbase4:35175] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 12:22:21,853 DEBUG [RS:1;jenkins-hbase4:39937] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 12:22:21,853 DEBUG [RS:0;jenkins-hbase4:35175] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 12:22:21,854 DEBUG [RS:1;jenkins-hbase4:39937] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 12:22:21,854 DEBUG [RS:0;jenkins-hbase4:35175] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-28 12:22:21,854 DEBUG [RS:1;jenkins-hbase4:39937] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 12:22:21,854 INFO [RS:2;jenkins-hbase4:40363] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-28 12:22:21,854 DEBUG [RS:1;jenkins-hbase4:39937] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 12:22:21,854 INFO [RS:2;jenkins-hbase4:40363] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-28 12:22:21,854 DEBUG [RS:0;jenkins-hbase4:35175] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 12:22:21,854 INFO [RS:2;jenkins-hbase4:40363] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-28 12:22:21,854 DEBUG [RS:0;jenkins-hbase4:35175] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 12:22:21,854 DEBUG [RS:0;jenkins-hbase4:35175] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 12:22:21,854 DEBUG [RS:0;jenkins-hbase4:35175] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 12:22:21,856 INFO [RS:1;jenkins-hbase4:39937] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-28 12:22:21,861 INFO [RS:0;jenkins-hbase4:35175] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-28 12:22:21,861 INFO [RS:1;jenkins-hbase4:39937] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-28 12:22:21,861 INFO [RS:0;jenkins-hbase4:35175] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-28 12:22:21,861 INFO [RS:1;jenkins-hbase4:39937] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-28 12:22:21,861 INFO [RS:0;jenkins-hbase4:35175] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-28 12:22:21,879 INFO [RS:1;jenkins-hbase4:39937] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-28 12:22:21,879 INFO [RS:0;jenkins-hbase4:35175] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-28 12:22:21,879 INFO [RS:2;jenkins-hbase4:40363] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-28 12:22:21,883 INFO [RS:1;jenkins-hbase4:39937] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39937,1695903740345-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-28 12:22:21,883 INFO [RS:0;jenkins-hbase4:35175] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35175,1695903740297-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-28 12:22:21,883 INFO [RS:2;jenkins-hbase4:40363] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40363,1695903740380-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-28 12:22:21,902 INFO [RS:0;jenkins-hbase4:35175] regionserver.Replication(203): jenkins-hbase4.apache.org,35175,1695903740297 started 2023-09-28 12:22:21,902 INFO [RS:0;jenkins-hbase4:35175] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,35175,1695903740297, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35175, sessionid=0x100f27ca02f0001 2023-09-28 12:22:21,902 DEBUG [RS:0;jenkins-hbase4:35175] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-28 12:22:21,902 DEBUG [RS:0;jenkins-hbase4:35175] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:21,902 DEBUG [RS:0;jenkins-hbase4:35175] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35175,1695903740297' 2023-09-28 12:22:21,902 DEBUG [RS:0;jenkins-hbase4:35175] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-28 12:22:21,903 DEBUG [RS:0;jenkins-hbase4:35175] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-28 12:22:21,904 DEBUG [RS:0;jenkins-hbase4:35175] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-28 12:22:21,904 DEBUG [RS:0;jenkins-hbase4:35175] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-28 12:22:21,904 DEBUG [RS:0;jenkins-hbase4:35175] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:21,904 DEBUG [RS:0;jenkins-hbase4:35175] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35175,1695903740297' 2023-09-28 12:22:21,904 DEBUG [RS:0;jenkins-hbase4:35175] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:22:21,904 DEBUG [RS:0;jenkins-hbase4:35175] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:22:21,905 DEBUG [RS:0;jenkins-hbase4:35175] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-28 12:22:21,905 INFO [RS:0;jenkins-hbase4:35175] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-28 12:22:21,905 INFO [RS:0;jenkins-hbase4:35175] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-28 12:22:21,906 INFO [RS:2;jenkins-hbase4:40363] regionserver.Replication(203): jenkins-hbase4.apache.org,40363,1695903740380 started 2023-09-28 12:22:21,906 INFO [RS:2;jenkins-hbase4:40363] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,40363,1695903740380, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40363, sessionid=0x100f27ca02f0003 2023-09-28 12:22:21,908 INFO [RS:1;jenkins-hbase4:39937] regionserver.Replication(203): jenkins-hbase4.apache.org,39937,1695903740345 started 2023-09-28 12:22:21,908 DEBUG [RS:2;jenkins-hbase4:40363] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-28 12:22:21,908 INFO [RS:1;jenkins-hbase4:39937] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39937,1695903740345, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39937, sessionid=0x100f27ca02f0002 2023-09-28 12:22:21,908 DEBUG [RS:2;jenkins-hbase4:40363] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:21,909 DEBUG [RS:1;jenkins-hbase4:39937] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-28 12:22:21,909 DEBUG [RS:1;jenkins-hbase4:39937] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:21,910 DEBUG [RS:1;jenkins-hbase4:39937] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39937,1695903740345' 2023-09-28 12:22:21,909 DEBUG [RS:2;jenkins-hbase4:40363] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40363,1695903740380' 2023-09-28 12:22:21,910 DEBUG [RS:2;jenkins-hbase4:40363] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-28 12:22:21,910 DEBUG [RS:1;jenkins-hbase4:39937] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-28 12:22:21,910 DEBUG [RS:2;jenkins-hbase4:40363] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-28 12:22:21,910 DEBUG [RS:1;jenkins-hbase4:39937] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-28 12:22:21,911 DEBUG [RS:2;jenkins-hbase4:40363] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-28 12:22:21,911 DEBUG [RS:2;jenkins-hbase4:40363] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-28 12:22:21,911 DEBUG [RS:2;jenkins-hbase4:40363] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:21,911 DEBUG [RS:2;jenkins-hbase4:40363] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40363,1695903740380' 2023-09-28 12:22:21,911 DEBUG [RS:1;jenkins-hbase4:39937] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-28 12:22:21,911 DEBUG [RS:2;jenkins-hbase4:40363] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:22:21,912 DEBUG [RS:1;jenkins-hbase4:39937] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-28 12:22:21,912 DEBUG [RS:1;jenkins-hbase4:39937] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:21,912 DEBUG [RS:1;jenkins-hbase4:39937] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39937,1695903740345' 2023-09-28 12:22:21,912 DEBUG [RS:1;jenkins-hbase4:39937] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:22:21,912 DEBUG [RS:1;jenkins-hbase4:39937] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:22:21,913 DEBUG [RS:1;jenkins-hbase4:39937] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-28 12:22:21,913 INFO [RS:1;jenkins-hbase4:39937] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-28 12:22:21,913 INFO [RS:1;jenkins-hbase4:39937] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-28 12:22:21,915 DEBUG [RS:2;jenkins-hbase4:40363] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:22:21,915 DEBUG [RS:2;jenkins-hbase4:40363] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-28 12:22:21,915 INFO [RS:2;jenkins-hbase4:40363] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-28 12:22:21,915 INFO [RS:2;jenkins-hbase4:40363] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-28 12:22:21,941 DEBUG [jenkins-hbase4:45395] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-28 12:22:21,947 DEBUG [jenkins-hbase4:45395] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-28 12:22:21,952 DEBUG [jenkins-hbase4:45395] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-28 12:22:21,952 DEBUG [jenkins-hbase4:45395] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-28 12:22:21,953 DEBUG [jenkins-hbase4:45395] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-28 12:22:21,953 DEBUG [jenkins-hbase4:45395] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-28 12:22:21,956 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40363,1695903740380, state=OPENING 2023-09-28 12:22:21,965 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-28 12:22:21,966 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 12:22:21,967 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-28 12:22:21,971 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40363,1695903740380}] 2023-09-28 12:22:22,017 INFO [RS:0;jenkins-hbase4:35175] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35175%2C1695903740297, suffix=, logDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/WALs/jenkins-hbase4.apache.org,35175,1695903740297, archiveDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/oldWALs, maxLogs=32 2023-09-28 12:22:22,017 INFO [RS:1;jenkins-hbase4:39937] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39937%2C1695903740345, suffix=, logDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/WALs/jenkins-hbase4.apache.org,39937,1695903740345, archiveDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/oldWALs, maxLogs=32 2023-09-28 12:22:22,018 INFO [RS:2;jenkins-hbase4:40363] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40363%2C1695903740380, suffix=, logDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/WALs/jenkins-hbase4.apache.org,40363,1695903740380, archiveDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/oldWALs, maxLogs=32 2023-09-28 12:22:22,042 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37189,DS-3e9a2b3f-841c-4e61-a6d1-9bbadd43f4d1,DISK] 2023-09-28 12:22:22,044 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37189,DS-3e9a2b3f-841c-4e61-a6d1-9bbadd43f4d1,DISK] 2023-09-28 12:22:22,045 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32921,DS-ac00ba0d-c87d-47a2-8750-1c8e467b18c8,DISK] 2023-09-28 12:22:22,045 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41987,DS-5e415af4-31b2-4fac-9e4e-423f6f8123a5,DISK] 2023-09-28 12:22:22,046 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41987,DS-5e415af4-31b2-4fac-9e4e-423f6f8123a5,DISK] 2023-09-28 12:22:22,046 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32921,DS-ac00ba0d-c87d-47a2-8750-1c8e467b18c8,DISK] 2023-09-28 12:22:22,059 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37189,DS-3e9a2b3f-841c-4e61-a6d1-9bbadd43f4d1,DISK] 2023-09-28 12:22:22,059 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32921,DS-ac00ba0d-c87d-47a2-8750-1c8e467b18c8,DISK] 2023-09-28 12:22:22,061 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41987,DS-5e415af4-31b2-4fac-9e4e-423f6f8123a5,DISK] 2023-09-28 12:22:22,062 INFO [RS:0;jenkins-hbase4:35175] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/WALs/jenkins-hbase4.apache.org,35175,1695903740297/jenkins-hbase4.apache.org%2C35175%2C1695903740297.1695903742022 2023-09-28 12:22:22,062 INFO [RS:1;jenkins-hbase4:39937] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/WALs/jenkins-hbase4.apache.org,39937,1695903740345/jenkins-hbase4.apache.org%2C39937%2C1695903740345.1695903742022 2023-09-28 12:22:22,065 DEBUG [RS:1;jenkins-hbase4:39937] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37189,DS-3e9a2b3f-841c-4e61-a6d1-9bbadd43f4d1,DISK], DatanodeInfoWithStorage[127.0.0.1:32921,DS-ac00ba0d-c87d-47a2-8750-1c8e467b18c8,DISK], DatanodeInfoWithStorage[127.0.0.1:41987,DS-5e415af4-31b2-4fac-9e4e-423f6f8123a5,DISK]] 2023-09-28 12:22:22,066 DEBUG [RS:0;jenkins-hbase4:35175] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37189,DS-3e9a2b3f-841c-4e61-a6d1-9bbadd43f4d1,DISK], DatanodeInfoWithStorage[127.0.0.1:41987,DS-5e415af4-31b2-4fac-9e4e-423f6f8123a5,DISK], DatanodeInfoWithStorage[127.0.0.1:32921,DS-ac00ba0d-c87d-47a2-8750-1c8e467b18c8,DISK]] 2023-09-28 12:22:22,069 INFO [RS:2;jenkins-hbase4:40363] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/WALs/jenkins-hbase4.apache.org,40363,1695903740380/jenkins-hbase4.apache.org%2C40363%2C1695903740380.1695903742022 2023-09-28 12:22:22,073 DEBUG [RS:2;jenkins-hbase4:40363] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:32921,DS-ac00ba0d-c87d-47a2-8750-1c8e467b18c8,DISK], DatanodeInfoWithStorage[127.0.0.1:41987,DS-5e415af4-31b2-4fac-9e4e-423f6f8123a5,DISK], DatanodeInfoWithStorage[127.0.0.1:37189,DS-3e9a2b3f-841c-4e61-a6d1-9bbadd43f4d1,DISK]] 2023-09-28 12:22:22,154 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:22,157 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-28 12:22:22,160 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44024, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-28 12:22:22,175 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-28 12:22:22,175 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-28 12:22:22,179 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40363%2C1695903740380.meta, suffix=.meta, logDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/WALs/jenkins-hbase4.apache.org,40363,1695903740380, archiveDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/oldWALs, maxLogs=32 2023-09-28 12:22:22,200 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41987,DS-5e415af4-31b2-4fac-9e4e-423f6f8123a5,DISK] 2023-09-28 12:22:22,200 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32921,DS-ac00ba0d-c87d-47a2-8750-1c8e467b18c8,DISK] 2023-09-28 12:22:22,202 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37189,DS-3e9a2b3f-841c-4e61-a6d1-9bbadd43f4d1,DISK] 2023-09-28 12:22:22,210 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/WALs/jenkins-hbase4.apache.org,40363,1695903740380/jenkins-hbase4.apache.org%2C40363%2C1695903740380.meta.1695903742180.meta 2023-09-28 12:22:22,211 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41987,DS-5e415af4-31b2-4fac-9e4e-423f6f8123a5,DISK], DatanodeInfoWithStorage[127.0.0.1:32921,DS-ac00ba0d-c87d-47a2-8750-1c8e467b18c8,DISK], DatanodeInfoWithStorage[127.0.0.1:37189,DS-3e9a2b3f-841c-4e61-a6d1-9bbadd43f4d1,DISK]] 2023-09-28 12:22:22,211 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-28 12:22:22,213 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-28 12:22:22,214 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 12:22:22,215 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-28 12:22:22,218 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-28 12:22:22,220 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-28 12:22:22,236 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-28 12:22:22,236 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 12:22:22,237 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-28 12:22:22,237 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-28 12:22:22,240 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-28 12:22:22,242 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/meta/1588230740/info 2023-09-28 12:22:22,242 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/meta/1588230740/info 2023-09-28 12:22:22,243 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-28 12:22:22,243 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 12:22:22,244 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-28 12:22:22,245 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/meta/1588230740/rep_barrier 2023-09-28 12:22:22,246 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/meta/1588230740/rep_barrier 2023-09-28 12:22:22,246 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-28 12:22:22,247 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 12:22:22,247 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-28 12:22:22,249 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/meta/1588230740/table 2023-09-28 12:22:22,249 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/meta/1588230740/table 2023-09-28 12:22:22,250 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-28 12:22:22,251 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 12:22:22,253 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/meta/1588230740 2023-09-28 12:22:22,257 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/meta/1588230740 2023-09-28 12:22:22,260 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-28 12:22:22,263 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-28 12:22:22,264 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62374290, jitterRate=-0.07055065035820007}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-28 12:22:22,268 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-28 12:22:22,281 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1695903742147 2023-09-28 12:22:22,303 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-28 12:22:22,303 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-28 12:22:22,304 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40363,1695903740380, state=OPEN 2023-09-28 12:22:22,307 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-28 12:22:22,307 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-28 12:22:22,311 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-28 12:22:22,311 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40363,1695903740380 in 336 msec 2023-09-28 12:22:22,319 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-28 12:22:22,319 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 550 msec 2023-09-28 12:22:22,325 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 817 msec 2023-09-28 12:22:22,325 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1695903742325, completionTime=-1 2023-09-28 12:22:22,325 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-28 12:22:22,325 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-28 12:22:22,395 DEBUG [hconnection-0x552cecd0-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 12:22:22,398 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44040, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 12:22:22,427 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-28 12:22:22,427 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1695903802427 2023-09-28 12:22:22,427 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1695903862427 2023-09-28 12:22:22,427 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 102 msec 2023-09-28 12:22:22,450 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45395,1695903738972-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-28 12:22:22,451 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45395,1695903738972-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-28 12:22:22,451 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45395,1695903738972-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-28 12:22:22,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:45395, period=300000, unit=MILLISECONDS is enabled. 2023-09-28 12:22:22,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-28 12:22:22,459 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-28 12:22:22,468 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-28 12:22:22,469 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-28 12:22:22,478 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-28 12:22:22,481 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-28 12:22:22,484 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-28 12:22:22,512 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/hbase/namespace/b76c299f3a811003291b50d263ea4180 2023-09-28 12:22:22,515 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/hbase/namespace/b76c299f3a811003291b50d263ea4180 empty. 2023-09-28 12:22:22,516 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/hbase/namespace/b76c299f3a811003291b50d263ea4180 2023-09-28 12:22:22,516 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-28 12:22:22,555 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-28 12:22:22,557 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => b76c299f3a811003291b50d263ea4180, NAME => 'hbase:namespace,,1695903742469.b76c299f3a811003291b50d263ea4180.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp 2023-09-28 12:22:22,576 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695903742469.b76c299f3a811003291b50d263ea4180.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 12:22:22,577 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing b76c299f3a811003291b50d263ea4180, disabling compactions & flushes 2023-09-28 12:22:22,577 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695903742469.b76c299f3a811003291b50d263ea4180. 2023-09-28 12:22:22,577 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695903742469.b76c299f3a811003291b50d263ea4180. 2023-09-28 12:22:22,577 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695903742469.b76c299f3a811003291b50d263ea4180. after waiting 0 ms 2023-09-28 12:22:22,577 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695903742469.b76c299f3a811003291b50d263ea4180. 2023-09-28 12:22:22,577 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695903742469.b76c299f3a811003291b50d263ea4180. 2023-09-28 12:22:22,577 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for b76c299f3a811003291b50d263ea4180: 2023-09-28 12:22:22,583 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-28 12:22:22,603 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1695903742469.b76c299f3a811003291b50d263ea4180.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695903742586"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695903742586"}]},"ts":"1695903742586"} 2023-09-28 12:22:22,640 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-28 12:22:22,643 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-28 12:22:22,647 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695903742643"}]},"ts":"1695903742643"} 2023-09-28 12:22:22,652 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-28 12:22:22,657 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-28 12:22:22,658 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-28 12:22:22,658 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-28 12:22:22,658 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-28 12:22:22,658 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-28 12:22:22,664 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=b76c299f3a811003291b50d263ea4180, ASSIGN}] 2023-09-28 12:22:22,668 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=b76c299f3a811003291b50d263ea4180, ASSIGN 2023-09-28 12:22:22,670 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=b76c299f3a811003291b50d263ea4180, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40363,1695903740380; forceNewPlan=false, retain=false 2023-09-28 12:22:22,822 INFO [jenkins-hbase4:45395] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-28 12:22:22,823 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=b76c299f3a811003291b50d263ea4180, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:22,823 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1695903742469.b76c299f3a811003291b50d263ea4180.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695903742822"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695903742822"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695903742822"}]},"ts":"1695903742822"} 2023-09-28 12:22:22,827 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure b76c299f3a811003291b50d263ea4180, server=jenkins-hbase4.apache.org,40363,1695903740380}] 2023-09-28 12:22:22,989 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1695903742469.b76c299f3a811003291b50d263ea4180. 2023-09-28 12:22:22,989 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b76c299f3a811003291b50d263ea4180, NAME => 'hbase:namespace,,1695903742469.b76c299f3a811003291b50d263ea4180.', STARTKEY => '', ENDKEY => ''} 2023-09-28 12:22:22,989 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1695903742469.b76c299f3a811003291b50d263ea4180. service=AccessControlService 2023-09-28 12:22:22,990 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 12:22:22,990 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace b76c299f3a811003291b50d263ea4180 2023-09-28 12:22:22,991 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695903742469.b76c299f3a811003291b50d263ea4180.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 12:22:22,991 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b76c299f3a811003291b50d263ea4180 2023-09-28 12:22:22,991 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b76c299f3a811003291b50d263ea4180 2023-09-28 12:22:22,993 INFO [StoreOpener-b76c299f3a811003291b50d263ea4180-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region b76c299f3a811003291b50d263ea4180 2023-09-28 12:22:22,995 DEBUG [StoreOpener-b76c299f3a811003291b50d263ea4180-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/namespace/b76c299f3a811003291b50d263ea4180/info 2023-09-28 12:22:22,995 DEBUG [StoreOpener-b76c299f3a811003291b50d263ea4180-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/namespace/b76c299f3a811003291b50d263ea4180/info 2023-09-28 12:22:22,996 INFO [StoreOpener-b76c299f3a811003291b50d263ea4180-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b76c299f3a811003291b50d263ea4180 columnFamilyName info 2023-09-28 12:22:22,996 INFO [StoreOpener-b76c299f3a811003291b50d263ea4180-1] regionserver.HStore(310): Store=b76c299f3a811003291b50d263ea4180/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 12:22:22,998 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/namespace/b76c299f3a811003291b50d263ea4180 2023-09-28 12:22:22,999 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/namespace/b76c299f3a811003291b50d263ea4180 2023-09-28 12:22:23,003 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b76c299f3a811003291b50d263ea4180 2023-09-28 12:22:23,006 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/namespace/b76c299f3a811003291b50d263ea4180/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 12:22:23,007 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b76c299f3a811003291b50d263ea4180; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61973969, jitterRate=-0.07651589810848236}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 12:22:23,007 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b76c299f3a811003291b50d263ea4180: 2023-09-28 12:22:23,009 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1695903742469.b76c299f3a811003291b50d263ea4180., pid=6, masterSystemTime=1695903742982 2023-09-28 12:22:23,013 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1695903742469.b76c299f3a811003291b50d263ea4180. 2023-09-28 12:22:23,013 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1695903742469.b76c299f3a811003291b50d263ea4180. 2023-09-28 12:22:23,015 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=b76c299f3a811003291b50d263ea4180, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:23,015 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1695903742469.b76c299f3a811003291b50d263ea4180.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695903743014"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695903743014"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695903743014"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695903743014"}]},"ts":"1695903743014"} 2023-09-28 12:22:23,023 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-28 12:22:23,023 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure b76c299f3a811003291b50d263ea4180, server=jenkins-hbase4.apache.org,40363,1695903740380 in 191 msec 2023-09-28 12:22:23,027 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-28 12:22:23,028 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=b76c299f3a811003291b50d263ea4180, ASSIGN in 359 msec 2023-09-28 12:22:23,029 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-28 12:22:23,029 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695903743029"}]},"ts":"1695903743029"} 2023-09-28 12:22:23,031 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-28 12:22:23,035 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-28 12:22:23,039 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 566 msec 2023-09-28 12:22:23,081 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-28 12:22:23,082 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-28 12:22:23,082 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 12:22:23,115 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-28 12:22:23,129 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-28 12:22:23,135 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 27 msec 2023-09-28 12:22:23,138 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-28 12:22:23,152 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-28 12:22:23,157 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-09-28 12:22:23,164 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-28 12:22:23,172 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-28 12:22:23,172 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.727sec 2023-09-28 12:22:23,175 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-28 12:22:23,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-28 12:22:23,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-28 12:22:23,178 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45395,1695903738972-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-28 12:22:23,178 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45395,1695903738972-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-28 12:22:23,199 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-28 12:22:23,201 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-28 12:22:23,203 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-28 12:22:23,204 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-28 12:22:23,207 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-28 12:22:23,207 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/hbase/acl/60fcb1e86482093d728cff835802f62d 2023-09-28 12:22:23,208 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/hbase/acl/60fcb1e86482093d728cff835802f62d empty. 2023-09-28 12:22:23,211 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/hbase/acl/60fcb1e86482093d728cff835802f62d 2023-09-28 12:22:23,211 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-28 12:22:23,216 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-28 12:22:23,217 DEBUG [Listener at localhost/44031] zookeeper.ReadOnlyZKClient(139): Connect 0x45bc384d to 127.0.0.1:65025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 12:22:23,224 DEBUG [Listener at localhost/44031] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d32f7c5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 12:22:23,241 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-28 12:22:23,243 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 60fcb1e86482093d728cff835802f62d, NAME => 'hbase:acl,,1695903743195.60fcb1e86482093d728cff835802f62d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp 2023-09-28 12:22:23,253 DEBUG [hconnection-0x16ac9256-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 12:22:23,271 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695903743195.60fcb1e86482093d728cff835802f62d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 12:22:23,272 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 60fcb1e86482093d728cff835802f62d, disabling compactions & flushes 2023-09-28 12:22:23,272 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695903743195.60fcb1e86482093d728cff835802f62d. 2023-09-28 12:22:23,272 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695903743195.60fcb1e86482093d728cff835802f62d. 2023-09-28 12:22:23,272 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695903743195.60fcb1e86482093d728cff835802f62d. after waiting 0 ms 2023-09-28 12:22:23,272 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695903743195.60fcb1e86482093d728cff835802f62d. 2023-09-28 12:22:23,272 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1695903743195.60fcb1e86482093d728cff835802f62d. 2023-09-28 12:22:23,272 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 60fcb1e86482093d728cff835802f62d: 2023-09-28 12:22:23,274 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44042, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 12:22:23,277 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-28 12:22:23,277 INFO [Listener at localhost/44031] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,45395,1695903738972 2023-09-28 12:22:23,277 INFO [Listener at localhost/44031] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-28 12:22:23,278 INFO [Listener at localhost/44031] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/test.cache.data in system properties and HBase conf 2023-09-28 12:22:23,278 INFO [Listener at localhost/44031] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/hadoop.tmp.dir in system properties and HBase conf 2023-09-28 12:22:23,278 INFO [Listener at localhost/44031] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/hadoop.log.dir in system properties and HBase conf 2023-09-28 12:22:23,278 INFO [Listener at localhost/44031] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-28 12:22:23,278 INFO [Listener at localhost/44031] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-28 12:22:23,278 INFO [Listener at localhost/44031] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-28 12:22:23,278 INFO [Listener at localhost/44031] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-28 12:22:23,278 INFO [Listener at localhost/44031] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-28 12:22:23,278 INFO [Listener at localhost/44031] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-28 12:22:23,278 INFO [Listener at localhost/44031] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-28 12:22:23,278 INFO [Listener at localhost/44031] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-28 12:22:23,278 INFO [Listener at localhost/44031] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-28 12:22:23,279 INFO [Listener at localhost/44031] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-28 12:22:23,279 INFO [Listener at localhost/44031] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-28 12:22:23,279 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1695903743195.60fcb1e86482093d728cff835802f62d.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695903743278"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695903743278"}]},"ts":"1695903743278"} 2023-09-28 12:22:23,279 INFO [Listener at localhost/44031] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-28 12:22:23,279 INFO [Listener at localhost/44031] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/nfs.dump.dir in system properties and HBase conf 2023-09-28 12:22:23,279 INFO [Listener at localhost/44031] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/java.io.tmpdir in system properties and HBase conf 2023-09-28 12:22:23,279 INFO [Listener at localhost/44031] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-28 12:22:23,279 INFO [Listener at localhost/44031] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-28 12:22:23,279 INFO [Listener at localhost/44031] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-28 12:22:23,282 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-28 12:22:23,283 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-28 12:22:23,284 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695903743284"}]},"ts":"1695903743284"} 2023-09-28 12:22:23,286 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-28 12:22:23,293 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-28 12:22:23,294 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-28 12:22:23,294 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-28 12:22:23,294 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-28 12:22:23,295 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-28 12:22:23,295 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=60fcb1e86482093d728cff835802f62d, ASSIGN}] 2023-09-28 12:22:23,299 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=60fcb1e86482093d728cff835802f62d, ASSIGN 2023-09-28 12:22:23,301 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=60fcb1e86482093d728cff835802f62d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40363,1695903740380; forceNewPlan=false, retain=false 2023-09-28 12:22:23,322 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-28 12:22:23,451 INFO [jenkins-hbase4:45395] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-28 12:22:23,453 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=60fcb1e86482093d728cff835802f62d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:23,453 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1695903743195.60fcb1e86482093d728cff835802f62d.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695903743453"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695903743453"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695903743453"}]},"ts":"1695903743453"} 2023-09-28 12:22:23,457 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 60fcb1e86482093d728cff835802f62d, server=jenkins-hbase4.apache.org,40363,1695903740380}] 2023-09-28 12:22:23,522 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-28 12:22:23,619 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1695903743195.60fcb1e86482093d728cff835802f62d. 2023-09-28 12:22:23,621 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 60fcb1e86482093d728cff835802f62d, NAME => 'hbase:acl,,1695903743195.60fcb1e86482093d728cff835802f62d.', STARTKEY => '', ENDKEY => ''} 2023-09-28 12:22:23,621 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1695903743195.60fcb1e86482093d728cff835802f62d. service=AccessControlService 2023-09-28 12:22:23,621 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 12:22:23,622 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 60fcb1e86482093d728cff835802f62d 2023-09-28 12:22:23,622 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695903743195.60fcb1e86482093d728cff835802f62d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 12:22:23,622 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 60fcb1e86482093d728cff835802f62d 2023-09-28 12:22:23,622 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 60fcb1e86482093d728cff835802f62d 2023-09-28 12:22:23,624 INFO [StoreOpener-60fcb1e86482093d728cff835802f62d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 60fcb1e86482093d728cff835802f62d 2023-09-28 12:22:23,627 DEBUG [StoreOpener-60fcb1e86482093d728cff835802f62d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/acl/60fcb1e86482093d728cff835802f62d/l 2023-09-28 12:22:23,627 DEBUG [StoreOpener-60fcb1e86482093d728cff835802f62d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/acl/60fcb1e86482093d728cff835802f62d/l 2023-09-28 12:22:23,628 INFO [StoreOpener-60fcb1e86482093d728cff835802f62d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 60fcb1e86482093d728cff835802f62d columnFamilyName l 2023-09-28 12:22:23,629 INFO [StoreOpener-60fcb1e86482093d728cff835802f62d-1] regionserver.HStore(310): Store=60fcb1e86482093d728cff835802f62d/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 12:22:23,631 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/acl/60fcb1e86482093d728cff835802f62d 2023-09-28 12:22:23,632 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/acl/60fcb1e86482093d728cff835802f62d 2023-09-28 12:22:23,638 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 60fcb1e86482093d728cff835802f62d 2023-09-28 12:22:23,643 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/acl/60fcb1e86482093d728cff835802f62d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 12:22:23,644 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 60fcb1e86482093d728cff835802f62d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62751034, jitterRate=-0.06493672728538513}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 12:22:23,644 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 60fcb1e86482093d728cff835802f62d: 2023-09-28 12:22:23,647 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1695903743195.60fcb1e86482093d728cff835802f62d., pid=11, masterSystemTime=1695903743612 2023-09-28 12:22:23,651 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1695903743195.60fcb1e86482093d728cff835802f62d. 2023-09-28 12:22:23,651 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1695903743195.60fcb1e86482093d728cff835802f62d. 2023-09-28 12:22:23,651 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=60fcb1e86482093d728cff835802f62d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:23,652 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1695903743195.60fcb1e86482093d728cff835802f62d.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695903743651"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695903743651"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695903743651"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695903743651"}]},"ts":"1695903743651"} 2023-09-28 12:22:23,662 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-28 12:22:23,663 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 60fcb1e86482093d728cff835802f62d, server=jenkins-hbase4.apache.org,40363,1695903740380 in 201 msec 2023-09-28 12:22:23,668 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-28 12:22:23,668 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=60fcb1e86482093d728cff835802f62d, ASSIGN in 368 msec 2023-09-28 12:22:23,669 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-28 12:22:23,669 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695903743669"}]},"ts":"1695903743669"} 2023-09-28 12:22:23,672 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-28 12:22:23,676 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-28 12:22:23,679 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 477 msec 2023-09-28 12:22:23,822 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-28 12:22:23,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-28 12:22:23,839 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-28 12:22:24,657 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-28 12:22:25,044 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-09-28 12:22:25,051 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46275_jobhistory____.68mg7d/webapp 2023-09-28 12:22:25,233 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-28 12:22:25,234 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-28 12:22:25,234 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-28 12:22:25,237 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-28 12:22:25,323 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 12:22:25,649 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 12:22:25,929 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-28 12:22:25,963 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46275 2023-09-28 12:22:26,156 WARN [Listener at jenkins-hbase4.apache.org/34137] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-28 12:22:26,500 WARN [Listener at jenkins-hbase4.apache.org/34137] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-28 12:22:26,501 INFO [Listener at jenkins-hbase4.apache.org/34137] log.Slf4jLog(67): jetty-6.1.26 2023-09-28 12:22:26,509 INFO [Listener at jenkins-hbase4.apache.org/34137] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_40087_cluster____dzyv81/webapp 2023-09-28 12:22:26,608 INFO [Listener at jenkins-hbase4.apache.org/34137] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-28 12:22:26,608 INFO [Listener at jenkins-hbase4.apache.org/34137] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-28 12:22:26,608 INFO [Listener at jenkins-hbase4.apache.org/34137] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-28 12:22:26,609 INFO [Listener at jenkins-hbase4.apache.org/34137] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-28 12:22:26,623 INFO [Listener at jenkins-hbase4.apache.org/34137] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 12:22:26,859 INFO [Listener at jenkins-hbase4.apache.org/34137] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 12:22:26,987 INFO [Listener at jenkins-hbase4.apache.org/34137] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 12:22:26,998 INFO [Listener at jenkins-hbase4.apache.org/34137] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:40087 2023-09-28 12:22:27,512 WARN [Listener at jenkins-hbase4.apache.org/37549] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-28 12:22:27,538 WARN [Listener at jenkins-hbase4.apache.org/37549] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-28 12:22:27,538 INFO [Listener at jenkins-hbase4.apache.org/37549] log.Slf4jLog(67): jetty-6.1.26 2023-09-28 12:22:27,548 INFO [Listener at jenkins-hbase4.apache.org/37549] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_43459_node____495qnr/webapp 2023-09-28 12:22:27,600 INFO [Listener at jenkins-hbase4.apache.org/37549] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-28 12:22:27,600 INFO [Listener at jenkins-hbase4.apache.org/37549] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-28 12:22:27,600 INFO [Listener at jenkins-hbase4.apache.org/37549] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-28 12:22:27,600 INFO [Listener at jenkins-hbase4.apache.org/37549] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-28 12:22:27,608 INFO [Listener at jenkins-hbase4.apache.org/37549] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 12:22:27,630 INFO [Listener at jenkins-hbase4.apache.org/37549] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 12:22:27,701 INFO [Listener at jenkins-hbase4.apache.org/37549] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 12:22:27,715 INFO [Listener at jenkins-hbase4.apache.org/37549] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:43459 2023-09-28 12:22:27,786 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-28 12:22:27,948 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-28 12:22:27,950 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-28 12:22:27,951 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-28 12:22:28,066 WARN [Listener at jenkins-hbase4.apache.org/33885] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-28 12:22:28,072 WARN [Listener at jenkins-hbase4.apache.org/33885] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-28 12:22:28,072 INFO [Listener at jenkins-hbase4.apache.org/33885] log.Slf4jLog(67): jetty-6.1.26 2023-09-28 12:22:28,084 INFO [Listener at jenkins-hbase4.apache.org/33885] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_39877_node____rcv2uo/webapp 2023-09-28 12:22:28,160 INFO [Listener at jenkins-hbase4.apache.org/33885] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-28 12:22:28,161 INFO [Listener at jenkins-hbase4.apache.org/33885] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-28 12:22:28,161 INFO [Listener at jenkins-hbase4.apache.org/33885] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-28 12:22:28,161 INFO [Listener at jenkins-hbase4.apache.org/33885] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-28 12:22:28,174 INFO [Listener at jenkins-hbase4.apache.org/33885] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 12:22:28,197 INFO [Listener at jenkins-hbase4.apache.org/33885] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 12:22:28,280 INFO [Listener at jenkins-hbase4.apache.org/33885] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 12:22:28,287 INFO [Listener at jenkins-hbase4.apache.org/33885] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39877 2023-09-28 12:22:28,316 INFO [Listener at jenkins-hbase4.apache.org/33885] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-28 12:22:28,318 INFO [Listener at jenkins-hbase4.apache.org/33885] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 12:22:28,382 INFO [Listener at jenkins-hbase4.apache.org/33885] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=703, OpenFileDescriptor=896, MaxFileDescriptor=60000, SystemLoadAverage=169, ProcessCount=168, AvailableMemoryMB=5635 2023-09-28 12:22:28,382 WARN [Listener at jenkins-hbase4.apache.org/33885] hbase.ResourceChecker(130): Thread=703 is superior to 500 2023-09-28 12:22:28,399 DEBUG [Listener at jenkins-hbase4.apache.org/33885] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-28 12:22:28,404 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40546, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-28 12:22:28,411 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-28 12:22:28,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-28 12:22:28,416 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-28 12:22:28,417 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-28 12:22:28,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-28 12:22:28,419 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-28 12:22:28,424 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportWithTargetName/859284cdd1e050e646505823826ea0cd 2023-09-28 12:22:28,424 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportWithTargetName/8925a5853bc13b91b40985612eee2abd 2023-09-28 12:22:28,426 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportWithTargetName/8925a5853bc13b91b40985612eee2abd empty. 2023-09-28 12:22:28,426 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportWithTargetName/859284cdd1e050e646505823826ea0cd empty. 2023-09-28 12:22:28,427 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportWithTargetName/8925a5853bc13b91b40985612eee2abd 2023-09-28 12:22:28,430 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportWithTargetName/859284cdd1e050e646505823826ea0cd 2023-09-28 12:22:28,430 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-28 12:22:28,460 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-28 12:22:28,462 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 859284cdd1e050e646505823826ea0cd, NAME => 'testtb-testExportWithTargetName,,1695903748411.859284cdd1e050e646505823826ea0cd.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp 2023-09-28 12:22:28,462 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8925a5853bc13b91b40985612eee2abd, NAME => 'testtb-testExportWithTargetName,1,1695903748411.8925a5853bc13b91b40985612eee2abd.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp 2023-09-28 12:22:28,498 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695903748411.859284cdd1e050e646505823826ea0cd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 12:22:28,500 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 859284cdd1e050e646505823826ea0cd, disabling compactions & flushes 2023-09-28 12:22:28,500 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695903748411.859284cdd1e050e646505823826ea0cd. 2023-09-28 12:22:28,500 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695903748411.859284cdd1e050e646505823826ea0cd. 2023-09-28 12:22:28,500 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695903748411.859284cdd1e050e646505823826ea0cd. after waiting 0 ms 2023-09-28 12:22:28,500 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695903748411.859284cdd1e050e646505823826ea0cd. 2023-09-28 12:22:28,500 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695903748411.8925a5853bc13b91b40985612eee2abd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 12:22:28,500 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695903748411.859284cdd1e050e646505823826ea0cd. 2023-09-28 12:22:28,501 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 8925a5853bc13b91b40985612eee2abd, disabling compactions & flushes 2023-09-28 12:22:28,501 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 859284cdd1e050e646505823826ea0cd: 2023-09-28 12:22:28,501 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695903748411.8925a5853bc13b91b40985612eee2abd. 2023-09-28 12:22:28,501 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695903748411.8925a5853bc13b91b40985612eee2abd. 2023-09-28 12:22:28,501 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695903748411.8925a5853bc13b91b40985612eee2abd. after waiting 0 ms 2023-09-28 12:22:28,501 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695903748411.8925a5853bc13b91b40985612eee2abd. 2023-09-28 12:22:28,501 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695903748411.8925a5853bc13b91b40985612eee2abd. 2023-09-28 12:22:28,502 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 8925a5853bc13b91b40985612eee2abd: 2023-09-28 12:22:28,505 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-28 12:22:28,507 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695903748411.859284cdd1e050e646505823826ea0cd.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695903748507"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695903748507"}]},"ts":"1695903748507"} 2023-09-28 12:22:28,507 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695903748411.8925a5853bc13b91b40985612eee2abd.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695903748507"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695903748507"}]},"ts":"1695903748507"} 2023-09-28 12:22:28,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-28 12:22:28,562 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-28 12:22:28,564 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-28 12:22:28,564 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695903748564"}]},"ts":"1695903748564"} 2023-09-28 12:22:28,567 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-28 12:22:28,573 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-28 12:22:28,575 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-28 12:22:28,575 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-28 12:22:28,575 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-28 12:22:28,575 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-28 12:22:28,576 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=859284cdd1e050e646505823826ea0cd, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8925a5853bc13b91b40985612eee2abd, ASSIGN}] 2023-09-28 12:22:28,579 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8925a5853bc13b91b40985612eee2abd, ASSIGN 2023-09-28 12:22:28,579 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=859284cdd1e050e646505823826ea0cd, ASSIGN 2023-09-28 12:22:28,580 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=859284cdd1e050e646505823826ea0cd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35175,1695903740297; forceNewPlan=false, retain=false 2023-09-28 12:22:28,580 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8925a5853bc13b91b40985612eee2abd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39937,1695903740345; forceNewPlan=false, retain=false 2023-09-28 12:22:28,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-28 12:22:28,731 INFO [jenkins-hbase4:45395] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-28 12:22:28,733 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=859284cdd1e050e646505823826ea0cd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:28,733 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=8925a5853bc13b91b40985612eee2abd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:28,733 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695903748411.859284cdd1e050e646505823826ea0cd.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695903748733"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695903748733"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695903748733"}]},"ts":"1695903748733"} 2023-09-28 12:22:28,734 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695903748411.8925a5853bc13b91b40985612eee2abd.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695903748733"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695903748733"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695903748733"}]},"ts":"1695903748733"} 2023-09-28 12:22:28,736 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 859284cdd1e050e646505823826ea0cd, server=jenkins-hbase4.apache.org,35175,1695903740297}] 2023-09-28 12:22:28,738 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 8925a5853bc13b91b40985612eee2abd, server=jenkins-hbase4.apache.org,39937,1695903740345}] 2023-09-28 12:22:28,892 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:28,892 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:28,892 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-28 12:22:28,892 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-28 12:22:28,896 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37896, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-28 12:22:28,897 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52450, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-28 12:22:28,905 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1695903748411.859284cdd1e050e646505823826ea0cd. 2023-09-28 12:22:28,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 859284cdd1e050e646505823826ea0cd, NAME => 'testtb-testExportWithTargetName,,1695903748411.859284cdd1e050e646505823826ea0cd.', STARTKEY => '', ENDKEY => '1'} 2023-09-28 12:22:28,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1695903748411.859284cdd1e050e646505823826ea0cd. service=AccessControlService 2023-09-28 12:22:28,906 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 12:22:28,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 859284cdd1e050e646505823826ea0cd 2023-09-28 12:22:28,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695903748411.859284cdd1e050e646505823826ea0cd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 12:22:28,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 859284cdd1e050e646505823826ea0cd 2023-09-28 12:22:28,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 859284cdd1e050e646505823826ea0cd 2023-09-28 12:22:28,911 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1695903748411.8925a5853bc13b91b40985612eee2abd. 2023-09-28 12:22:28,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8925a5853bc13b91b40985612eee2abd, NAME => 'testtb-testExportWithTargetName,1,1695903748411.8925a5853bc13b91b40985612eee2abd.', STARTKEY => '1', ENDKEY => ''} 2023-09-28 12:22:28,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1695903748411.8925a5853bc13b91b40985612eee2abd. service=AccessControlService 2023-09-28 12:22:28,912 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 12:22:28,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 8925a5853bc13b91b40985612eee2abd 2023-09-28 12:22:28,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695903748411.8925a5853bc13b91b40985612eee2abd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 12:22:28,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8925a5853bc13b91b40985612eee2abd 2023-09-28 12:22:28,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8925a5853bc13b91b40985612eee2abd 2023-09-28 12:22:28,914 INFO [StoreOpener-859284cdd1e050e646505823826ea0cd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 859284cdd1e050e646505823826ea0cd 2023-09-28 12:22:28,922 INFO [StoreOpener-8925a5853bc13b91b40985612eee2abd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8925a5853bc13b91b40985612eee2abd 2023-09-28 12:22:28,923 DEBUG [StoreOpener-859284cdd1e050e646505823826ea0cd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportWithTargetName/859284cdd1e050e646505823826ea0cd/cf 2023-09-28 12:22:28,924 DEBUG [StoreOpener-859284cdd1e050e646505823826ea0cd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportWithTargetName/859284cdd1e050e646505823826ea0cd/cf 2023-09-28 12:22:28,924 DEBUG [StoreOpener-8925a5853bc13b91b40985612eee2abd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportWithTargetName/8925a5853bc13b91b40985612eee2abd/cf 2023-09-28 12:22:28,924 DEBUG [StoreOpener-8925a5853bc13b91b40985612eee2abd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportWithTargetName/8925a5853bc13b91b40985612eee2abd/cf 2023-09-28 12:22:28,927 INFO [StoreOpener-8925a5853bc13b91b40985612eee2abd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8925a5853bc13b91b40985612eee2abd columnFamilyName cf 2023-09-28 12:22:28,927 INFO [StoreOpener-859284cdd1e050e646505823826ea0cd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 859284cdd1e050e646505823826ea0cd columnFamilyName cf 2023-09-28 12:22:28,930 INFO [StoreOpener-8925a5853bc13b91b40985612eee2abd-1] regionserver.HStore(310): Store=8925a5853bc13b91b40985612eee2abd/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 12:22:28,931 INFO [StoreOpener-859284cdd1e050e646505823826ea0cd-1] regionserver.HStore(310): Store=859284cdd1e050e646505823826ea0cd/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 12:22:28,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportWithTargetName/8925a5853bc13b91b40985612eee2abd 2023-09-28 12:22:28,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportWithTargetName/859284cdd1e050e646505823826ea0cd 2023-09-28 12:22:28,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportWithTargetName/8925a5853bc13b91b40985612eee2abd 2023-09-28 12:22:28,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportWithTargetName/859284cdd1e050e646505823826ea0cd 2023-09-28 12:22:28,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 859284cdd1e050e646505823826ea0cd 2023-09-28 12:22:28,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8925a5853bc13b91b40985612eee2abd 2023-09-28 12:22:28,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportWithTargetName/859284cdd1e050e646505823826ea0cd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 12:22:28,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportWithTargetName/8925a5853bc13b91b40985612eee2abd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 12:22:28,960 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 859284cdd1e050e646505823826ea0cd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70983659, jitterRate=0.05773894488811493}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 12:22:28,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 859284cdd1e050e646505823826ea0cd: 2023-09-28 12:22:28,960 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8925a5853bc13b91b40985612eee2abd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69070678, jitterRate=0.029233306646347046}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 12:22:28,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8925a5853bc13b91b40985612eee2abd: 2023-09-28 12:22:28,961 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1695903748411.859284cdd1e050e646505823826ea0cd., pid=15, masterSystemTime=1695903748892 2023-09-28 12:22:28,962 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1695903748411.8925a5853bc13b91b40985612eee2abd., pid=16, masterSystemTime=1695903748892 2023-09-28 12:22:28,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1695903748411.859284cdd1e050e646505823826ea0cd. 2023-09-28 12:22:28,967 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1695903748411.859284cdd1e050e646505823826ea0cd. 2023-09-28 12:22:28,968 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=859284cdd1e050e646505823826ea0cd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:28,968 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1695903748411.859284cdd1e050e646505823826ea0cd.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695903748968"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695903748968"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695903748968"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695903748968"}]},"ts":"1695903748968"} 2023-09-28 12:22:28,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1695903748411.8925a5853bc13b91b40985612eee2abd. 2023-09-28 12:22:28,969 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1695903748411.8925a5853bc13b91b40985612eee2abd. 2023-09-28 12:22:28,970 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=8925a5853bc13b91b40985612eee2abd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:28,971 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1695903748411.8925a5853bc13b91b40985612eee2abd.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695903748970"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695903748970"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695903748970"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695903748970"}]},"ts":"1695903748970"} 2023-09-28 12:22:28,976 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=13 2023-09-28 12:22:28,976 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 859284cdd1e050e646505823826ea0cd, server=jenkins-hbase4.apache.org,35175,1695903740297 in 237 msec 2023-09-28 12:22:28,979 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=859284cdd1e050e646505823826ea0cd, ASSIGN in 400 msec 2023-09-28 12:22:28,979 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=14 2023-09-28 12:22:28,984 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 8925a5853bc13b91b40985612eee2abd, server=jenkins-hbase4.apache.org,39937,1695903740345 in 238 msec 2023-09-28 12:22:28,988 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=12 2023-09-28 12:22:28,988 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8925a5853bc13b91b40985612eee2abd, ASSIGN in 407 msec 2023-09-28 12:22:28,989 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-28 12:22:28,989 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695903748989"}]},"ts":"1695903748989"} 2023-09-28 12:22:28,991 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-28 12:22:28,994 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-28 12:22:28,999 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-28 12:22:29,017 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40363] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-28 12:22:29,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-28 12:22:29,060 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-28 12:22:29,060 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-28 12:22:29,060 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-28 12:22:29,060 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 12:22:29,060 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-28 12:22:29,068 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-28 12:22:29,069 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-28 12:22:29,068 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-28 12:22:29,069 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-28 12:22:29,070 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-28 12:22:29,070 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-28 12:22:29,072 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-28 12:22:29,074 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 658 msec 2023-09-28 12:22:29,166 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 12:22:29,167 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-28 12:22:29,168 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 12:22:29,168 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-28 12:22:29,168 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-28 12:22:29,168 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-28 12:22:29,168 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 12:22:29,168 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-28 12:22:29,169 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-28 12:22:29,169 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-28 12:22:29,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-28 12:22:29,526 INFO [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-28 12:22:29,530 DEBUG [Listener at jenkins-hbase4.apache.org/33885] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-28 12:22:29,531 DEBUG [Listener at jenkins-hbase4.apache.org/33885] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695903748411.859284cdd1e050e646505823826ea0cd. 2023-09-28 12:22:29,534 INFO [Listener at jenkins-hbase4.apache.org/33885] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 12:22:29,556 DEBUG [hconnection-0x16ac9256-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 12:22:29,561 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37908, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 12:22:29,563 DEBUG [hconnection-0x16ac9256-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 12:22:29,567 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52464, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 12:22:29,581 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-28 12:22:29,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695903749581 (current time:1695903749581). 2023-09-28 12:22:29,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 12:22:29,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(139): Connect 0x24d73a28 to 127.0.0.1:65025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 12:22:29,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@eccc5aa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 12:22:29,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 12:22:29,592 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51464, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 12:22:29,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x24d73a28 to 127.0.0.1:65025 2023-09-28 12:22:29,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 12:22:29,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(139): Connect 0x7134bdf1 to 127.0.0.1:65025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 12:22:29,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56343446, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 12:22:29,700 DEBUG [hconnection-0x6792f771-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 12:22:29,704 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51466, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 12:22:29,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7134bdf1 to 127.0.0.1:65025 2023-09-28 12:22:29,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 12:22:29,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-28 12:22:29,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 12:22:29,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-28 12:22:29,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-28 12:22:29,756 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-28 12:22:29,757 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695904349757 2023-09-28 12:22:29,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-28 12:22:29,758 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-28 12:22:29,760 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-28 12:22:29,761 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-28 12:22:29,762 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 14 msec 2023-09-28 12:22:29,763 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-28 12:22:29,764 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695904349764 2023-09-28 12:22:29,765 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 12:22:29,765 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 12:22:29,788 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,788 INFO [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-28 12:22:29,789 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:22:29,789 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-28 12:22:29,789 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-28 12:22:29,790 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,790 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,798 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:22:29,798 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:29,798 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:22:29,798 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:22:29,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:22:29,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:22:29,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:22:29,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:22:29,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:22:29,799 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:29,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:22:29,799 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:29,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,800 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:29,800 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 12:22:29,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,800 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,800 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,801 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-28 12:22:29,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-28 12:22:29,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,802 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-28 12:22:29,802 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-28 12:22:29,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-28 12:22:29,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,803 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-28 12:22:29,805 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,805 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,805 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,809 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-28 12:22:29,809 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-28 12:22:29,809 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:22:29,809 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-28 12:22:29,810 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-28 12:22:29,810 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:22:29,809 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:22:29,811 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-28 12:22:29,812 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-28 12:22:29,810 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-28 12:22:29,813 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39937,1695903740345' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-28 12:22:29,812 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-28 12:22:29,813 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35175,1695903740297' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-28 12:22:29,814 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-28 12:22:29,814 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40363,1695903740380' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-28 12:22:29,816 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:29,816 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:29,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:22:29,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:22:29,817 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:29,817 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,817 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,817 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 12:22:29,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:22:29,817 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,818 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,818 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 12:22:29,818 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,818 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 12:22:29,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:22:29,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:29,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:29,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:29,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:22:29,821 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39937,1695903740345' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-28 12:22:29,821 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4bdba76a[Count = 1] remaining members to acquire global barrier 2023-09-28 12:22:29,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:29,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:22:29,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:22:29,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:22:29,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:22:29,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:29,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:29,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:29,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:22:29,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35175,1695903740297' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-28 12:22:29,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4bdba76a[Count = 0] remaining members to acquire global barrier 2023-09-28 12:22:29,824 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-28 12:22:29,824 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,827 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,827 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,827 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,827 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-28 12:22:29,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,827 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:29,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,827 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-28 12:22:29,827 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-28 12:22:29,828 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-28 12:22:29,828 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40363,1695903740380' in zk 2023-09-28 12:22:29,828 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:29,828 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 12:22:29,828 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 12:22:29,828 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 12:22:29,829 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695903748411.8925a5853bc13b91b40985612eee2abd. 2023-09-28 12:22:29,829 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695903748411.8925a5853bc13b91b40985612eee2abd. started... 2023-09-28 12:22:29,833 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 12:22:29,834 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 12:22:29,834 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695903748411.859284cdd1e050e646505823826ea0cd. 2023-09-28 12:22:29,834 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-28 12:22:29,834 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695903748411.859284cdd1e050e646505823826ea0cd. started... 2023-09-28 12:22:29,834 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:22:29,834 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-28 12:22:29,837 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8925a5853bc13b91b40985612eee2abd: 2023-09-28 12:22:29,837 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 859284cdd1e050e646505823826ea0cd: 2023-09-28 12:22:29,838 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695903748411.859284cdd1e050e646505823826ea0cd.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,838 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695903748411.8925a5853bc13b91b40985612eee2abd.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,843 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 12:22:29,843 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 12:22:29,847 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 12:22:29,847 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 12:22:29,865 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 12:22:29,869 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695903748411.8925a5853bc13b91b40985612eee2abd. completed. 2023-09-28 12:22:29,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-28 12:22:29,870 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695903748411.8925a5853bc13b91b40985612eee2abd. 2023-09-28 12:22:29,871 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 12:22:29,871 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 12:22:29,871 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:29,871 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-28 12:22:29,871 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39937,1695903740345' in zk 2023-09-28 12:22:29,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-28 12:22:29,874 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 12:22:29,874 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:29,874 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-28 12:22:29,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:29,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:22:29,874 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:22:29,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:22:29,874 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-28 12:22:29,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:22:29,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:22:29,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:29,878 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695903748411.859284cdd1e050e646505823826ea0cd. completed. 2023-09-28 12:22:29,878 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695903748411.859284cdd1e050e646505823826ea0cd. 2023-09-28 12:22:29,878 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 12:22:29,878 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 12:22:29,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:29,878 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:29,878 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-28 12:22:29,878 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35175,1695903740297' in zk 2023-09-28 12:22:29,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:29,880 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-28 12:22:29,880 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:29,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:22:29,881 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:22:29,881 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-28 12:22:29,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:29,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:29,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:29,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39937,1695903740345': 2023-09-28 12:22:29,884 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39937,1695903740345' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-28 12:22:29,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:29,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:22:29,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:22:29,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:22:29,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:22:29,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:29,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:29,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:29,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:22:29,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:29,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:29,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:29,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,35175,1695903740297': 2023-09-28 12:22:29,889 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35175,1695903740297' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-28 12:22:29,889 INFO [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-28 12:22:29,889 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 12:22:29,889 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 12:22:29,889 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,889 INFO [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 12:22:29,901 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,901 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,901 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:22:29,901 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:22:29,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,901 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:22:29,901 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,901 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:22:29,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:22:29,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:22:29,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:22:29,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:22:29,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:22:29,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,903 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:29,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:22:29,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:22:29,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:22:29,903 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:29,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,905 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:29,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:22:29,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:29,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:29,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:29,907 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:29,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:22:29,908 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:29,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,908 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:29,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:29,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:29,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:29,922 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:29,922 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:22:29,922 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:22:29,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:22:29,922 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:22:29,922 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:22:29,922 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:29,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:22:29,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:22:29,923 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:22:29,923 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:22:29,923 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,923 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:22:29,924 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:22:29,924 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-28 12:22:29,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:22:29,923 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:29,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,924 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 12:22:29,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:22:29,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:22:29,924 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:29,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:22:29,924 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,924 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:29,924 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:29,924 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,924 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:22:29,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:22:29,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:22:29,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:22:29,925 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-28 12:22:29,945 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,948 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:29,999 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:30,000 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-28 12:22:30,000 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:30,001 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:30,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695903749758Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695903749945 (+187 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1695903749945Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1695903749945Writing data manifest for emptySnaptb0-testExportWithTargetName at 1695903749961 (+16 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1695903749987 (+26 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695903750000 (+13 ms) 2023-09-28 12:22:30,003 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-28 12:22:30,006 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 244 msec 2023-09-28 12:22:30,074 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 12:22:30,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-28 12:22:30,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 12:22:30,090 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35175] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1695903748411.859284cdd1e050e646505823826ea0cd. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 12:22:30,092 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39937] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1695903748411.8925a5853bc13b91b40985612eee2abd. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 12:22:30,098 DEBUG [Listener at jenkins-hbase4.apache.org/33885] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-28 12:22:30,098 DEBUG [Listener at jenkins-hbase4.apache.org/33885] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695903748411.859284cdd1e050e646505823826ea0cd. 2023-09-28 12:22:30,098 INFO [Listener at jenkins-hbase4.apache.org/33885] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 12:22:30,113 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-28 12:22:30,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695903750113 (current time:1695903750113). 2023-09-28 12:22:30,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 12:22:30,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(139): Connect 0x6d371767 to 127.0.0.1:65025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 12:22:30,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c0f3154, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 12:22:30,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 12:22:30,126 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51468, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 12:22:30,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6d371767 to 127.0.0.1:65025 2023-09-28 12:22:30,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 12:22:30,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(139): Connect 0x3a22193b to 127.0.0.1:65025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 12:22:30,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f7bad37, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 12:22:30,137 DEBUG [hconnection-0x1a8bb41d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 12:22:30,138 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51474, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 12:22:30,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a22193b to 127.0.0.1:65025 2023-09-28 12:22:30,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 12:22:30,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-28 12:22:30,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 12:22:30,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-28 12:22:30,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-28 12:22:30,151 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-28 12:22:30,152 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695904350152 2023-09-28 12:22:30,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-28 12:22:30,152 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-28 12:22:30,153 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 12:22:30,153 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 12:22:30,154 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-28 12:22:30,155 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-28 12:22:30,156 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-09-28 12:22:30,157 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-28 12:22:30,158 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695904350158 2023-09-28 12:22:30,176 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-28 12:22:30,176 INFO [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-28 12:22:30,176 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:22:30,177 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-28 12:22:30,177 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-28 12:22:30,177 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,177 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,179 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:22:30,179 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:30,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:22:30,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:22:30,179 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:22:30,179 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:22:30,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:22:30,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:22:30,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:22:30,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:22:30,180 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:30,180 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:30,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,180 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:30,180 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 12:22:30,180 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,180 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,180 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-28 12:22:30,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-28 12:22:30,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-28 12:22:30,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,181 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-28 12:22:30,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,181 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-28 12:22:30,181 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-28 12:22:30,181 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-28 12:22:30,181 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-28 12:22:30,181 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-28 12:22:30,181 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-28 12:22:30,182 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-28 12:22:30,182 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-28 12:22:30,182 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:22:30,181 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:22:30,182 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-28 12:22:30,183 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-28 12:22:30,182 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:22:30,183 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-28 12:22:30,184 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-28 12:22:30,184 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-28 12:22:30,184 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40363,1695903740380' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-28 12:22:30,183 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-28 12:22:30,184 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35175,1695903740297' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-28 12:22:30,184 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39937,1695903740345' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-28 12:22:30,186 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:30,186 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:30,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:22:30,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:22:30,186 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,189 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:30,189 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,189 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:22:30,189 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 12:22:30,189 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 12:22:30,189 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:22:30,189 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,189 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 12:22:30,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-28 12:22:30,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:30,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:30,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:30,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:22:30,191 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35175,1695903740297' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-28 12:22:30,191 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f79bd80[Count = 1] remaining members to acquire global barrier 2023-09-28 12:22:30,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:30,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:22:30,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:22:30,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:22:30,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:22:30,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-28 12:22:30,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:30,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:30,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:30,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:22:30,194 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39937,1695903740345' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-28 12:22:30,194 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f79bd80[Count = 0] remaining members to acquire global barrier 2023-09-28 12:22:30,194 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-28 12:22:30,194 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,198 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,198 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,198 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,198 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-28 12:22:30,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,198 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-28 12:22:30,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,198 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:30,199 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-28 12:22:30,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,199 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40363,1695903740380' in zk 2023-09-28 12:22:30,199 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-28 12:22:30,199 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 12:22:30,199 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695903748411.8925a5853bc13b91b40985612eee2abd. 2023-09-28 12:22:30,199 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:30,199 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 12:22:30,199 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695903748411.859284cdd1e050e646505823826ea0cd. 2023-09-28 12:22:30,199 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 12:22:30,199 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695903748411.859284cdd1e050e646505823826ea0cd. started... 2023-09-28 12:22:30,199 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 12:22:30,199 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 12:22:30,199 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695903748411.8925a5853bc13b91b40985612eee2abd. started... 2023-09-28 12:22:30,200 INFO [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 859284cdd1e050e646505823826ea0cd 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-28 12:22:30,200 INFO [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8925a5853bc13b91b40985612eee2abd 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-28 12:22:30,201 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-28 12:22:30,201 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:22:30,201 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-28 12:22:30,254 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 12:22:30,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-28 12:22:30,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-28 12:22:30,255 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 12:22:30,348 INFO [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230928d98d5aeeb15d4a1fba65af1770ab76a3 to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230928d98d5aeeb15d4a1fba65af1770ab76a3 2023-09-28 12:22:30,348 INFO [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230928bd9a47eff20c453687c8430c029f28ee to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230928bd9a47eff20c453687c8430c029f28ee 2023-09-28 12:22:30,456 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 12:22:30,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-28 12:22:30,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-28 12:22:30,460 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-28 12:22:30,761 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 12:22:30,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-28 12:22:30,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-28 12:22:30,763 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-09-28 12:22:30,782 INFO [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportWithTargetName/859284cdd1e050e646505823826ea0cd/.tmp/cf/0c96de011266476a882a734976e19024 2023-09-28 12:22:30,782 INFO [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportWithTargetName/8925a5853bc13b91b40985612eee2abd/.tmp/cf/af66f744d67e4911898f712aaefad16c 2023-09-28 12:22:30,792 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportWithTargetName/859284cdd1e050e646505823826ea0cd/.tmp/cf/0c96de011266476a882a734976e19024 as hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportWithTargetName/859284cdd1e050e646505823826ea0cd/cf/0c96de011266476a882a734976e19024 2023-09-28 12:22:30,792 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportWithTargetName/8925a5853bc13b91b40985612eee2abd/.tmp/cf/af66f744d67e4911898f712aaefad16c as hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportWithTargetName/8925a5853bc13b91b40985612eee2abd/cf/af66f744d67e4911898f712aaefad16c 2023-09-28 12:22:30,801 INFO [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportWithTargetName/859284cdd1e050e646505823826ea0cd/cf/0c96de011266476a882a734976e19024, entries=4, sequenceid=6, filesize=5.6 K 2023-09-28 12:22:30,803 INFO [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportWithTargetName/8925a5853bc13b91b40985612eee2abd/cf/af66f744d67e4911898f712aaefad16c, entries=46, sequenceid=6, filesize=12.6 K 2023-09-28 12:22:30,807 INFO [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 8925a5853bc13b91b40985612eee2abd in 607ms, sequenceid=6, compaction requested=false 2023-09-28 12:22:30,807 INFO [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 859284cdd1e050e646505823826ea0cd in 608ms, sequenceid=6, compaction requested=false 2023-09-28 12:22:30,807 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-28 12:22:30,808 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-28 12:22:30,810 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8925a5853bc13b91b40985612eee2abd: 2023-09-28 12:22:30,810 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 859284cdd1e050e646505823826ea0cd: 2023-09-28 12:22:30,810 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695903748411.8925a5853bc13b91b40985612eee2abd.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-28 12:22:30,810 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 12:22:30,810 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695903748411.859284cdd1e050e646505823826ea0cd.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-28 12:22:30,810 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportWithTargetName/8925a5853bc13b91b40985612eee2abd/cf/af66f744d67e4911898f712aaefad16c] hfiles 2023-09-28 12:22:30,811 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 12:22:30,811 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportWithTargetName/8925a5853bc13b91b40985612eee2abd/cf/af66f744d67e4911898f712aaefad16c for snapshot=snaptb0-testExportWithTargetName 2023-09-28 12:22:30,811 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportWithTargetName/859284cdd1e050e646505823826ea0cd/cf/0c96de011266476a882a734976e19024] hfiles 2023-09-28 12:22:30,811 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportWithTargetName/859284cdd1e050e646505823826ea0cd/cf/0c96de011266476a882a734976e19024 for snapshot=snaptb0-testExportWithTargetName 2023-09-28 12:22:30,837 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695903748411.8925a5853bc13b91b40985612eee2abd. completed. 2023-09-28 12:22:30,837 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695903748411.8925a5853bc13b91b40985612eee2abd. 2023-09-28 12:22:30,837 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 12:22:30,837 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 12:22:30,837 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:30,837 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-28 12:22:30,837 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39937,1695903740345' in zk 2023-09-28 12:22:30,838 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695903748411.859284cdd1e050e646505823826ea0cd. completed. 2023-09-28 12:22:30,838 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695903748411.859284cdd1e050e646505823826ea0cd. 2023-09-28 12:22:30,838 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 12:22:30,838 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 12:22:30,838 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:30,838 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-28 12:22:30,838 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35175,1695903740297' in zk 2023-09-28 12:22:30,839 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:30,839 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-28 12:22:30,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:30,839 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:22:30,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:22:30,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:22:30,839 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-28 12:22:30,842 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:30,842 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-28 12:22:30,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:22:30,842 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:22:30,842 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-28 12:22:30,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:22:30,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-28 12:22:30,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:30,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:30,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:30,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:22:30,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-28 12:22:30,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:30,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:30,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:30,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39937,1695903740345': 2023-09-28 12:22:30,848 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39937,1695903740345' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-28 12:22:30,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:30,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:22:30,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:22:30,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:22:30,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:22:30,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-28 12:22:30,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:30,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:30,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:30,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:22:30,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-28 12:22:30,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:30,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:30,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:30,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,35175,1695903740297': 2023-09-28 12:22:30,853 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35175,1695903740297' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-28 12:22:30,853 INFO [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-28 12:22:30,853 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 12:22:30,853 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 12:22:30,853 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-28 12:22:30,853 INFO [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 12:22:30,855 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,855 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,855 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:22:30,855 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:22:30,855 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,855 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:22:30,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:22:30,856 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:30,855 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:22:30,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:22:30,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:22:30,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,856 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:30,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:22:30,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:22:30,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:22:30,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:22:30,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:22:30,857 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:30,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-28 12:22:30,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:22:30,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-28 12:22:30,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:30,859 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:30,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:30,859 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:30,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:30,860 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:30,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:22:30,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-28 12:22:30,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:30,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:30,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:30,870 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:22:30,870 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:22:30,870 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:22:30,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:22:30,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:22:30,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:22:30,870 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:30,871 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-28 12:22:30,871 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,871 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-28 12:22:30,871 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:22:30,871 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-28 12:22:30,871 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:22:30,872 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 12:22:30,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:22:30,870 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:22:30,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:22:30,872 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:22:30,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:22:30,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:22:30,871 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:30,873 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:30,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:22:30,873 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:22:30,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:22:30,873 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:30,873 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,873 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:30,873 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:30,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:22:30,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:22:30,873 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,873 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,874 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230928d98d5aeeb15d4a1fba65af1770ab76a3, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230928bd9a47eff20c453687c8430c029f28ee] mob files 2023-09-28 12:22:30,874 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230928d98d5aeeb15d4a1fba65af1770ab76a3 2023-09-28 12:22:30,874 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230928bd9a47eff20c453687c8430c029f28ee 2023-09-28 12:22:30,889 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-28 12:22:30,890 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,927 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,928 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-28 12:22:30,928 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,928 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-28 12:22:30,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695903750152Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695903750889 (+737 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1695903750889Loading Region manifests for snaptb0-testExportWithTargetName at 1695903750889Writing data manifest for snaptb0-testExportWithTargetName at 1695903750894 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1695903750915 (+21 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695903750928 (+13 ms) 2023-09-28 12:22:30,931 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-28 12:22:30,934 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 779 msec 2023-09-28 12:22:31,263 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 12:22:31,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-28 12:22:31,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 12:22:31,266 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903751266 2023-09-28 12:22:31,267 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35969, tgtDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903751266, rawTgtDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903751266, srcFsUri=hdfs://localhost:35969, srcDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326 2023-09-28 12:22:31,312 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35969, inputRoot=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326 2023-09-28 12:22:31,312 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-406164852_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903751266, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903751266/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-28 12:22:31,312 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35969, inputRoot=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326, snapshotDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-28 12:22:31,332 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903751266/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-28 12:22:31,403 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-28 12:22:31,404 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-28 12:22:31,404 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-28 12:22:31,405 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-28 12:22:32,307 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/hadoop-4398136616085230414.jar 2023-09-28 12:22:32,308 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-28 12:22:32,308 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-28 12:22:32,375 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/hadoop-1952678356502815854.jar 2023-09-28 12:22:32,376 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-28 12:22:32,377 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-28 12:22:32,377 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-28 12:22:32,378 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-28 12:22:32,378 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-28 12:22:32,379 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-28 12:22:32,379 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-28 12:22:32,380 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-28 12:22:32,380 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-28 12:22:32,381 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-28 12:22:32,381 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-28 12:22:32,382 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-28 12:22:32,382 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-28 12:22:32,382 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-28 12:22:32,383 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-28 12:22:32,384 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-28 12:22:32,387 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 12:22:32,388 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 12:22:32,388 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 12:22:32,389 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 12:22:32,389 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 12:22:32,390 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 12:22:32,390 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 12:22:33,236 WARN [Listener at jenkins-hbase4.apache.org/33885] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-28 12:22:33,243 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-28 12:22:33,251 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-28 12:22:33,725 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 12:22:33,727 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 12:22:34,165 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695903747070_0001_000001 (auth:SIMPLE) 2023-09-28 12:22:34,416 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-28 12:22:38,547 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695903747070_0001_000001 (auth:SIMPLE) 2023-09-28 12:22:40,799 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695903747070_0001_000001 (auth:SIMPLE) 2023-09-28 12:22:43,615 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695903747070_0001_000001 (auth:SIMPLE) 2023-09-28 12:22:45,128 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-28 12:22:45,132 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-28 12:22:45,144 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-28 12:22:45,144 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-28 12:22:45,145 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-28 12:22:45,145 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1679557244_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-28 12:22:45,146 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(367): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-28 12:22:45,146 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(367): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-28 12:22:45,146 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1679557244_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903751266/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903751266/.hbase-snapshot/testExportWithTargetName 2023-09-28 12:22:45,146 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(367): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903751266/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-28 12:22:45,147 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(367): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903751266/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-28 12:22:45,158 INFO [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-28 12:22:45,162 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-09-28 12:22:45,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-28 12:22:45,176 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695903765176"}]},"ts":"1695903765176"} 2023-09-28 12:22:45,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-28 12:22:45,178 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-28 12:22:45,180 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-28 12:22:45,181 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=859284cdd1e050e646505823826ea0cd, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8925a5853bc13b91b40985612eee2abd, UNASSIGN}] 2023-09-28 12:22:45,184 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=859284cdd1e050e646505823826ea0cd, UNASSIGN 2023-09-28 12:22:45,184 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8925a5853bc13b91b40985612eee2abd, UNASSIGN 2023-09-28 12:22:45,185 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=859284cdd1e050e646505823826ea0cd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:45,185 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=8925a5853bc13b91b40985612eee2abd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:45,185 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695903748411.859284cdd1e050e646505823826ea0cd.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695903765185"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695903765185"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695903765185"}]},"ts":"1695903765185"} 2023-09-28 12:22:45,185 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695903748411.8925a5853bc13b91b40985612eee2abd.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695903765185"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695903765185"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695903765185"}]},"ts":"1695903765185"} 2023-09-28 12:22:45,187 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 859284cdd1e050e646505823826ea0cd, server=jenkins-hbase4.apache.org,35175,1695903740297}] 2023-09-28 12:22:45,188 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 8925a5853bc13b91b40985612eee2abd, server=jenkins-hbase4.apache.org,39937,1695903740345}] 2023-09-28 12:22:45,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-28 12:22:45,349 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 859284cdd1e050e646505823826ea0cd 2023-09-28 12:22:45,349 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8925a5853bc13b91b40985612eee2abd 2023-09-28 12:22:45,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 859284cdd1e050e646505823826ea0cd, disabling compactions & flushes 2023-09-28 12:22:45,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8925a5853bc13b91b40985612eee2abd, disabling compactions & flushes 2023-09-28 12:22:45,349 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695903748411.859284cdd1e050e646505823826ea0cd. 2023-09-28 12:22:45,349 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695903748411.8925a5853bc13b91b40985612eee2abd. 2023-09-28 12:22:45,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695903748411.859284cdd1e050e646505823826ea0cd. 2023-09-28 12:22:45,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695903748411.8925a5853bc13b91b40985612eee2abd. 2023-09-28 12:22:45,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695903748411.859284cdd1e050e646505823826ea0cd. after waiting 0 ms 2023-09-28 12:22:45,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695903748411.859284cdd1e050e646505823826ea0cd. 2023-09-28 12:22:45,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695903748411.8925a5853bc13b91b40985612eee2abd. after waiting 0 ms 2023-09-28 12:22:45,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695903748411.8925a5853bc13b91b40985612eee2abd. 2023-09-28 12:22:45,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportWithTargetName/8925a5853bc13b91b40985612eee2abd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 12:22:45,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportWithTargetName/859284cdd1e050e646505823826ea0cd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 12:22:45,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 12:22:45,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 12:22:45,365 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695903748411.859284cdd1e050e646505823826ea0cd. 2023-09-28 12:22:45,365 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695903748411.8925a5853bc13b91b40985612eee2abd. 2023-09-28 12:22:45,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 859284cdd1e050e646505823826ea0cd: 2023-09-28 12:22:45,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8925a5853bc13b91b40985612eee2abd: 2023-09-28 12:22:45,368 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8925a5853bc13b91b40985612eee2abd 2023-09-28 12:22:45,368 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=8925a5853bc13b91b40985612eee2abd, regionState=CLOSED 2023-09-28 12:22:45,369 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 859284cdd1e050e646505823826ea0cd 2023-09-28 12:22:45,369 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695903748411.8925a5853bc13b91b40985612eee2abd.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695903765368"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695903765368"}]},"ts":"1695903765368"} 2023-09-28 12:22:45,370 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=859284cdd1e050e646505823826ea0cd, regionState=CLOSED 2023-09-28 12:22:45,370 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695903748411.859284cdd1e050e646505823826ea0cd.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695903765369"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695903765369"}]},"ts":"1695903765369"} 2023-09-28 12:22:45,374 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-09-28 12:22:45,374 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 8925a5853bc13b91b40985612eee2abd, server=jenkins-hbase4.apache.org,39937,1695903740345 in 183 msec 2023-09-28 12:22:45,375 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-09-28 12:22:45,375 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 859284cdd1e050e646505823826ea0cd, server=jenkins-hbase4.apache.org,35175,1695903740297 in 185 msec 2023-09-28 12:22:45,376 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8925a5853bc13b91b40985612eee2abd, UNASSIGN in 193 msec 2023-09-28 12:22:45,377 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=22, resume processing ppid=21 2023-09-28 12:22:45,377 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=859284cdd1e050e646505823826ea0cd, UNASSIGN in 194 msec 2023-09-28 12:22:45,378 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695903765378"}]},"ts":"1695903765378"} 2023-09-28 12:22:45,380 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-28 12:22:45,382 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-28 12:22:45,385 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 219 msec 2023-09-28 12:22:45,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-28 12:22:45,480 INFO [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-28 12:22:45,485 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-09-28 12:22:45,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-28 12:22:45,498 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-28 12:22:45,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-28 12:22:45,500 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-28 12:22:45,504 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40363] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-28 12:22:45,506 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-28 12:22:45,506 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-28 12:22:45,506 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-28 12:22:45,506 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-28 12:22:45,506 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportWithTargetName/859284cdd1e050e646505823826ea0cd 2023-09-28 12:22:45,507 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportWithTargetName/8925a5853bc13b91b40985612eee2abd 2023-09-28 12:22:45,507 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-28 12:22:45,507 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-28 12:22:45,507 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-28 12:22:45,508 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-28 12:22:45,508 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:22:45,508 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:22:45,508 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-28 12:22:45,508 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-28 12:22:45,509 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-28 12:22:45,508 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:22:45,509 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-28 12:22:45,509 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:22:45,511 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportWithTargetName/8925a5853bc13b91b40985612eee2abd/cf, FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportWithTargetName/8925a5853bc13b91b40985612eee2abd/recovered.edits] 2023-09-28 12:22:45,511 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportWithTargetName/859284cdd1e050e646505823826ea0cd/cf, FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportWithTargetName/859284cdd1e050e646505823826ea0cd/recovered.edits] 2023-09-28 12:22:45,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-28 12:22:45,519 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportWithTargetName/859284cdd1e050e646505823826ea0cd/cf/0c96de011266476a882a734976e19024 to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testExportWithTargetName/859284cdd1e050e646505823826ea0cd/cf/0c96de011266476a882a734976e19024 2023-09-28 12:22:45,519 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportWithTargetName/8925a5853bc13b91b40985612eee2abd/cf/af66f744d67e4911898f712aaefad16c to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testExportWithTargetName/8925a5853bc13b91b40985612eee2abd/cf/af66f744d67e4911898f712aaefad16c 2023-09-28 12:22:45,524 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportWithTargetName/8925a5853bc13b91b40985612eee2abd/recovered.edits/9.seqid to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testExportWithTargetName/8925a5853bc13b91b40985612eee2abd/recovered.edits/9.seqid 2023-09-28 12:22:45,524 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportWithTargetName/859284cdd1e050e646505823826ea0cd/recovered.edits/9.seqid to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testExportWithTargetName/859284cdd1e050e646505823826ea0cd/recovered.edits/9.seqid 2023-09-28 12:22:45,525 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportWithTargetName/8925a5853bc13b91b40985612eee2abd 2023-09-28 12:22:45,525 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportWithTargetName/859284cdd1e050e646505823826ea0cd 2023-09-28 12:22:45,525 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-28 12:22:45,525 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-28 12:22:45,526 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-28 12:22:45,531 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230928d98d5aeeb15d4a1fba65af1770ab76a3 to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230928d98d5aeeb15d4a1fba65af1770ab76a3 2023-09-28 12:22:45,533 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230928bd9a47eff20c453687c8430c029f28ee to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230928bd9a47eff20c453687c8430c029f28ee 2023-09-28 12:22:45,533 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-28 12:22:45,536 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-28 12:22:45,559 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-28 12:22:45,562 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-28 12:22:45,563 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-28 12:22:45,564 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-28 12:22:45,564 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1695903748411.859284cdd1e050e646505823826ea0cd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695903765564"}]},"ts":"9223372036854775807"} 2023-09-28 12:22:45,564 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1695903748411.8925a5853bc13b91b40985612eee2abd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695903765564"}]},"ts":"9223372036854775807"} 2023-09-28 12:22:45,566 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-28 12:22:45,566 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 859284cdd1e050e646505823826ea0cd, NAME => 'testtb-testExportWithTargetName,,1695903748411.859284cdd1e050e646505823826ea0cd.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8925a5853bc13b91b40985612eee2abd, NAME => 'testtb-testExportWithTargetName,1,1695903748411.8925a5853bc13b91b40985612eee2abd.', STARTKEY => '1', ENDKEY => ''}] 2023-09-28 12:22:45,566 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-28 12:22:45,567 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695903765567"}]},"ts":"9223372036854775807"} 2023-09-28 12:22:45,569 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-28 12:22:45,572 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-28 12:22:45,574 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 85 msec 2023-09-28 12:22:45,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-28 12:22:45,614 INFO [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-28 12:22:45,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-28 12:22:45,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-28 12:22:45,638 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-09-28 12:22:45,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-28 12:22:45,671 INFO [Listener at jenkins-hbase4.apache.org/33885] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=754 (was 703) Potentially hanging thread: IPC Client (857873035) connection to jenkins-hbase4.apache.org/172.31.14.131:37549 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/cluster_f5b5db01-ec3b-43d5-fd0c-5c90c5632a48/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x552cecd0-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1920901505_1 at /127.0.0.1:53962 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/cluster_f5b5db01-ec3b-43d5-fd0c-5c90c5632a48/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1283 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (857873035) connection to jenkins-hbase4.apache.org/172.31.14.131:41949 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/cluster_f5b5db01-ec3b-43d5-fd0c-5c90c5632a48/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x552cecd0-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/cluster_f5b5db01-ec3b-43d5-fd0c-5c90c5632a48/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x552cecd0-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1920901505_1 at /127.0.0.1:49002 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/cluster_f5b5db01-ec3b-43d5-fd0c-5c90c5632a48/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1679557244_17 at /127.0.0.1:48914 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (857873035) connection to jenkins-hbase4.apache.org/172.31.14.131:41947 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x552cecd0-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/cluster_f5b5db01-ec3b-43d5-fd0c-5c90c5632a48/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1679557244_17 at /127.0.0.1:53976 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1679557244_17 at /127.0.0.1:49046 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=921 (was 896) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=238 (was 169) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 168) - ProcessCount LEAK? -, AvailableMemoryMB=4866 (was 5635) 2023-09-28 12:22:45,672 WARN [Listener at jenkins-hbase4.apache.org/33885] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-09-28 12:22:45,691 INFO [Listener at jenkins-hbase4.apache.org/33885] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=754, OpenFileDescriptor=921, MaxFileDescriptor=60000, SystemLoadAverage=238, ProcessCount=170, AvailableMemoryMB=4865 2023-09-28 12:22:45,691 WARN [Listener at jenkins-hbase4.apache.org/33885] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-09-28 12:22:45,694 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-28 12:22:45,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-28 12:22:45,699 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-28 12:22:45,700 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-28 12:22:45,701 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-28 12:22:45,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-28 12:22:45,704 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemState/cadd9cee6de5fde4d76b684203e6e25e 2023-09-28 12:22:45,705 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemState/2d0ca5ba12111078b0b5f865234e9a55 2023-09-28 12:22:45,705 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemState/cadd9cee6de5fde4d76b684203e6e25e empty. 2023-09-28 12:22:45,705 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemState/2d0ca5ba12111078b0b5f865234e9a55 empty. 2023-09-28 12:22:45,706 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemState/cadd9cee6de5fde4d76b684203e6e25e 2023-09-28 12:22:45,706 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemState/2d0ca5ba12111078b0b5f865234e9a55 2023-09-28 12:22:45,706 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-28 12:22:45,730 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-28 12:22:45,732 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => cadd9cee6de5fde4d76b684203e6e25e, NAME => 'testtb-testExportFileSystemState,,1695903765693.cadd9cee6de5fde4d76b684203e6e25e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp 2023-09-28 12:22:45,732 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2d0ca5ba12111078b0b5f865234e9a55, NAME => 'testtb-testExportFileSystemState,1,1695903765693.2d0ca5ba12111078b0b5f865234e9a55.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp 2023-09-28 12:22:45,750 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695903765693.2d0ca5ba12111078b0b5f865234e9a55.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 12:22:45,751 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 2d0ca5ba12111078b0b5f865234e9a55, disabling compactions & flushes 2023-09-28 12:22:45,751 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695903765693.2d0ca5ba12111078b0b5f865234e9a55. 2023-09-28 12:22:45,751 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695903765693.2d0ca5ba12111078b0b5f865234e9a55. 2023-09-28 12:22:45,751 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695903765693.2d0ca5ba12111078b0b5f865234e9a55. after waiting 0 ms 2023-09-28 12:22:45,751 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695903765693.2d0ca5ba12111078b0b5f865234e9a55. 2023-09-28 12:22:45,751 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695903765693.2d0ca5ba12111078b0b5f865234e9a55. 2023-09-28 12:22:45,751 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 2d0ca5ba12111078b0b5f865234e9a55: 2023-09-28 12:22:45,751 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695903765693.cadd9cee6de5fde4d76b684203e6e25e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 12:22:45,752 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing cadd9cee6de5fde4d76b684203e6e25e, disabling compactions & flushes 2023-09-28 12:22:45,752 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695903765693.cadd9cee6de5fde4d76b684203e6e25e. 2023-09-28 12:22:45,753 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695903765693.cadd9cee6de5fde4d76b684203e6e25e. 2023-09-28 12:22:45,753 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695903765693.cadd9cee6de5fde4d76b684203e6e25e. after waiting 0 ms 2023-09-28 12:22:45,753 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695903765693.cadd9cee6de5fde4d76b684203e6e25e. 2023-09-28 12:22:45,753 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695903765693.cadd9cee6de5fde4d76b684203e6e25e. 2023-09-28 12:22:45,753 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for cadd9cee6de5fde4d76b684203e6e25e: 2023-09-28 12:22:45,756 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-28 12:22:45,757 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695903765693.2d0ca5ba12111078b0b5f865234e9a55.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695903765757"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695903765757"}]},"ts":"1695903765757"} 2023-09-28 12:22:45,757 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695903765693.cadd9cee6de5fde4d76b684203e6e25e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695903765757"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695903765757"}]},"ts":"1695903765757"} 2023-09-28 12:22:45,760 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-28 12:22:45,761 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-28 12:22:45,761 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695903765761"}]},"ts":"1695903765761"} 2023-09-28 12:22:45,763 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-28 12:22:45,766 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-28 12:22:45,767 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-28 12:22:45,767 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-28 12:22:45,767 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-28 12:22:45,767 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-28 12:22:45,767 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cadd9cee6de5fde4d76b684203e6e25e, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2d0ca5ba12111078b0b5f865234e9a55, ASSIGN}] 2023-09-28 12:22:45,770 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cadd9cee6de5fde4d76b684203e6e25e, ASSIGN 2023-09-28 12:22:45,770 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2d0ca5ba12111078b0b5f865234e9a55, ASSIGN 2023-09-28 12:22:45,771 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cadd9cee6de5fde4d76b684203e6e25e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40363,1695903740380; forceNewPlan=false, retain=false 2023-09-28 12:22:45,771 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2d0ca5ba12111078b0b5f865234e9a55, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39937,1695903740345; forceNewPlan=false, retain=false 2023-09-28 12:22:45,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-28 12:22:45,921 INFO [jenkins-hbase4:45395] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-28 12:22:45,924 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=2d0ca5ba12111078b0b5f865234e9a55, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:45,924 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=cadd9cee6de5fde4d76b684203e6e25e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:45,924 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695903765693.2d0ca5ba12111078b0b5f865234e9a55.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695903765924"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695903765924"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695903765924"}]},"ts":"1695903765924"} 2023-09-28 12:22:45,925 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695903765693.cadd9cee6de5fde4d76b684203e6e25e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695903765924"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695903765924"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695903765924"}]},"ts":"1695903765924"} 2023-09-28 12:22:45,927 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 2d0ca5ba12111078b0b5f865234e9a55, server=jenkins-hbase4.apache.org,39937,1695903740345}] 2023-09-28 12:22:45,928 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure cadd9cee6de5fde4d76b684203e6e25e, server=jenkins-hbase4.apache.org,40363,1695903740380}] 2023-09-28 12:22:46,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-28 12:22:46,087 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1695903765693.2d0ca5ba12111078b0b5f865234e9a55. 2023-09-28 12:22:46,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2d0ca5ba12111078b0b5f865234e9a55, NAME => 'testtb-testExportFileSystemState,1,1695903765693.2d0ca5ba12111078b0b5f865234e9a55.', STARTKEY => '1', ENDKEY => ''} 2023-09-28 12:22:46,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1695903765693.2d0ca5ba12111078b0b5f865234e9a55. service=AccessControlService 2023-09-28 12:22:46,089 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 12:22:46,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 2d0ca5ba12111078b0b5f865234e9a55 2023-09-28 12:22:46,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695903765693.2d0ca5ba12111078b0b5f865234e9a55.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 12:22:46,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2d0ca5ba12111078b0b5f865234e9a55 2023-09-28 12:22:46,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2d0ca5ba12111078b0b5f865234e9a55 2023-09-28 12:22:46,091 INFO [StoreOpener-2d0ca5ba12111078b0b5f865234e9a55-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2d0ca5ba12111078b0b5f865234e9a55 2023-09-28 12:22:46,091 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1695903765693.cadd9cee6de5fde4d76b684203e6e25e. 2023-09-28 12:22:46,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cadd9cee6de5fde4d76b684203e6e25e, NAME => 'testtb-testExportFileSystemState,,1695903765693.cadd9cee6de5fde4d76b684203e6e25e.', STARTKEY => '', ENDKEY => '1'} 2023-09-28 12:22:46,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1695903765693.cadd9cee6de5fde4d76b684203e6e25e. service=AccessControlService 2023-09-28 12:22:46,093 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 12:22:46,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState cadd9cee6de5fde4d76b684203e6e25e 2023-09-28 12:22:46,093 DEBUG [StoreOpener-2d0ca5ba12111078b0b5f865234e9a55-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemState/2d0ca5ba12111078b0b5f865234e9a55/cf 2023-09-28 12:22:46,093 DEBUG [StoreOpener-2d0ca5ba12111078b0b5f865234e9a55-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemState/2d0ca5ba12111078b0b5f865234e9a55/cf 2023-09-28 12:22:46,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695903765693.cadd9cee6de5fde4d76b684203e6e25e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 12:22:46,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cadd9cee6de5fde4d76b684203e6e25e 2023-09-28 12:22:46,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cadd9cee6de5fde4d76b684203e6e25e 2023-09-28 12:22:46,094 INFO [StoreOpener-2d0ca5ba12111078b0b5f865234e9a55-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2d0ca5ba12111078b0b5f865234e9a55 columnFamilyName cf 2023-09-28 12:22:46,095 INFO [StoreOpener-cadd9cee6de5fde4d76b684203e6e25e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cadd9cee6de5fde4d76b684203e6e25e 2023-09-28 12:22:46,095 INFO [StoreOpener-2d0ca5ba12111078b0b5f865234e9a55-1] regionserver.HStore(310): Store=2d0ca5ba12111078b0b5f865234e9a55/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 12:22:46,097 DEBUG [StoreOpener-cadd9cee6de5fde4d76b684203e6e25e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemState/cadd9cee6de5fde4d76b684203e6e25e/cf 2023-09-28 12:22:46,097 DEBUG [StoreOpener-cadd9cee6de5fde4d76b684203e6e25e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemState/cadd9cee6de5fde4d76b684203e6e25e/cf 2023-09-28 12:22:46,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemState/2d0ca5ba12111078b0b5f865234e9a55 2023-09-28 12:22:46,098 INFO [StoreOpener-cadd9cee6de5fde4d76b684203e6e25e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cadd9cee6de5fde4d76b684203e6e25e columnFamilyName cf 2023-09-28 12:22:46,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemState/2d0ca5ba12111078b0b5f865234e9a55 2023-09-28 12:22:46,099 INFO [StoreOpener-cadd9cee6de5fde4d76b684203e6e25e-1] regionserver.HStore(310): Store=cadd9cee6de5fde4d76b684203e6e25e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 12:22:46,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemState/cadd9cee6de5fde4d76b684203e6e25e 2023-09-28 12:22:46,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemState/cadd9cee6de5fde4d76b684203e6e25e 2023-09-28 12:22:46,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2d0ca5ba12111078b0b5f865234e9a55 2023-09-28 12:22:46,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemState/2d0ca5ba12111078b0b5f865234e9a55/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 12:22:46,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cadd9cee6de5fde4d76b684203e6e25e 2023-09-28 12:22:46,105 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2d0ca5ba12111078b0b5f865234e9a55; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59392834, jitterRate=-0.11497780680656433}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 12:22:46,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2d0ca5ba12111078b0b5f865234e9a55: 2023-09-28 12:22:46,106 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1695903765693.2d0ca5ba12111078b0b5f865234e9a55., pid=30, masterSystemTime=1695903766079 2023-09-28 12:22:46,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemState/cadd9cee6de5fde4d76b684203e6e25e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 12:22:46,107 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cadd9cee6de5fde4d76b684203e6e25e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62879799, jitterRate=-0.06301797926425934}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 12:22:46,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cadd9cee6de5fde4d76b684203e6e25e: 2023-09-28 12:22:46,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1695903765693.2d0ca5ba12111078b0b5f865234e9a55. 2023-09-28 12:22:46,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1695903765693.2d0ca5ba12111078b0b5f865234e9a55. 2023-09-28 12:22:46,109 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1695903765693.cadd9cee6de5fde4d76b684203e6e25e., pid=31, masterSystemTime=1695903766082 2023-09-28 12:22:46,109 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=2d0ca5ba12111078b0b5f865234e9a55, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:46,109 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1695903765693.2d0ca5ba12111078b0b5f865234e9a55.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695903766109"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695903766109"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695903766109"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695903766109"}]},"ts":"1695903766109"} 2023-09-28 12:22:46,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1695903765693.cadd9cee6de5fde4d76b684203e6e25e. 2023-09-28 12:22:46,110 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1695903765693.cadd9cee6de5fde4d76b684203e6e25e. 2023-09-28 12:22:46,111 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=cadd9cee6de5fde4d76b684203e6e25e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:46,113 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1695903765693.cadd9cee6de5fde4d76b684203e6e25e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695903766111"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695903766111"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695903766111"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695903766111"}]},"ts":"1695903766111"} 2023-09-28 12:22:46,115 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=29 2023-09-28 12:22:46,115 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 2d0ca5ba12111078b0b5f865234e9a55, server=jenkins-hbase4.apache.org,39937,1695903740345 in 185 msec 2023-09-28 12:22:46,117 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2d0ca5ba12111078b0b5f865234e9a55, ASSIGN in 348 msec 2023-09-28 12:22:46,118 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=28 2023-09-28 12:22:46,121 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure cadd9cee6de5fde4d76b684203e6e25e, server=jenkins-hbase4.apache.org,40363,1695903740380 in 187 msec 2023-09-28 12:22:46,124 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=28, resume processing ppid=27 2023-09-28 12:22:46,124 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cadd9cee6de5fde4d76b684203e6e25e, ASSIGN in 354 msec 2023-09-28 12:22:46,125 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-28 12:22:46,125 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695903766125"}]},"ts":"1695903766125"} 2023-09-28 12:22:46,127 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-28 12:22:46,130 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-28 12:22:46,130 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-28 12:22:46,132 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40363] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-28 12:22:46,134 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:22:46,134 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:22:46,134 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:22:46,134 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:22:46,136 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-28 12:22:46,136 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-28 12:22:46,136 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-28 12:22:46,136 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-28 12:22:46,139 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 442 msec 2023-09-28 12:22:46,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-28 12:22:46,306 INFO [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-28 12:22:46,309 DEBUG [Listener at jenkins-hbase4.apache.org/33885] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-28 12:22:46,309 DEBUG [Listener at jenkins-hbase4.apache.org/33885] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695903765693.cadd9cee6de5fde4d76b684203e6e25e. 2023-09-28 12:22:46,312 INFO [Listener at jenkins-hbase4.apache.org/33885] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 12:22:46,326 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 12:22:46,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695903766326 (current time:1695903766326). 2023-09-28 12:22:46,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 12:22:46,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(139): Connect 0x09f8243b to 127.0.0.1:65025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 12:22:46,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45b489e4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 12:22:46,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 12:22:46,340 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52914, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 12:22:46,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09f8243b to 127.0.0.1:65025 2023-09-28 12:22:46,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 12:22:46,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(139): Connect 0x42688387 to 127.0.0.1:65025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 12:22:46,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a79ae0d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 12:22:46,351 DEBUG [hconnection-0x6b63ed0f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 12:22:46,354 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52916, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 12:22:46,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42688387 to 127.0.0.1:65025 2023-09-28 12:22:46,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 12:22:46,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-28 12:22:46,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 12:22:46,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 12:22:46,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-28 12:22:46,364 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-28 12:22:46,365 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695904366365 2023-09-28 12:22:46,365 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-28 12:22:46,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 12:22:46,367 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 12:22:46,367 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 12:22:46,369 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-28 12:22:46,369 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-28 12:22:46,371 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-09-28 12:22:46,372 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-28 12:22:46,372 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695904366372 2023-09-28 12:22:46,385 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,385 INFO [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-28 12:22:46,385 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:22:46,386 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-28 12:22:46,386 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-28 12:22:46,387 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,387 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,388 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:22:46,388 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:46,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:22:46,388 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:22:46,388 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:22:46,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:22:46,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:22:46,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:22:46,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:22:46,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:22:46,389 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:46,389 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:46,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,389 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:46,389 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 12:22:46,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,390 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,390 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,390 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-28 12:22:46,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-28 12:22:46,390 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-28 12:22:46,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-28 12:22:46,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,391 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-28 12:22:46,391 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,391 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-28 12:22:46,391 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,391 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-28 12:22:46,391 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-28 12:22:46,391 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:22:46,391 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,392 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-28 12:22:46,391 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:22:46,392 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-28 12:22:46,392 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-28 12:22:46,394 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40363,1695903740380' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-28 12:22:46,394 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-28 12:22:46,394 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-28 12:22:46,394 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35175,1695903740297' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-28 12:22:46,394 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:22:46,395 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-28 12:22:46,395 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-28 12:22:46,395 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39937,1695903740345' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-28 12:22:46,397 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:46,397 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:46,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:22:46,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:22:46,403 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:22:46,403 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,403 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 12:22:46,404 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:46,404 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,405 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 12:22:46,404 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:22:46,405 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,405 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 12:22:46,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:46,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:46,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:46,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:22:46,406 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40363,1695903740380' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-28 12:22:46,406 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e9af558[Count = 1] remaining members to acquire global barrier 2023-09-28 12:22:46,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:46,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:22:46,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:22:46,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:22:46,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:22:46,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:46,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:46,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:46,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:22:46,409 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39937,1695903740345' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-28 12:22:46,409 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e9af558[Count = 0] remaining members to acquire global barrier 2023-09-28 12:22:46,409 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-28 12:22:46,409 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,410 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,410 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,410 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,410 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:46,410 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-28 12:22:46,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,410 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-28 12:22:46,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,411 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 12:22:46,411 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 12:22:46,411 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-28 12:22:46,411 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:46,411 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 12:22:46,411 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-28 12:22:46,411 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35175,1695903740297' in zk 2023-09-28 12:22:46,411 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695903765693.2d0ca5ba12111078b0b5f865234e9a55. 2023-09-28 12:22:46,411 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695903765693.2d0ca5ba12111078b0b5f865234e9a55. started... 2023-09-28 12:22:46,412 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-28 12:22:46,412 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:22:46,412 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-28 12:22:46,414 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 12:22:46,414 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2d0ca5ba12111078b0b5f865234e9a55: 2023-09-28 12:22:46,414 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 12:22:46,414 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695903765693.cadd9cee6de5fde4d76b684203e6e25e. 2023-09-28 12:22:46,414 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695903765693.cadd9cee6de5fde4d76b684203e6e25e. started... 2023-09-28 12:22:46,414 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695903765693.2d0ca5ba12111078b0b5f865234e9a55.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,414 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 12:22:46,414 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cadd9cee6de5fde4d76b684203e6e25e: 2023-09-28 12:22:46,414 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 12:22:46,415 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695903765693.cadd9cee6de5fde4d76b684203e6e25e.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,415 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 12:22:46,415 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 12:22:46,432 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695903765693.cadd9cee6de5fde4d76b684203e6e25e. completed. 2023-09-28 12:22:46,432 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695903765693.cadd9cee6de5fde4d76b684203e6e25e. 2023-09-28 12:22:46,432 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 12:22:46,432 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 12:22:46,432 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:46,432 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-28 12:22:46,432 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40363,1695903740380' in zk 2023-09-28 12:22:46,435 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-28 12:22:46,435 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:46,435 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:22:46,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:46,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:22:46,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:22:46,435 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-28 12:22:46,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:22:46,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:22:46,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:46,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:46,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:46,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:22:46,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:46,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:46,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,40363,1695903740380': 2023-09-28 12:22:46,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40363,1695903740380' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-28 12:22:46,467 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 12:22:46,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-28 12:22:46,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-28 12:22:46,468 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 12:22:46,576 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-28 12:22:46,669 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 12:22:46,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-28 12:22:46,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-28 12:22:46,670 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-28 12:22:46,836 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695903765693.2d0ca5ba12111078b0b5f865234e9a55. completed. 2023-09-28 12:22:46,836 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695903765693.2d0ca5ba12111078b0b5f865234e9a55. 2023-09-28 12:22:46,836 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 12:22:46,836 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 12:22:46,836 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:46,836 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-28 12:22:46,836 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39937,1695903740345' in zk 2023-09-28 12:22:46,838 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:46,838 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-28 12:22:46,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:46,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:22:46,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:22:46,838 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:22:46,840 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-28 12:22:46,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:22:46,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:22:46,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:46,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:46,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:46,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:22:46,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:46,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:46,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:46,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39937,1695903740345': 2023-09-28 12:22:46,844 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39937,1695903740345' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-28 12:22:46,844 INFO [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-28 12:22:46,844 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 12:22:46,844 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 12:22:46,844 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,844 INFO [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 12:22:46,847 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,847 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,847 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:22:46,847 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,847 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:22:46,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:22:46,847 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:22:46,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,847 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:22:46,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,848 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:46,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:22:46,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:22:46,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:22:46,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:22:46,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:22:46,848 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:46,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:22:46,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:22:46,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,849 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:46,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:22:46,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:46,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:46,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:46,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:22:46,851 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:46,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,851 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:46,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:46,852 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:46,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:46,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:46,855 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:46,855 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:22:46,855 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:22:46,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:22:46,856 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:22:46,856 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:22:46,855 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,856 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:22:46,856 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:22:46,856 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-28 12:22:46,856 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:22:46,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:22:46,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:22:46,856 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:22:46,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:22:46,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:22:46,856 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:22:46,856 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:46,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:22:46,858 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 12:22:46,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:22:46,858 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:46,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:22:46,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:22:46,858 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:22:46,859 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:46,859 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,859 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:46,859 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:46,859 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,859 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,859 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-28 12:22:46,872 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,872 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,894 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,895 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-28 12:22:46,895 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,895 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-28 12:22:46,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695903766365Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695903766871 (+506 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1695903766872 (+1 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1695903766872Writing data manifest for emptySnaptb0-testExportFileSystemState at 1695903766878 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1695903766887 (+9 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695903766895 (+8 ms) 2023-09-28 12:22:46,898 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-28 12:22:46,900 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 532 msec 2023-09-28 12:22:46,970 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 12:22:46,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-28 12:22:46,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 12:22:46,975 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40363] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1695903765693.cadd9cee6de5fde4d76b684203e6e25e. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 12:22:46,977 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39937] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1695903765693.2d0ca5ba12111078b0b5f865234e9a55. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 12:22:46,981 DEBUG [Listener at jenkins-hbase4.apache.org/33885] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-28 12:22:46,981 DEBUG [Listener at jenkins-hbase4.apache.org/33885] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695903765693.cadd9cee6de5fde4d76b684203e6e25e. 2023-09-28 12:22:46,981 INFO [Listener at jenkins-hbase4.apache.org/33885] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 12:22:46,993 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 12:22:46,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695903766993 (current time:1695903766993). 2023-09-28 12:22:46,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 12:22:46,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(139): Connect 0x60044576 to 127.0.0.1:65025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 12:22:47,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@be24d35, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 12:22:47,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 12:22:47,005 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52930, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 12:22:47,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60044576 to 127.0.0.1:65025 2023-09-28 12:22:47,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 12:22:47,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(139): Connect 0x614fb05e to 127.0.0.1:65025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 12:22:47,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7cd5842c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 12:22:47,017 DEBUG [hconnection-0x6a12334a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 12:22:47,020 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52936, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 12:22:47,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x614fb05e to 127.0.0.1:65025 2023-09-28 12:22:47,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 12:22:47,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-28 12:22:47,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 12:22:47,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 12:22:47,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-28 12:22:47,031 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-28 12:22:47,032 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695904367032 2023-09-28 12:22:47,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 12:22:47,032 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-28 12:22:47,034 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 12:22:47,034 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 12:22:47,035 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-28 12:22:47,036 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-28 12:22:47,038 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-09-28 12:22:47,039 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-28 12:22:47,040 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695904367040 2023-09-28 12:22:47,057 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-28 12:22:47,058 INFO [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-28 12:22:47,058 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:22:47,059 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-28 12:22:47,059 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-28 12:22:47,060 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,060 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,062 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:22:47,062 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:22:47,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:22:47,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:22:47,062 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:22:47,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:22:47,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:22:47,062 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:47,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:22:47,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:22:47,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,063 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,063 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:47,063 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:47,063 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,063 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-28 12:22:47,063 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:47,063 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 12:22:47,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-28 12:22:47,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,064 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-28 12:22:47,064 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-28 12:22:47,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-28 12:22:47,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,064 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-28 12:22:47,064 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-28 12:22:47,064 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-28 12:22:47,064 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-28 12:22:47,064 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:22:47,064 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-28 12:22:47,064 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-28 12:22:47,064 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:22:47,064 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-28 12:22:47,066 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-28 12:22:47,066 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:22:47,065 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-28 12:22:47,067 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-28 12:22:47,067 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-28 12:22:47,067 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-28 12:22:47,067 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-28 12:22:47,068 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40363,1695903740380' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-28 12:22:47,068 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39937,1695903740345' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-28 12:22:47,067 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35175,1695903740297' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-28 12:22:47,069 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,069 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,069 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:47,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:47,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:22:47,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:22:47,070 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:47,070 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,070 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,070 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 12:22:47,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:22:47,070 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,070 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 12:22:47,070 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,070 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 12:22:47,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:22:47,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-28 12:22:47,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:47,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:47,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:47,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:22:47,072 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40363,1695903740380' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-28 12:22:47,072 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c4ddeb6[Count = 1] remaining members to acquire global barrier 2023-09-28 12:22:47,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:47,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:22:47,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:22:47,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:22:47,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:22:47,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-28 12:22:47,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:47,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:47,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:47,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:22:47,075 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39937,1695903740345' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-28 12:22:47,075 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c4ddeb6[Count = 0] remaining members to acquire global barrier 2023-09-28 12:22:47,075 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-28 12:22:47,075 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,076 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,076 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,076 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,076 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-28 12:22:47,076 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-28 12:22:47,076 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:47,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,076 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-28 12:22:47,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,076 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 12:22:47,076 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35175,1695903740297' in zk 2023-09-28 12:22:47,077 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695903765693.2d0ca5ba12111078b0b5f865234e9a55. 2023-09-28 12:22:47,077 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 12:22:47,077 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-28 12:22:47,077 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:47,077 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 12:22:47,077 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695903765693.2d0ca5ba12111078b0b5f865234e9a55. started... 2023-09-28 12:22:47,077 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 12:22:47,077 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 12:22:47,077 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695903765693.cadd9cee6de5fde4d76b684203e6e25e. 2023-09-28 12:22:47,077 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695903765693.cadd9cee6de5fde4d76b684203e6e25e. started... 2023-09-28 12:22:47,077 INFO [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2d0ca5ba12111078b0b5f865234e9a55 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-28 12:22:47,077 INFO [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cadd9cee6de5fde4d76b684203e6e25e 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-28 12:22:47,079 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-28 12:22:47,079 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:22:47,079 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-28 12:22:47,116 INFO [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230928db82ee510c7e446393da7b1dfb3b0b2b to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230928db82ee510c7e446393da7b1dfb3b0b2b 2023-09-28 12:22:47,119 INFO [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230928477b5f78f2cc4091a404ee645b5cf610 to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230928477b5f78f2cc4091a404ee645b5cf610 2023-09-28 12:22:47,134 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 12:22:47,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-28 12:22:47,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-28 12:22:47,135 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 12:22:47,137 INFO [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemState/2d0ca5ba12111078b0b5f865234e9a55/.tmp/cf/2474d841df6d48f2b83841475d993d0c 2023-09-28 12:22:47,144 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemState/2d0ca5ba12111078b0b5f865234e9a55/.tmp/cf/2474d841df6d48f2b83841475d993d0c as hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemState/2d0ca5ba12111078b0b5f865234e9a55/cf/2474d841df6d48f2b83841475d993d0c 2023-09-28 12:22:47,149 INFO [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemState/cadd9cee6de5fde4d76b684203e6e25e/.tmp/cf/d44711814b224e309cce8921891a6751 2023-09-28 12:22:47,153 INFO [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemState/2d0ca5ba12111078b0b5f865234e9a55/cf/2474d841df6d48f2b83841475d993d0c, entries=47, sequenceid=6, filesize=12.8 K 2023-09-28 12:22:47,155 INFO [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 2d0ca5ba12111078b0b5f865234e9a55 in 77ms, sequenceid=6, compaction requested=false 2023-09-28 12:22:47,156 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2d0ca5ba12111078b0b5f865234e9a55: 2023-09-28 12:22:47,156 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695903765693.2d0ca5ba12111078b0b5f865234e9a55.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-28 12:22:47,157 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 12:22:47,157 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemState/2d0ca5ba12111078b0b5f865234e9a55/cf/2474d841df6d48f2b83841475d993d0c] hfiles 2023-09-28 12:22:47,157 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemState/2d0ca5ba12111078b0b5f865234e9a55/cf/2474d841df6d48f2b83841475d993d0c for snapshot=snaptb0-testExportFileSystemState 2023-09-28 12:22:47,157 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemState/cadd9cee6de5fde4d76b684203e6e25e/.tmp/cf/d44711814b224e309cce8921891a6751 as hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemState/cadd9cee6de5fde4d76b684203e6e25e/cf/d44711814b224e309cce8921891a6751 2023-09-28 12:22:47,164 INFO [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemState/cadd9cee6de5fde4d76b684203e6e25e/cf/d44711814b224e309cce8921891a6751, entries=3, sequenceid=6, filesize=5.4 K 2023-09-28 12:22:47,165 INFO [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for cadd9cee6de5fde4d76b684203e6e25e in 88ms, sequenceid=6, compaction requested=false 2023-09-28 12:22:47,166 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cadd9cee6de5fde4d76b684203e6e25e: 2023-09-28 12:22:47,166 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695903765693.cadd9cee6de5fde4d76b684203e6e25e.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-28 12:22:47,166 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 12:22:47,166 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemState/cadd9cee6de5fde4d76b684203e6e25e/cf/d44711814b224e309cce8921891a6751] hfiles 2023-09-28 12:22:47,166 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemState/cadd9cee6de5fde4d76b684203e6e25e/cf/d44711814b224e309cce8921891a6751 for snapshot=snaptb0-testExportFileSystemState 2023-09-28 12:22:47,181 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695903765693.2d0ca5ba12111078b0b5f865234e9a55. completed. 2023-09-28 12:22:47,181 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695903765693.2d0ca5ba12111078b0b5f865234e9a55. 2023-09-28 12:22:47,181 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 12:22:47,181 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 12:22:47,181 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:47,185 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-28 12:22:47,185 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39937,1695903740345' in zk 2023-09-28 12:22:47,189 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:47,189 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695903765693.cadd9cee6de5fde4d76b684203e6e25e. completed. 2023-09-28 12:22:47,189 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-28 12:22:47,189 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695903765693.cadd9cee6de5fde4d76b684203e6e25e. 2023-09-28 12:22:47,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:47,189 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 12:22:47,189 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 12:22:47,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:22:47,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:22:47,189 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:22:47,189 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:47,190 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-28 12:22:47,191 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-28 12:22:47,192 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40363,1695903740380' in zk 2023-09-28 12:22:47,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:22:47,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:22:47,193 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:47,193 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-28 12:22:47,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-28 12:22:47,193 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:22:47,193 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-28 12:22:47,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:47,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:47,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:47,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:22:47,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-28 12:22:47,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:47,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:47,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:47,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39937,1695903740345': 2023-09-28 12:22:47,197 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39937,1695903740345' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-28 12:22:47,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:47,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:22:47,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:22:47,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:22:47,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:22:47,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-28 12:22:47,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:47,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:47,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:47,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:22:47,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-28 12:22:47,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:47,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:47,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:47,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,40363,1695903740380': 2023-09-28 12:22:47,200 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40363,1695903740380' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-28 12:22:47,200 INFO [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-28 12:22:47,201 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 12:22:47,201 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 12:22:47,201 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-28 12:22:47,201 INFO [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 12:22:47,207 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,207 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,207 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,207 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:22:47,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:22:47,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,207 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:22:47,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,207 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:22:47,207 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:22:47,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:22:47,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,208 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:47,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:22:47,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:22:47,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:22:47,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:22:47,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:22:47,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:22:47,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-28 12:22:47,208 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:47,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:22:47,210 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:47,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-28 12:22:47,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:47,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:47,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:47,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:22:47,212 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:47,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-28 12:22:47,212 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:47,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:47,213 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:47,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:47,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:47,217 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:47,217 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,217 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:22:47,217 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:22:47,217 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:22:47,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:22:47,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:22:47,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:22:47,217 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:22:47,217 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:22:47,217 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:22:47,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:22:47,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:22:47,217 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:47,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:22:47,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:22:47,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:22:47,218 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:47,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:22:47,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:22:47,218 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,218 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:22:47,218 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,218 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:22:47,218 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:22:47,218 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,218 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:22:47,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:22:47,220 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:22:47,220 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-28 12:22:47,221 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-28 12:22:47,221 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-28 12:22:47,221 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 12:22:47,222 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230928db82ee510c7e446393da7b1dfb3b0b2b, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230928477b5f78f2cc4091a404ee645b5cf610] mob files 2023-09-28 12:22:47,222 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230928db82ee510c7e446393da7b1dfb3b0b2b 2023-09-28 12:22:47,222 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230928477b5f78f2cc4091a404ee645b5cf610 2023-09-28 12:22:47,232 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-28 12:22:47,232 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,258 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,258 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-28 12:22:47,259 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,259 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,259 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695903767032Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695903767232 (+200 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1695903767232Loading Region manifests for snaptb0-testExportFileSystemState at 1695903767232Writing data manifest for snaptb0-testExportFileSystemState at 1695903767236 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1695903767249 (+13 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695903767258 (+9 ms) 2023-09-28 12:22:47,262 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-28 12:22:47,264 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 229 msec 2023-09-28 12:22:47,336 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 12:22:47,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-28 12:22:47,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 12:22:47,337 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903767337 2023-09-28 12:22:47,337 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35969, tgtDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903767337, rawTgtDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903767337, srcFsUri=hdfs://localhost:35969, srcDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326 2023-09-28 12:22:47,368 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35969, inputRoot=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326 2023-09-28 12:22:47,368 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1531322385_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903767337, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903767337/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,368 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35969, inputRoot=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326, snapshotDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-28 12:22:47,387 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903767337/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-28 12:22:47,414 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-28 12:22:47,414 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-28 12:22:47,415 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-28 12:22:47,415 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-28 12:22:48,308 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/hadoop-5462020914081706045.jar 2023-09-28 12:22:48,308 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-28 12:22:48,309 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-28 12:22:48,376 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/hadoop-3677821894400510061.jar 2023-09-28 12:22:48,376 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-28 12:22:48,376 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-28 12:22:48,377 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-28 12:22:48,377 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-28 12:22:48,378 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-28 12:22:48,378 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-28 12:22:48,378 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-28 12:22:48,379 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-28 12:22:48,379 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-28 12:22:48,380 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-28 12:22:48,380 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-28 12:22:48,381 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-28 12:22:48,381 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-28 12:22:48,381 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-28 12:22:48,382 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-28 12:22:48,382 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-28 12:22:48,383 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 12:22:48,383 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 12:22:48,384 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 12:22:48,384 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 12:22:48,384 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 12:22:48,385 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 12:22:48,386 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 12:22:48,859 WARN [Listener at jenkins-hbase4.apache.org/33885] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-28 12:22:48,862 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-28 12:22:48,865 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-28 12:22:49,810 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 12:22:49,811 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 12:22:49,816 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695903747070_0001_000001 (auth:SIMPLE) 2023-09-28 12:22:50,318 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695903747070_0002_000001 (auth:SIMPLE) 2023-09-28 12:22:50,983 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-28 12:22:54,374 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695903747070_0002_000001 (auth:SIMPLE) 2023-09-28 12:22:56,601 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695903747070_0002_000001 (auth:SIMPLE) 2023-09-28 12:22:59,745 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695903747070_0002_000001 (auth:SIMPLE) 2023-09-28 12:23:01,059 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-28 12:23:01,060 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-28 12:23:01,067 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-28 12:23:01,067 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-28 12:23:01,068 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-28 12:23:01,068 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1679557244_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-28 12:23:01,069 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(367): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-28 12:23:01,069 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(367): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-28 12:23:01,069 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1679557244_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903767337/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903767337/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-28 12:23:01,069 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(367): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903767337/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-28 12:23:01,070 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(367): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903767337/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-28 12:23:01,077 INFO [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-28 12:23:01,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-09-28 12:23:01,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-28 12:23:01,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-28 12:23:01,083 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695903781083"}]},"ts":"1695903781083"} 2023-09-28 12:23:01,084 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-28 12:23:01,086 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-28 12:23:01,087 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cadd9cee6de5fde4d76b684203e6e25e, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2d0ca5ba12111078b0b5f865234e9a55, UNASSIGN}] 2023-09-28 12:23:01,089 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cadd9cee6de5fde4d76b684203e6e25e, UNASSIGN 2023-09-28 12:23:01,089 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2d0ca5ba12111078b0b5f865234e9a55, UNASSIGN 2023-09-28 12:23:01,090 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=2d0ca5ba12111078b0b5f865234e9a55, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:01,090 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=cadd9cee6de5fde4d76b684203e6e25e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:01,090 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695903765693.2d0ca5ba12111078b0b5f865234e9a55.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695903781090"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695903781090"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695903781090"}]},"ts":"1695903781090"} 2023-09-28 12:23:01,090 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695903765693.cadd9cee6de5fde4d76b684203e6e25e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695903781090"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695903781090"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695903781090"}]},"ts":"1695903781090"} 2023-09-28 12:23:01,092 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure cadd9cee6de5fde4d76b684203e6e25e, server=jenkins-hbase4.apache.org,40363,1695903740380}] 2023-09-28 12:23:01,093 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 2d0ca5ba12111078b0b5f865234e9a55, server=jenkins-hbase4.apache.org,39937,1695903740345}] 2023-09-28 12:23:01,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-28 12:23:01,244 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2d0ca5ba12111078b0b5f865234e9a55 2023-09-28 12:23:01,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2d0ca5ba12111078b0b5f865234e9a55, disabling compactions & flushes 2023-09-28 12:23:01,245 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cadd9cee6de5fde4d76b684203e6e25e 2023-09-28 12:23:01,245 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695903765693.2d0ca5ba12111078b0b5f865234e9a55. 2023-09-28 12:23:01,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695903765693.2d0ca5ba12111078b0b5f865234e9a55. 2023-09-28 12:23:01,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695903765693.2d0ca5ba12111078b0b5f865234e9a55. after waiting 0 ms 2023-09-28 12:23:01,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cadd9cee6de5fde4d76b684203e6e25e, disabling compactions & flushes 2023-09-28 12:23:01,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695903765693.2d0ca5ba12111078b0b5f865234e9a55. 2023-09-28 12:23:01,245 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695903765693.cadd9cee6de5fde4d76b684203e6e25e. 2023-09-28 12:23:01,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695903765693.cadd9cee6de5fde4d76b684203e6e25e. 2023-09-28 12:23:01,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695903765693.cadd9cee6de5fde4d76b684203e6e25e. after waiting 0 ms 2023-09-28 12:23:01,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695903765693.cadd9cee6de5fde4d76b684203e6e25e. 2023-09-28 12:23:01,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemState/cadd9cee6de5fde4d76b684203e6e25e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 12:23:01,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemState/2d0ca5ba12111078b0b5f865234e9a55/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 12:23:01,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 12:23:01,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 12:23:01,256 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695903765693.cadd9cee6de5fde4d76b684203e6e25e. 2023-09-28 12:23:01,257 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695903765693.2d0ca5ba12111078b0b5f865234e9a55. 2023-09-28 12:23:01,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2d0ca5ba12111078b0b5f865234e9a55: 2023-09-28 12:23:01,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cadd9cee6de5fde4d76b684203e6e25e: 2023-09-28 12:23:01,259 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2d0ca5ba12111078b0b5f865234e9a55 2023-09-28 12:23:01,259 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=2d0ca5ba12111078b0b5f865234e9a55, regionState=CLOSED 2023-09-28 12:23:01,260 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695903765693.2d0ca5ba12111078b0b5f865234e9a55.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695903781259"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695903781259"}]},"ts":"1695903781259"} 2023-09-28 12:23:01,260 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cadd9cee6de5fde4d76b684203e6e25e 2023-09-28 12:23:01,260 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=cadd9cee6de5fde4d76b684203e6e25e, regionState=CLOSED 2023-09-28 12:23:01,260 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695903765693.cadd9cee6de5fde4d76b684203e6e25e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695903781260"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695903781260"}]},"ts":"1695903781260"} 2023-09-28 12:23:01,264 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=38 2023-09-28 12:23:01,264 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 2d0ca5ba12111078b0b5f865234e9a55, server=jenkins-hbase4.apache.org,39937,1695903740345 in 168 msec 2023-09-28 12:23:01,265 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=37 2023-09-28 12:23:01,265 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure cadd9cee6de5fde4d76b684203e6e25e, server=jenkins-hbase4.apache.org,40363,1695903740380 in 170 msec 2023-09-28 12:23:01,265 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2d0ca5ba12111078b0b5f865234e9a55, UNASSIGN in 177 msec 2023-09-28 12:23:01,267 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-09-28 12:23:01,267 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cadd9cee6de5fde4d76b684203e6e25e, UNASSIGN in 178 msec 2023-09-28 12:23:01,268 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695903781268"}]},"ts":"1695903781268"} 2023-09-28 12:23:01,270 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-28 12:23:01,271 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-28 12:23:01,274 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 195 msec 2023-09-28 12:23:01,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-28 12:23:01,384 INFO [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-28 12:23:01,385 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-09-28 12:23:01,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-28 12:23:01,389 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-28 12:23:01,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-28 12:23:01,390 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-28 12:23:01,391 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40363] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-28 12:23:01,395 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemState/cadd9cee6de5fde4d76b684203e6e25e 2023-09-28 12:23:01,395 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemState/2d0ca5ba12111078b0b5f865234e9a55 2023-09-28 12:23:01,395 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-28 12:23:01,395 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-28 12:23:01,395 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-28 12:23:01,395 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-28 12:23:01,396 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-28 12:23:01,396 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-28 12:23:01,396 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-28 12:23:01,396 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-28 12:23:01,397 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-28 12:23:01,397 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-28 12:23:01,397 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-28 12:23:01,397 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemState/2d0ca5ba12111078b0b5f865234e9a55/cf, FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemState/2d0ca5ba12111078b0b5f865234e9a55/recovered.edits] 2023-09-28 12:23:01,397 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-28 12:23:01,397 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:23:01,397 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemState/cadd9cee6de5fde4d76b684203e6e25e/cf, FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemState/cadd9cee6de5fde4d76b684203e6e25e/recovered.edits] 2023-09-28 12:23:01,397 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:23:01,397 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:23:01,397 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:23:01,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-28 12:23:01,402 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemState/cadd9cee6de5fde4d76b684203e6e25e/cf/d44711814b224e309cce8921891a6751 to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testExportFileSystemState/cadd9cee6de5fde4d76b684203e6e25e/cf/d44711814b224e309cce8921891a6751 2023-09-28 12:23:01,403 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemState/2d0ca5ba12111078b0b5f865234e9a55/cf/2474d841df6d48f2b83841475d993d0c to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testExportFileSystemState/2d0ca5ba12111078b0b5f865234e9a55/cf/2474d841df6d48f2b83841475d993d0c 2023-09-28 12:23:01,407 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemState/cadd9cee6de5fde4d76b684203e6e25e/recovered.edits/9.seqid to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testExportFileSystemState/cadd9cee6de5fde4d76b684203e6e25e/recovered.edits/9.seqid 2023-09-28 12:23:01,407 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemState/2d0ca5ba12111078b0b5f865234e9a55/recovered.edits/9.seqid to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testExportFileSystemState/2d0ca5ba12111078b0b5f865234e9a55/recovered.edits/9.seqid 2023-09-28 12:23:01,407 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemState/cadd9cee6de5fde4d76b684203e6e25e 2023-09-28 12:23:01,407 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemState/2d0ca5ba12111078b0b5f865234e9a55 2023-09-28 12:23:01,408 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-28 12:23:01,408 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-28 12:23:01,409 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-28 12:23:01,413 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230928db82ee510c7e446393da7b1dfb3b0b2b to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230928db82ee510c7e446393da7b1dfb3b0b2b 2023-09-28 12:23:01,414 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230928477b5f78f2cc4091a404ee645b5cf610 to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230928477b5f78f2cc4091a404ee645b5cf610 2023-09-28 12:23:01,415 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-28 12:23:01,418 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-28 12:23:01,421 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-28 12:23:01,423 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-28 12:23:01,424 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-28 12:23:01,425 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-28 12:23:01,425 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1695903765693.cadd9cee6de5fde4d76b684203e6e25e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695903781425"}]},"ts":"9223372036854775807"} 2023-09-28 12:23:01,425 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1695903765693.2d0ca5ba12111078b0b5f865234e9a55.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695903781425"}]},"ts":"9223372036854775807"} 2023-09-28 12:23:01,429 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-28 12:23:01,429 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => cadd9cee6de5fde4d76b684203e6e25e, NAME => 'testtb-testExportFileSystemState,,1695903765693.cadd9cee6de5fde4d76b684203e6e25e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 2d0ca5ba12111078b0b5f865234e9a55, NAME => 'testtb-testExportFileSystemState,1,1695903765693.2d0ca5ba12111078b0b5f865234e9a55.', STARTKEY => '1', ENDKEY => ''}] 2023-09-28 12:23:01,429 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-28 12:23:01,429 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695903781429"}]},"ts":"9223372036854775807"} 2023-09-28 12:23:01,433 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-28 12:23:01,436 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-28 12:23:01,438 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 51 msec 2023-09-28 12:23:01,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-28 12:23:01,500 INFO [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-28 12:23:01,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-28 12:23:01,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-28 12:23:01,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-09-28 12:23:01,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-28 12:23:01,545 INFO [Listener at jenkins-hbase4.apache.org/33885] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=763 (was 754) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1679557244_17 at /127.0.0.1:41760 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x552cecd0-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1965 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (857873035) connection to jenkins-hbase4.apache.org/172.31.14.131:41465 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x552cecd0-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1679557244_17 at /127.0.0.1:41892 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (857873035) connection to jenkins-hbase4.apache.org/172.31.14.131:33885 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x552cecd0-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-491609927_1 at /127.0.0.1:41870 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x552cecd0-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=933 (was 921) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=269 (was 238) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=4705 (was 4865) 2023-09-28 12:23:01,545 WARN [Listener at jenkins-hbase4.apache.org/33885] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-09-28 12:23:01,570 INFO [Listener at jenkins-hbase4.apache.org/33885] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=763, OpenFileDescriptor=933, MaxFileDescriptor=60000, SystemLoadAverage=272, ProcessCount=170, AvailableMemoryMB=4704 2023-09-28 12:23:01,570 WARN [Listener at jenkins-hbase4.apache.org/33885] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-09-28 12:23:01,572 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-28 12:23:01,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-28 12:23:01,577 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-28 12:23:01,577 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-28 12:23:01,578 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-28 12:23:01,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-28 12:23:01,581 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testConsecutiveExports/17f437f4515d9c93f6df99a5ec1a2388 2023-09-28 12:23:01,581 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testConsecutiveExports/daff369dbf4222535bada9a7c92453b0 2023-09-28 12:23:01,582 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testConsecutiveExports/daff369dbf4222535bada9a7c92453b0 empty. 2023-09-28 12:23:01,582 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testConsecutiveExports/17f437f4515d9c93f6df99a5ec1a2388 empty. 2023-09-28 12:23:01,582 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testConsecutiveExports/daff369dbf4222535bada9a7c92453b0 2023-09-28 12:23:01,582 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testConsecutiveExports/17f437f4515d9c93f6df99a5ec1a2388 2023-09-28 12:23:01,582 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-28 12:23:01,594 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-28 12:23:01,595 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 17f437f4515d9c93f6df99a5ec1a2388, NAME => 'testtb-testConsecutiveExports,,1695903781572.17f437f4515d9c93f6df99a5ec1a2388.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp 2023-09-28 12:23:01,596 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => daff369dbf4222535bada9a7c92453b0, NAME => 'testtb-testConsecutiveExports,1,1695903781572.daff369dbf4222535bada9a7c92453b0.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp 2023-09-28 12:23:01,607 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695903781572.daff369dbf4222535bada9a7c92453b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 12:23:01,607 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing daff369dbf4222535bada9a7c92453b0, disabling compactions & flushes 2023-09-28 12:23:01,607 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695903781572.daff369dbf4222535bada9a7c92453b0. 2023-09-28 12:23:01,607 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695903781572.daff369dbf4222535bada9a7c92453b0. 2023-09-28 12:23:01,607 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695903781572.daff369dbf4222535bada9a7c92453b0. after waiting 0 ms 2023-09-28 12:23:01,607 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695903781572.daff369dbf4222535bada9a7c92453b0. 2023-09-28 12:23:01,607 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695903781572.daff369dbf4222535bada9a7c92453b0. 2023-09-28 12:23:01,607 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for daff369dbf4222535bada9a7c92453b0: 2023-09-28 12:23:01,607 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695903781572.17f437f4515d9c93f6df99a5ec1a2388.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 12:23:01,608 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 17f437f4515d9c93f6df99a5ec1a2388, disabling compactions & flushes 2023-09-28 12:23:01,608 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695903781572.17f437f4515d9c93f6df99a5ec1a2388. 2023-09-28 12:23:01,608 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695903781572.17f437f4515d9c93f6df99a5ec1a2388. 2023-09-28 12:23:01,608 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695903781572.17f437f4515d9c93f6df99a5ec1a2388. after waiting 0 ms 2023-09-28 12:23:01,608 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695903781572.17f437f4515d9c93f6df99a5ec1a2388. 2023-09-28 12:23:01,608 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695903781572.17f437f4515d9c93f6df99a5ec1a2388. 2023-09-28 12:23:01,608 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 17f437f4515d9c93f6df99a5ec1a2388: 2023-09-28 12:23:01,610 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-28 12:23:01,611 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695903781572.daff369dbf4222535bada9a7c92453b0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695903781611"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695903781611"}]},"ts":"1695903781611"} 2023-09-28 12:23:01,611 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695903781572.17f437f4515d9c93f6df99a5ec1a2388.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695903781611"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695903781611"}]},"ts":"1695903781611"} 2023-09-28 12:23:01,614 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-28 12:23:01,615 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-28 12:23:01,615 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695903781615"}]},"ts":"1695903781615"} 2023-09-28 12:23:01,616 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-28 12:23:01,621 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-28 12:23:01,622 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-28 12:23:01,622 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-28 12:23:01,622 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-28 12:23:01,622 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-28 12:23:01,622 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=17f437f4515d9c93f6df99a5ec1a2388, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=daff369dbf4222535bada9a7c92453b0, ASSIGN}] 2023-09-28 12:23:01,626 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=17f437f4515d9c93f6df99a5ec1a2388, ASSIGN 2023-09-28 12:23:01,626 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=daff369dbf4222535bada9a7c92453b0, ASSIGN 2023-09-28 12:23:01,626 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=17f437f4515d9c93f6df99a5ec1a2388, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39937,1695903740345; forceNewPlan=false, retain=false 2023-09-28 12:23:01,627 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=daff369dbf4222535bada9a7c92453b0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35175,1695903740297; forceNewPlan=false, retain=false 2023-09-28 12:23:01,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-28 12:23:01,777 INFO [jenkins-hbase4:45395] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-28 12:23:01,779 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=daff369dbf4222535bada9a7c92453b0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:01,779 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=17f437f4515d9c93f6df99a5ec1a2388, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:01,779 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695903781572.daff369dbf4222535bada9a7c92453b0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695903781779"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695903781779"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695903781779"}]},"ts":"1695903781779"} 2023-09-28 12:23:01,780 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695903781572.17f437f4515d9c93f6df99a5ec1a2388.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695903781779"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695903781779"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695903781779"}]},"ts":"1695903781779"} 2023-09-28 12:23:01,781 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure daff369dbf4222535bada9a7c92453b0, server=jenkins-hbase4.apache.org,35175,1695903740297}] 2023-09-28 12:23:01,782 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 17f437f4515d9c93f6df99a5ec1a2388, server=jenkins-hbase4.apache.org,39937,1695903740345}] 2023-09-28 12:23:01,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-28 12:23:01,937 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1695903781572.daff369dbf4222535bada9a7c92453b0. 2023-09-28 12:23:01,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => daff369dbf4222535bada9a7c92453b0, NAME => 'testtb-testConsecutiveExports,1,1695903781572.daff369dbf4222535bada9a7c92453b0.', STARTKEY => '1', ENDKEY => ''} 2023-09-28 12:23:01,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1695903781572.daff369dbf4222535bada9a7c92453b0. service=AccessControlService 2023-09-28 12:23:01,937 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1695903781572.17f437f4515d9c93f6df99a5ec1a2388. 2023-09-28 12:23:01,938 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 12:23:01,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 17f437f4515d9c93f6df99a5ec1a2388, NAME => 'testtb-testConsecutiveExports,,1695903781572.17f437f4515d9c93f6df99a5ec1a2388.', STARTKEY => '', ENDKEY => '1'} 2023-09-28 12:23:01,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports daff369dbf4222535bada9a7c92453b0 2023-09-28 12:23:01,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695903781572.daff369dbf4222535bada9a7c92453b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 12:23:01,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for daff369dbf4222535bada9a7c92453b0 2023-09-28 12:23:01,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1695903781572.17f437f4515d9c93f6df99a5ec1a2388. service=AccessControlService 2023-09-28 12:23:01,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for daff369dbf4222535bada9a7c92453b0 2023-09-28 12:23:01,938 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 12:23:01,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 17f437f4515d9c93f6df99a5ec1a2388 2023-09-28 12:23:01,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695903781572.17f437f4515d9c93f6df99a5ec1a2388.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 12:23:01,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 17f437f4515d9c93f6df99a5ec1a2388 2023-09-28 12:23:01,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 17f437f4515d9c93f6df99a5ec1a2388 2023-09-28 12:23:01,939 INFO [StoreOpener-daff369dbf4222535bada9a7c92453b0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region daff369dbf4222535bada9a7c92453b0 2023-09-28 12:23:01,939 INFO [StoreOpener-17f437f4515d9c93f6df99a5ec1a2388-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 17f437f4515d9c93f6df99a5ec1a2388 2023-09-28 12:23:01,940 DEBUG [StoreOpener-daff369dbf4222535bada9a7c92453b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testConsecutiveExports/daff369dbf4222535bada9a7c92453b0/cf 2023-09-28 12:23:01,941 DEBUG [StoreOpener-daff369dbf4222535bada9a7c92453b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testConsecutiveExports/daff369dbf4222535bada9a7c92453b0/cf 2023-09-28 12:23:01,941 DEBUG [StoreOpener-17f437f4515d9c93f6df99a5ec1a2388-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testConsecutiveExports/17f437f4515d9c93f6df99a5ec1a2388/cf 2023-09-28 12:23:01,941 DEBUG [StoreOpener-17f437f4515d9c93f6df99a5ec1a2388-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testConsecutiveExports/17f437f4515d9c93f6df99a5ec1a2388/cf 2023-09-28 12:23:01,941 INFO [StoreOpener-daff369dbf4222535bada9a7c92453b0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region daff369dbf4222535bada9a7c92453b0 columnFamilyName cf 2023-09-28 12:23:01,941 INFO [StoreOpener-17f437f4515d9c93f6df99a5ec1a2388-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 17f437f4515d9c93f6df99a5ec1a2388 columnFamilyName cf 2023-09-28 12:23:01,942 INFO [StoreOpener-daff369dbf4222535bada9a7c92453b0-1] regionserver.HStore(310): Store=daff369dbf4222535bada9a7c92453b0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 12:23:01,942 INFO [StoreOpener-17f437f4515d9c93f6df99a5ec1a2388-1] regionserver.HStore(310): Store=17f437f4515d9c93f6df99a5ec1a2388/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 12:23:01,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testConsecutiveExports/daff369dbf4222535bada9a7c92453b0 2023-09-28 12:23:01,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testConsecutiveExports/17f437f4515d9c93f6df99a5ec1a2388 2023-09-28 12:23:01,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testConsecutiveExports/daff369dbf4222535bada9a7c92453b0 2023-09-28 12:23:01,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testConsecutiveExports/17f437f4515d9c93f6df99a5ec1a2388 2023-09-28 12:23:01,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for daff369dbf4222535bada9a7c92453b0 2023-09-28 12:23:01,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 17f437f4515d9c93f6df99a5ec1a2388 2023-09-28 12:23:01,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testConsecutiveExports/daff369dbf4222535bada9a7c92453b0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 12:23:01,949 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened daff369dbf4222535bada9a7c92453b0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64322980, jitterRate=-0.041512906551361084}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 12:23:01,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for daff369dbf4222535bada9a7c92453b0: 2023-09-28 12:23:01,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testConsecutiveExports/17f437f4515d9c93f6df99a5ec1a2388/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 12:23:01,950 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 17f437f4515d9c93f6df99a5ec1a2388; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59247362, jitterRate=-0.11714550852775574}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 12:23:01,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 17f437f4515d9c93f6df99a5ec1a2388: 2023-09-28 12:23:01,950 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1695903781572.daff369dbf4222535bada9a7c92453b0., pid=45, masterSystemTime=1695903781933 2023-09-28 12:23:01,951 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1695903781572.17f437f4515d9c93f6df99a5ec1a2388., pid=46, masterSystemTime=1695903781934 2023-09-28 12:23:01,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1695903781572.daff369dbf4222535bada9a7c92453b0. 2023-09-28 12:23:01,953 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1695903781572.daff369dbf4222535bada9a7c92453b0. 2023-09-28 12:23:01,953 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=daff369dbf4222535bada9a7c92453b0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:01,954 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1695903781572.daff369dbf4222535bada9a7c92453b0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695903781953"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695903781953"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695903781953"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695903781953"}]},"ts":"1695903781953"} 2023-09-28 12:23:01,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1695903781572.17f437f4515d9c93f6df99a5ec1a2388. 2023-09-28 12:23:01,954 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1695903781572.17f437f4515d9c93f6df99a5ec1a2388. 2023-09-28 12:23:01,954 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=17f437f4515d9c93f6df99a5ec1a2388, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:01,955 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1695903781572.17f437f4515d9c93f6df99a5ec1a2388.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695903781954"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695903781954"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695903781954"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695903781954"}]},"ts":"1695903781954"} 2023-09-28 12:23:01,958 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-09-28 12:23:01,959 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure daff369dbf4222535bada9a7c92453b0, server=jenkins-hbase4.apache.org,35175,1695903740297 in 174 msec 2023-09-28 12:23:01,960 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=43 2023-09-28 12:23:01,960 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 17f437f4515d9c93f6df99a5ec1a2388, server=jenkins-hbase4.apache.org,39937,1695903740345 in 175 msec 2023-09-28 12:23:01,960 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=daff369dbf4222535bada9a7c92453b0, ASSIGN in 337 msec 2023-09-28 12:23:01,962 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=43, resume processing ppid=42 2023-09-28 12:23:01,962 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=17f437f4515d9c93f6df99a5ec1a2388, ASSIGN in 338 msec 2023-09-28 12:23:01,963 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-28 12:23:01,963 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695903781963"}]},"ts":"1695903781963"} 2023-09-28 12:23:01,965 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-28 12:23:01,967 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-28 12:23:01,967 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-28 12:23:01,969 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40363] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-28 12:23:01,971 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:23:01,971 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:23:01,971 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:23:01,971 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:23:01,972 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-28 12:23:01,973 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-28 12:23:01,973 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-28 12:23:01,973 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-28 12:23:01,975 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 401 msec 2023-09-28 12:23:02,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-28 12:23:02,183 INFO [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-28 12:23:02,185 DEBUG [Listener at jenkins-hbase4.apache.org/33885] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-28 12:23:02,185 DEBUG [Listener at jenkins-hbase4.apache.org/33885] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695903781572.17f437f4515d9c93f6df99a5ec1a2388. 2023-09-28 12:23:02,188 INFO [Listener at jenkins-hbase4.apache.org/33885] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 12:23:02,199 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-28 12:23:02,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695903782199 (current time:1695903782199). 2023-09-28 12:23:02,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 12:23:02,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(139): Connect 0x05225087 to 127.0.0.1:65025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 12:23:02,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c43b397, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 12:23:02,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 12:23:02,216 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36126, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 12:23:02,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x05225087 to 127.0.0.1:65025 2023-09-28 12:23:02,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 12:23:02,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(139): Connect 0x05f8c0e2 to 127.0.0.1:65025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 12:23:02,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12490eb2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 12:23:02,225 DEBUG [hconnection-0x1397d867-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 12:23:02,226 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36134, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 12:23:02,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x05f8c0e2 to 127.0.0.1:65025 2023-09-28 12:23:02,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 12:23:02,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-28 12:23:02,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 12:23:02,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-28 12:23:02,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-28 12:23:02,234 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-28 12:23:02,235 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695904382235 2023-09-28 12:23:02,235 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-28 12:23:02,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-28 12:23:02,236 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 12:23:02,236 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 12:23:02,239 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-28 12:23:02,240 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-28 12:23:02,241 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-09-28 12:23:02,241 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-28 12:23:02,242 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695904382242 2023-09-28 12:23:02,254 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,254 INFO [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-28 12:23:02,254 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:23:02,255 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-28 12:23:02,255 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-28 12:23:02,256 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,256 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,258 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:23:02,258 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:23:02,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:23:02,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:23:02,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:23:02,258 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:23:02,258 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:02,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:23:02,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:23:02,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:23:02,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,259 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:02,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,259 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:02,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,259 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,259 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,259 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:02,259 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 12:23:02,259 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-28 12:23:02,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-28 12:23:02,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,260 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-28 12:23:02,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-28 12:23:02,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,260 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-28 12:23:02,260 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,260 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-28 12:23:02,260 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-28 12:23:02,260 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,260 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:23:02,260 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-28 12:23:02,261 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-28 12:23:02,261 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-28 12:23:02,260 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,261 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35175,1695903740297' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-28 12:23:02,261 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:23:02,261 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-28 12:23:02,262 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-28 12:23:02,262 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-28 12:23:02,262 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:23:02,262 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39937,1695903740345' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-28 12:23:02,265 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-28 12:23:02,265 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-28 12:23:02,265 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40363,1695903740380' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-28 12:23:02,267 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:02,267 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:02,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:23:02,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:23:02,267 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:02,267 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,268 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,268 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:23:02,268 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,268 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 12:23:02,268 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 12:23:02,268 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,268 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 12:23:02,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:23:02,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:02,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:02,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:02,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:23:02,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35175,1695903740297' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-28 12:23:02,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57097da6[Count = 1] remaining members to acquire global barrier 2023-09-28 12:23:02,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:02,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:23:02,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:23:02,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:23:02,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:23:02,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:02,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:02,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:02,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:23:02,272 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39937,1695903740345' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-28 12:23:02,272 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57097da6[Count = 0] remaining members to acquire global barrier 2023-09-28 12:23:02,272 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-28 12:23:02,272 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,275 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,275 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,275 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,275 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-28 12:23:02,275 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:02,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,275 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-28 12:23:02,275 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-28 12:23:02,275 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:02,275 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-28 12:23:02,275 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 12:23:02,275 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40363,1695903740380' in zk 2023-09-28 12:23:02,275 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695903781572.daff369dbf4222535bada9a7c92453b0. 2023-09-28 12:23:02,275 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695903781572.17f437f4515d9c93f6df99a5ec1a2388. 2023-09-28 12:23:02,276 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695903781572.daff369dbf4222535bada9a7c92453b0. started... 2023-09-28 12:23:02,275 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 12:23:02,276 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695903781572.17f437f4515d9c93f6df99a5ec1a2388. started... 2023-09-28 12:23:02,275 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 12:23:02,275 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 12:23:02,276 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 12:23:02,277 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for daff369dbf4222535bada9a7c92453b0: 2023-09-28 12:23:02,277 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 17f437f4515d9c93f6df99a5ec1a2388: 2023-09-28 12:23:02,277 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695903781572.daff369dbf4222535bada9a7c92453b0.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,277 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 12:23:02,277 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 12:23:02,277 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695903781572.17f437f4515d9c93f6df99a5ec1a2388.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,277 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 12:23:02,277 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 12:23:02,283 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-28 12:23:02,283 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:23:02,283 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-28 12:23:02,293 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695903781572.17f437f4515d9c93f6df99a5ec1a2388. completed. 2023-09-28 12:23:02,293 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695903781572.17f437f4515d9c93f6df99a5ec1a2388. 2023-09-28 12:23:02,293 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 12:23:02,293 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 12:23:02,293 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:02,293 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-28 12:23:02,293 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39937,1695903740345' in zk 2023-09-28 12:23:02,294 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695903781572.daff369dbf4222535bada9a7c92453b0. completed. 2023-09-28 12:23:02,294 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695903781572.daff369dbf4222535bada9a7c92453b0. 2023-09-28 12:23:02,294 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 12:23:02,294 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 12:23:02,294 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:02,294 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-28 12:23:02,294 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35175,1695903740297' in zk 2023-09-28 12:23:02,295 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-28 12:23:02,295 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:02,295 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:23:02,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:02,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:23:02,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:23:02,295 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-28 12:23:02,298 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:02,298 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-28 12:23:02,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:23:02,298 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:23:02,298 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-28 12:23:02,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:23:02,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:02,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:02,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:02,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:23:02,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:02,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:02,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:02,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39937,1695903740345': 2023-09-28 12:23:02,302 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39937,1695903740345' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-28 12:23:02,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:02,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:23:02,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:23:02,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:23:02,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:23:02,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:02,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:02,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:02,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:23:02,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:02,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:02,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:02,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,35175,1695903740297': 2023-09-28 12:23:02,306 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35175,1695903740297' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-28 12:23:02,306 INFO [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-28 12:23:02,306 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 12:23:02,306 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 12:23:02,306 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,306 INFO [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 12:23:02,307 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,307 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,307 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:23:02,307 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,307 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:23:02,307 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:23:02,308 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:23:02,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:23:02,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:23:02,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:23:02,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:23:02,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:23:02,308 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:02,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:23:02,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:23:02,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,309 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:02,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:23:02,309 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:02,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:23:02,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:02,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:02,311 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:02,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:02,311 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:02,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:23:02,311 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:02,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:02,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:02,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:02,316 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:02,317 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,317 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:23:02,317 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:02,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:23:02,317 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:23:02,317 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:23:02,317 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:23:02,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:23:02,317 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:23:02,317 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:23:02,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:23:02,317 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:02,317 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,318 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-28 12:23:02,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:23:02,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:23:02,317 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:23:02,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:23:02,319 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,318 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,320 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:02,320 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,320 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:02,320 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:02,320 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:23:02,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:23:02,320 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 12:23:02,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:23:02,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:23:02,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:23:02,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:23:02,320 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,321 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-28 12:23:02,328 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,328 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,337 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 12:23:02,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-28 12:23:02,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-28 12:23:02,338 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 12:23:02,345 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,346 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-28 12:23:02,346 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,346 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:02,346 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695903782235Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695903782328 (+93 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1695903782328Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1695903782328Writing data manifest for emptySnaptb0-testConsecutiveExports at 1695903782332 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1695903782339 (+7 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695903782346 (+7 ms) 2023-09-28 12:23:02,349 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-28 12:23:02,350 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 113 msec 2023-09-28 12:23:02,538 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 12:23:02,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-28 12:23:02,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 12:23:02,542 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39937] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1695903781572.17f437f4515d9c93f6df99a5ec1a2388. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 12:23:02,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35175] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1695903781572.daff369dbf4222535bada9a7c92453b0. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 12:23:02,546 DEBUG [Listener at jenkins-hbase4.apache.org/33885] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-28 12:23:02,546 DEBUG [Listener at jenkins-hbase4.apache.org/33885] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695903781572.17f437f4515d9c93f6df99a5ec1a2388. 2023-09-28 12:23:02,546 INFO [Listener at jenkins-hbase4.apache.org/33885] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 12:23:02,556 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-28 12:23:02,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695903782556 (current time:1695903782556). 2023-09-28 12:23:02,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 12:23:02,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(139): Connect 0x3a1b2f55 to 127.0.0.1:65025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 12:23:02,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4221fb7a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 12:23:02,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 12:23:02,572 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36142, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 12:23:02,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a1b2f55 to 127.0.0.1:65025 2023-09-28 12:23:02,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 12:23:02,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(139): Connect 0x2251045b to 127.0.0.1:65025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 12:23:02,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4153f6c3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 12:23:02,584 DEBUG [hconnection-0xc643fb8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 12:23:02,587 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36158, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 12:23:02,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2251045b to 127.0.0.1:65025 2023-09-28 12:23:02,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 12:23:02,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-28 12:23:02,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 12:23:02,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-28 12:23:02,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-28 12:23:02,597 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-28 12:23:02,598 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695904382598 2023-09-28 12:23:02,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-28 12:23:02,598 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-28 12:23:02,599 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 12:23:02,599 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 12:23:02,600 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-28 12:23:02,601 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-28 12:23:02,602 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-09-28 12:23:02,603 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-28 12:23:02,603 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695904382603 2023-09-28 12:23:02,616 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-28 12:23:02,616 INFO [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-28 12:23:02,616 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:23:02,617 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-28 12:23:02,617 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-28 12:23:02,618 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,618 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,619 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:02,619 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:23:02,619 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:23:02,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:23:02,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:23:02,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:23:02,619 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:23:02,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:23:02,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:23:02,620 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:02,620 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:02,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:23:02,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,627 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:02,627 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 12:23:02,627 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,627 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-28 12:23:02,628 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-28 12:23:02,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,628 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-28 12:23:02,628 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-28 12:23:02,628 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-28 12:23:02,628 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-28 12:23:02,628 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-28 12:23:02,629 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-28 12:23:02,629 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:23:02,629 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:23:02,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-28 12:23:02,630 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-28 12:23:02,631 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-28 12:23:02,631 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39937,1695903740345' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-28 12:23:02,630 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-28 12:23:02,631 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-28 12:23:02,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,631 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40363,1695903740380' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-28 12:23:02,631 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-28 12:23:02,631 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-28 12:23:02,631 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-28 12:23:02,631 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:23:02,632 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-28 12:23:02,632 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-28 12:23:02,632 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35175,1695903740297' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-28 12:23:02,633 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,633 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:02,633 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:02,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:23:02,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:23:02,633 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,633 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 12:23:02,634 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:02,634 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:23:02,634 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,635 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 12:23:02,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:23:02,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-28 12:23:02,635 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,635 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 12:23:02,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:02,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:02,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:02,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:23:02,636 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39937,1695903740345' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-28 12:23:02,636 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@389426ac[Count = 1] remaining members to acquire global barrier 2023-09-28 12:23:02,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:02,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:23:02,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:23:02,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:23:02,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:23:02,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-28 12:23:02,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:02,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:02,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:02,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:23:02,638 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35175,1695903740297' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-28 12:23:02,638 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@389426ac[Count = 0] remaining members to acquire global barrier 2023-09-28 12:23:02,638 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-28 12:23:02,638 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,641 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,641 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,641 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,641 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-28 12:23:02,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,641 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:02,641 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-28 12:23:02,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,641 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-28 12:23:02,641 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-28 12:23:02,641 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40363,1695903740380' in zk 2023-09-28 12:23:02,641 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:02,641 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 12:23:02,643 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-28 12:23:02,643 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:23:02,643 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-28 12:23:02,646 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 12:23:02,646 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 12:23:02,646 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695903781572.17f437f4515d9c93f6df99a5ec1a2388. 2023-09-28 12:23:02,646 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695903781572.daff369dbf4222535bada9a7c92453b0. 2023-09-28 12:23:02,646 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695903781572.17f437f4515d9c93f6df99a5ec1a2388. started... 2023-09-28 12:23:02,646 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695903781572.daff369dbf4222535bada9a7c92453b0. started... 2023-09-28 12:23:02,646 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 12:23:02,646 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 12:23:02,646 INFO [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 17f437f4515d9c93f6df99a5ec1a2388 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-28 12:23:02,646 INFO [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] regionserver.HRegion(2745): Flushing daff369dbf4222535bada9a7c92453b0 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-28 12:23:02,672 INFO [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230928463e1ded4ead4106a6ccc9798415e8aa to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230928463e1ded4ead4106a6ccc9798415e8aa 2023-09-28 12:23:02,673 INFO [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230928a3ac81e860c64e67857f965d53e8fb79 to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230928a3ac81e860c64e67857f965d53e8fb79 2023-09-28 12:23:02,685 INFO [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testConsecutiveExports/17f437f4515d9c93f6df99a5ec1a2388/.tmp/cf/c0e494ae20f24678ae9a91c973167f6f 2023-09-28 12:23:02,688 INFO [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testConsecutiveExports/daff369dbf4222535bada9a7c92453b0/.tmp/cf/b548d42a516345e1a8387fccf8d13dfb 2023-09-28 12:23:02,691 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testConsecutiveExports/17f437f4515d9c93f6df99a5ec1a2388/.tmp/cf/c0e494ae20f24678ae9a91c973167f6f as hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testConsecutiveExports/17f437f4515d9c93f6df99a5ec1a2388/cf/c0e494ae20f24678ae9a91c973167f6f 2023-09-28 12:23:02,694 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testConsecutiveExports/daff369dbf4222535bada9a7c92453b0/.tmp/cf/b548d42a516345e1a8387fccf8d13dfb as hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testConsecutiveExports/daff369dbf4222535bada9a7c92453b0/cf/b548d42a516345e1a8387fccf8d13dfb 2023-09-28 12:23:02,697 INFO [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testConsecutiveExports/17f437f4515d9c93f6df99a5ec1a2388/cf/c0e494ae20f24678ae9a91c973167f6f, entries=3, sequenceid=6, filesize=5.4 K 2023-09-28 12:23:02,698 INFO [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 17f437f4515d9c93f6df99a5ec1a2388 in 52ms, sequenceid=6, compaction requested=false 2023-09-28 12:23:02,698 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-28 12:23:02,698 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 17f437f4515d9c93f6df99a5ec1a2388: 2023-09-28 12:23:02,699 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695903781572.17f437f4515d9c93f6df99a5ec1a2388.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-28 12:23:02,699 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 12:23:02,699 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testConsecutiveExports/17f437f4515d9c93f6df99a5ec1a2388/cf/c0e494ae20f24678ae9a91c973167f6f] hfiles 2023-09-28 12:23:02,699 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testConsecutiveExports/17f437f4515d9c93f6df99a5ec1a2388/cf/c0e494ae20f24678ae9a91c973167f6f for snapshot=snaptb0-testConsecutiveExports 2023-09-28 12:23:02,699 INFO [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testConsecutiveExports/daff369dbf4222535bada9a7c92453b0/cf/b548d42a516345e1a8387fccf8d13dfb, entries=47, sequenceid=6, filesize=12.7 K 2023-09-28 12:23:02,699 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 12:23:02,700 INFO [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for daff369dbf4222535bada9a7c92453b0 in 54ms, sequenceid=6, compaction requested=false 2023-09-28 12:23:02,701 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for daff369dbf4222535bada9a7c92453b0: 2023-09-28 12:23:02,702 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695903781572.daff369dbf4222535bada9a7c92453b0.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-28 12:23:02,702 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 12:23:02,702 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testConsecutiveExports/daff369dbf4222535bada9a7c92453b0/cf/b548d42a516345e1a8387fccf8d13dfb] hfiles 2023-09-28 12:23:02,702 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testConsecutiveExports/daff369dbf4222535bada9a7c92453b0/cf/b548d42a516345e1a8387fccf8d13dfb for snapshot=snaptb0-testConsecutiveExports 2023-09-28 12:23:02,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-28 12:23:02,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-28 12:23:02,702 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 12:23:02,709 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695903781572.17f437f4515d9c93f6df99a5ec1a2388. completed. 2023-09-28 12:23:02,709 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695903781572.17f437f4515d9c93f6df99a5ec1a2388. 2023-09-28 12:23:02,709 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 12:23:02,709 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 12:23:02,709 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:02,709 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-28 12:23:02,709 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39937,1695903740345' in zk 2023-09-28 12:23:02,711 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:02,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:02,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:23:02,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:23:02,711 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-28 12:23:02,711 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:23:02,711 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-28 12:23:02,713 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695903781572.daff369dbf4222535bada9a7c92453b0. completed. 2023-09-28 12:23:02,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:23:02,713 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695903781572.daff369dbf4222535bada9a7c92453b0. 2023-09-28 12:23:02,713 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 12:23:02,713 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 12:23:02,713 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:02,713 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-28 12:23:02,713 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35175,1695903740297' in zk 2023-09-28 12:23:02,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:23:02,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-28 12:23:02,714 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:02,714 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-28 12:23:02,714 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:23:02,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:02,714 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-28 12:23:02,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:02,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:02,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:23:02,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-28 12:23:02,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:02,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:02,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:02,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39937,1695903740345': 2023-09-28 12:23:02,718 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39937,1695903740345' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-28 12:23:02,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:02,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:23:02,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:23:02,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:23:02,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:23:02,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-28 12:23:02,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:02,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:02,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:02,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:23:02,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-28 12:23:02,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:02,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:02,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:02,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,35175,1695903740297': 2023-09-28 12:23:02,721 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35175,1695903740297' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-28 12:23:02,721 INFO [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-28 12:23:02,721 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 12:23:02,721 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 12:23:02,721 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-28 12:23:02,721 INFO [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 12:23:02,723 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,723 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,723 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:23:02,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:23:02,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,723 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:23:02,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,723 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:23:02,723 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:23:02,724 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:23:02,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:23:02,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:23:02,724 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:02,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:23:02,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:23:02,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:23:02,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:23:02,725 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:02,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-28 12:23:02,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,725 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:02,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:23:02,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-28 12:23:02,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:02,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:02,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:02,727 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:02,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:23:02,727 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:02,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-28 12:23:02,728 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:02,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:02,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:02,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:02,735 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:23:02,735 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:23:02,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:23:02,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:23:02,736 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:02,736 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:23:02,736 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:23:02,736 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:23:02,736 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:23:02,736 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:23:02,736 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-28 12:23:02,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:23:02,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:23:02,736 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:02,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:23:02,738 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:02,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:23:02,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:23:02,737 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-28 12:23:02,737 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:23:02,738 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,738 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-28 12:23:02,738 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:02,738 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 12:23:02,738 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,738 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:02,738 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:02,738 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,738 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:23:02,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:23:02,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:23:02,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:23:02,739 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230928a3ac81e860c64e67857f965d53e8fb79, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230928463e1ded4ead4106a6ccc9798415e8aa] mob files 2023-09-28 12:23:02,739 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230928a3ac81e860c64e67857f965d53e8fb79 2023-09-28 12:23:02,739 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230928463e1ded4ead4106a6ccc9798415e8aa 2023-09-28 12:23:02,751 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-28 12:23:02,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,768 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,769 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-28 12:23:02,769 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,769 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,769 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695903782598Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695903782751 (+153 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1695903782751Loading Region manifests for snaptb0-testConsecutiveExports at 1695903782751Writing data manifest for snaptb0-testConsecutiveExports at 1695903782754 (+3 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1695903782762 (+8 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695903782769 (+7 ms) 2023-09-28 12:23:02,772 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-28 12:23:02,773 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 173 msec 2023-09-28 12:23:02,902 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 12:23:02,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-28 12:23:02,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 12:23:02,904 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/local-export-1695903782904 2023-09-28 12:23:02,904 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/local-export-1695903782904, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/local-export-1695903782904, srcFsUri=hdfs://localhost:35969, srcDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326 2023-09-28 12:23:02,926 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35969, inputRoot=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326 2023-09-28 12:23:02,926 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@52d6f7d1, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/local-export-1695903782904, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/local-export-1695903782904/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,926 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35969, inputRoot=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326, snapshotDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-28 12:23:02,934 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/local-export-1695903782904/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-28 12:23:02,946 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:02,947 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:02,947 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:02,947 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:03,835 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/hadoop-7302117621000013016.jar 2023-09-28 12:23:03,835 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:03,836 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:03,902 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/hadoop-8273852764504425503.jar 2023-09-28 12:23:03,902 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:03,902 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:03,903 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:03,903 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:03,904 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:03,904 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:03,905 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-28 12:23:03,905 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-28 12:23:03,905 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-28 12:23:03,906 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-28 12:23:03,906 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-28 12:23:03,907 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-28 12:23:03,907 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-28 12:23:03,907 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-28 12:23:03,907 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-28 12:23:03,908 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-28 12:23:03,909 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 12:23:03,909 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 12:23:03,910 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 12:23:03,910 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 12:23:03,910 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 12:23:03,911 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 12:23:03,911 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 12:23:04,269 WARN [Listener at jenkins-hbase4.apache.org/33885] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-28 12:23:04,271 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-28 12:23:04,273 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-28 12:23:05,920 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 12:23:05,920 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 12:23:05,922 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695903747070_0002_000001 (auth:SIMPLE) 2023-09-28 12:23:06,722 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695903747070_0003_000001 (auth:SIMPLE) 2023-09-28 12:23:06,832 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-28 12:23:10,438 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695903747070_0003_000001 (auth:SIMPLE) 2023-09-28 12:23:12,654 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695903747070_0003_000001 (auth:SIMPLE) 2023-09-28 12:23:15,052 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695903747070_0003_000001 (auth:SIMPLE) 2023-09-28 12:23:16,434 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-28 12:23:16,434 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-28 12:23:16,438 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-28 12:23:16,439 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-28 12:23:16,439 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-28 12:23:16,439 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1679557244_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-28 12:23:16,442 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(367): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-28 12:23:16,442 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(367): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-28 12:23:16,442 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@10fbebf9 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/local-export-1695903782904/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/local-export-1695903782904/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-28 12:23:16,443 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/local-export-1695903782904/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-28 12:23:16,443 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/local-export-1695903782904/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-28 12:23:16,444 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/local-export-1695903782904, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/local-export-1695903782904, srcFsUri=hdfs://localhost:35969, srcDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326 2023-09-28 12:23:16,466 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35969, inputRoot=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326 2023-09-28 12:23:16,466 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@635bfdc0, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/local-export-1695903782904, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/local-export-1695903782904/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-28 12:23:16,466 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35969, inputRoot=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326, snapshotDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-28 12:23:16,477 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/local-export-1695903782904/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-28 12:23:16,488 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:16,488 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:16,489 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:16,489 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:17,361 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/hadoop-3772031595141307060.jar 2023-09-28 12:23:17,362 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:17,362 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:17,429 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/hadoop-3360118821892466477.jar 2023-09-28 12:23:17,429 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:17,430 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:17,430 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:17,430 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:17,431 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:17,431 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:17,431 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-28 12:23:17,432 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-28 12:23:17,432 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-28 12:23:17,433 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-28 12:23:17,433 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-28 12:23:17,433 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-28 12:23:17,434 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-28 12:23:17,434 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-28 12:23:17,434 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-28 12:23:17,435 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-28 12:23:17,435 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 12:23:17,436 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 12:23:17,436 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 12:23:17,437 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 12:23:17,437 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 12:23:17,437 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 12:23:17,438 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 12:23:17,861 WARN [Listener at jenkins-hbase4.apache.org/33885] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-28 12:23:17,863 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-28 12:23:17,865 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-28 12:23:21,223 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 12:23:21,224 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 12:23:21,227 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695903747070_0003_000001 (auth:SIMPLE) 2023-09-28 12:23:21,934 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695903747070_0004_000001 (auth:SIMPLE) 2023-09-28 12:23:25,830 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695903747070_0004_000001 (auth:SIMPLE) 2023-09-28 12:23:28,055 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695903747070_0004_000001 (auth:SIMPLE) 2023-09-28 12:23:30,337 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695903747070_0004_000001 (auth:SIMPLE) 2023-09-28 12:23:32,049 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-28 12:23:32,050 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-28 12:23:32,052 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-28 12:23:32,053 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-28 12:23:32,053 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-28 12:23:32,053 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1679557244_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-28 12:23:32,057 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(367): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-28 12:23:32,057 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(367): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-28 12:23:32,057 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@10fbebf9 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/local-export-1695903782904/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/local-export-1695903782904/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-28 12:23:32,058 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/local-export-1695903782904/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-28 12:23:32,058 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/local-export-1695903782904/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-28 12:23:32,072 INFO [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-28 12:23:32,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-09-28 12:23:32,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-28 12:23:32,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-28 12:23:32,076 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695903812076"}]},"ts":"1695903812076"} 2023-09-28 12:23:32,078 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-28 12:23:32,081 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-28 12:23:32,081 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=17f437f4515d9c93f6df99a5ec1a2388, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=daff369dbf4222535bada9a7c92453b0, UNASSIGN}] 2023-09-28 12:23:32,083 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=17f437f4515d9c93f6df99a5ec1a2388, UNASSIGN 2023-09-28 12:23:32,083 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=daff369dbf4222535bada9a7c92453b0, UNASSIGN 2023-09-28 12:23:32,084 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=17f437f4515d9c93f6df99a5ec1a2388, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:32,084 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=daff369dbf4222535bada9a7c92453b0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:32,084 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695903781572.17f437f4515d9c93f6df99a5ec1a2388.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695903812084"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695903812084"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695903812084"}]},"ts":"1695903812084"} 2023-09-28 12:23:32,084 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695903781572.daff369dbf4222535bada9a7c92453b0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695903812084"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695903812084"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695903812084"}]},"ts":"1695903812084"} 2023-09-28 12:23:32,086 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure daff369dbf4222535bada9a7c92453b0, server=jenkins-hbase4.apache.org,35175,1695903740297}] 2023-09-28 12:23:32,087 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 17f437f4515d9c93f6df99a5ec1a2388, server=jenkins-hbase4.apache.org,39937,1695903740345}] 2023-09-28 12:23:32,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-28 12:23:32,238 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close daff369dbf4222535bada9a7c92453b0 2023-09-28 12:23:32,238 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing daff369dbf4222535bada9a7c92453b0, disabling compactions & flushes 2023-09-28 12:23:32,238 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695903781572.daff369dbf4222535bada9a7c92453b0. 2023-09-28 12:23:32,238 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695903781572.daff369dbf4222535bada9a7c92453b0. 2023-09-28 12:23:32,238 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695903781572.daff369dbf4222535bada9a7c92453b0. after waiting 0 ms 2023-09-28 12:23:32,238 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695903781572.daff369dbf4222535bada9a7c92453b0. 2023-09-28 12:23:32,241 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 17f437f4515d9c93f6df99a5ec1a2388 2023-09-28 12:23:32,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 17f437f4515d9c93f6df99a5ec1a2388, disabling compactions & flushes 2023-09-28 12:23:32,242 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695903781572.17f437f4515d9c93f6df99a5ec1a2388. 2023-09-28 12:23:32,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695903781572.17f437f4515d9c93f6df99a5ec1a2388. 2023-09-28 12:23:32,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695903781572.17f437f4515d9c93f6df99a5ec1a2388. after waiting 0 ms 2023-09-28 12:23:32,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695903781572.17f437f4515d9c93f6df99a5ec1a2388. 2023-09-28 12:23:32,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testConsecutiveExports/daff369dbf4222535bada9a7c92453b0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 12:23:32,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testConsecutiveExports/17f437f4515d9c93f6df99a5ec1a2388/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 12:23:32,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 12:23:32,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 12:23:32,259 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695903781572.daff369dbf4222535bada9a7c92453b0. 2023-09-28 12:23:32,259 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695903781572.17f437f4515d9c93f6df99a5ec1a2388. 2023-09-28 12:23:32,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for daff369dbf4222535bada9a7c92453b0: 2023-09-28 12:23:32,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 17f437f4515d9c93f6df99a5ec1a2388: 2023-09-28 12:23:32,261 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 17f437f4515d9c93f6df99a5ec1a2388 2023-09-28 12:23:32,261 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=17f437f4515d9c93f6df99a5ec1a2388, regionState=CLOSED 2023-09-28 12:23:32,261 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695903781572.17f437f4515d9c93f6df99a5ec1a2388.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695903812261"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695903812261"}]},"ts":"1695903812261"} 2023-09-28 12:23:32,261 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed daff369dbf4222535bada9a7c92453b0 2023-09-28 12:23:32,262 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=daff369dbf4222535bada9a7c92453b0, regionState=CLOSED 2023-09-28 12:23:32,262 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695903781572.daff369dbf4222535bada9a7c92453b0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695903812262"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695903812262"}]},"ts":"1695903812262"} 2023-09-28 12:23:32,264 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=52 2023-09-28 12:23:32,264 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 17f437f4515d9c93f6df99a5ec1a2388, server=jenkins-hbase4.apache.org,39937,1695903740345 in 176 msec 2023-09-28 12:23:32,266 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=53 2023-09-28 12:23:32,266 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure daff369dbf4222535bada9a7c92453b0, server=jenkins-hbase4.apache.org,35175,1695903740297 in 178 msec 2023-09-28 12:23:32,266 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=17f437f4515d9c93f6df99a5ec1a2388, UNASSIGN in 183 msec 2023-09-28 12:23:32,267 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-09-28 12:23:32,267 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=daff369dbf4222535bada9a7c92453b0, UNASSIGN in 185 msec 2023-09-28 12:23:32,268 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695903812268"}]},"ts":"1695903812268"} 2023-09-28 12:23:32,269 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-28 12:23:32,271 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-28 12:23:32,273 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 200 msec 2023-09-28 12:23:32,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-28 12:23:32,378 INFO [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-28 12:23:32,379 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-09-28 12:23:32,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-28 12:23:32,383 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-28 12:23:32,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-28 12:23:32,384 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-28 12:23:32,386 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40363] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-28 12:23:32,389 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-28 12:23:32,389 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-28 12:23:32,389 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-28 12:23:32,389 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-28 12:23:32,389 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-28 12:23:32,390 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-28 12:23:32,390 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-28 12:23:32,390 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testConsecutiveExports/17f437f4515d9c93f6df99a5ec1a2388 2023-09-28 12:23:32,390 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-28 12:23:32,390 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testConsecutiveExports/daff369dbf4222535bada9a7c92453b0 2023-09-28 12:23:32,391 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-28 12:23:32,391 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-28 12:23:32,391 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-28 12:23:32,391 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:23:32,391 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:23:32,391 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-28 12:23:32,391 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:23:32,392 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:23:32,392 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testConsecutiveExports/17f437f4515d9c93f6df99a5ec1a2388/cf, FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testConsecutiveExports/17f437f4515d9c93f6df99a5ec1a2388/recovered.edits] 2023-09-28 12:23:32,393 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testConsecutiveExports/daff369dbf4222535bada9a7c92453b0/cf, FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testConsecutiveExports/daff369dbf4222535bada9a7c92453b0/recovered.edits] 2023-09-28 12:23:32,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-28 12:23:32,400 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testConsecutiveExports/17f437f4515d9c93f6df99a5ec1a2388/cf/c0e494ae20f24678ae9a91c973167f6f to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testConsecutiveExports/17f437f4515d9c93f6df99a5ec1a2388/cf/c0e494ae20f24678ae9a91c973167f6f 2023-09-28 12:23:32,400 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testConsecutiveExports/daff369dbf4222535bada9a7c92453b0/cf/b548d42a516345e1a8387fccf8d13dfb to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testConsecutiveExports/daff369dbf4222535bada9a7c92453b0/cf/b548d42a516345e1a8387fccf8d13dfb 2023-09-28 12:23:32,403 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testConsecutiveExports/17f437f4515d9c93f6df99a5ec1a2388/recovered.edits/9.seqid to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testConsecutiveExports/17f437f4515d9c93f6df99a5ec1a2388/recovered.edits/9.seqid 2023-09-28 12:23:32,404 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testConsecutiveExports/daff369dbf4222535bada9a7c92453b0/recovered.edits/9.seqid to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testConsecutiveExports/daff369dbf4222535bada9a7c92453b0/recovered.edits/9.seqid 2023-09-28 12:23:32,404 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testConsecutiveExports/17f437f4515d9c93f6df99a5ec1a2388 2023-09-28 12:23:32,404 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testConsecutiveExports/daff369dbf4222535bada9a7c92453b0 2023-09-28 12:23:32,404 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-28 12:23:32,405 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-28 12:23:32,406 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-28 12:23:32,409 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230928a3ac81e860c64e67857f965d53e8fb79 to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230928a3ac81e860c64e67857f965d53e8fb79 2023-09-28 12:23:32,410 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230928463e1ded4ead4106a6ccc9798415e8aa to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230928463e1ded4ead4106a6ccc9798415e8aa 2023-09-28 12:23:32,410 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-28 12:23:32,413 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-28 12:23:32,415 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-28 12:23:32,417 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-28 12:23:32,418 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-28 12:23:32,418 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-28 12:23:32,418 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1695903781572.17f437f4515d9c93f6df99a5ec1a2388.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695903812418"}]},"ts":"9223372036854775807"} 2023-09-28 12:23:32,418 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1695903781572.daff369dbf4222535bada9a7c92453b0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695903812418"}]},"ts":"9223372036854775807"} 2023-09-28 12:23:32,420 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-28 12:23:32,420 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 17f437f4515d9c93f6df99a5ec1a2388, NAME => 'testtb-testConsecutiveExports,,1695903781572.17f437f4515d9c93f6df99a5ec1a2388.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => daff369dbf4222535bada9a7c92453b0, NAME => 'testtb-testConsecutiveExports,1,1695903781572.daff369dbf4222535bada9a7c92453b0.', STARTKEY => '1', ENDKEY => ''}] 2023-09-28 12:23:32,420 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-28 12:23:32,420 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695903812420"}]},"ts":"9223372036854775807"} 2023-09-28 12:23:32,422 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-28 12:23:32,423 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-28 12:23:32,425 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 44 msec 2023-09-28 12:23:32,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-28 12:23:32,494 INFO [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-28 12:23:32,502 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-28 12:23:32,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-28 12:23:32,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-09-28 12:23:32,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-28 12:23:32,530 INFO [Listener at jenkins-hbase4.apache.org/33885] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=746 (was 763), OpenFileDescriptor=898 (was 933), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=178 (was 272), ProcessCount=172 (was 170) - ProcessCount LEAK? -, AvailableMemoryMB=4602 (was 4704) 2023-09-28 12:23:32,531 WARN [Listener at jenkins-hbase4.apache.org/33885] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-09-28 12:23:32,550 INFO [Listener at jenkins-hbase4.apache.org/33885] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=745, OpenFileDescriptor=896, MaxFileDescriptor=60000, SystemLoadAverage=178, ProcessCount=172, AvailableMemoryMB=4608 2023-09-28 12:23:32,550 WARN [Listener at jenkins-hbase4.apache.org/33885] hbase.ResourceChecker(130): Thread=745 is superior to 500 2023-09-28 12:23:32,552 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-28 12:23:32,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:32,555 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-28 12:23:32,555 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-28 12:23:32,556 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-28 12:23:32,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-28 12:23:32,559 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a84094c45873efbede08142718bc962 2023-09-28 12:23:32,559 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/91919fe6a2f8eb8db434879c66e3ad10 2023-09-28 12:23:32,559 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a84094c45873efbede08142718bc962 empty. 2023-09-28 12:23:32,559 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/91919fe6a2f8eb8db434879c66e3ad10 empty. 2023-09-28 12:23:32,560 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a84094c45873efbede08142718bc962 2023-09-28 12:23:32,560 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/91919fe6a2f8eb8db434879c66e3ad10 2023-09-28 12:23:32,560 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-28 12:23:32,570 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-28 12:23:32,571 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3a84094c45873efbede08142718bc962, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695903812551.3a84094c45873efbede08142718bc962.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp 2023-09-28 12:23:32,571 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 91919fe6a2f8eb8db434879c66e3ad10, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695903812551.91919fe6a2f8eb8db434879c66e3ad10.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp 2023-09-28 12:23:32,585 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695903812551.91919fe6a2f8eb8db434879c66e3ad10.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 12:23:32,585 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 91919fe6a2f8eb8db434879c66e3ad10, disabling compactions & flushes 2023-09-28 12:23:32,585 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695903812551.91919fe6a2f8eb8db434879c66e3ad10. 2023-09-28 12:23:32,586 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695903812551.91919fe6a2f8eb8db434879c66e3ad10. 2023-09-28 12:23:32,586 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695903812551.91919fe6a2f8eb8db434879c66e3ad10. after waiting 0 ms 2023-09-28 12:23:32,586 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695903812551.91919fe6a2f8eb8db434879c66e3ad10. 2023-09-28 12:23:32,586 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695903812551.91919fe6a2f8eb8db434879c66e3ad10. 2023-09-28 12:23:32,586 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 91919fe6a2f8eb8db434879c66e3ad10: 2023-09-28 12:23:32,588 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695903812551.3a84094c45873efbede08142718bc962.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 12:23:32,588 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 3a84094c45873efbede08142718bc962, disabling compactions & flushes 2023-09-28 12:23:32,588 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695903812551.3a84094c45873efbede08142718bc962. 2023-09-28 12:23:32,589 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695903812551.3a84094c45873efbede08142718bc962. 2023-09-28 12:23:32,589 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695903812551.3a84094c45873efbede08142718bc962. after waiting 0 ms 2023-09-28 12:23:32,589 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695903812551.3a84094c45873efbede08142718bc962. 2023-09-28 12:23:32,589 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695903812551.3a84094c45873efbede08142718bc962. 2023-09-28 12:23:32,589 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 3a84094c45873efbede08142718bc962: 2023-09-28 12:23:32,591 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-28 12:23:32,592 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695903812551.91919fe6a2f8eb8db434879c66e3ad10.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695903812592"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695903812592"}]},"ts":"1695903812592"} 2023-09-28 12:23:32,592 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695903812551.3a84094c45873efbede08142718bc962.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695903812592"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695903812592"}]},"ts":"1695903812592"} 2023-09-28 12:23:32,602 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-28 12:23:32,603 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-28 12:23:32,603 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695903812603"}]},"ts":"1695903812603"} 2023-09-28 12:23:32,604 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-28 12:23:32,607 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-28 12:23:32,609 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-28 12:23:32,609 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-28 12:23:32,609 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-28 12:23:32,609 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-28 12:23:32,609 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3a84094c45873efbede08142718bc962, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=91919fe6a2f8eb8db434879c66e3ad10, ASSIGN}] 2023-09-28 12:23:32,612 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=91919fe6a2f8eb8db434879c66e3ad10, ASSIGN 2023-09-28 12:23:32,612 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3a84094c45873efbede08142718bc962, ASSIGN 2023-09-28 12:23:32,612 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3a84094c45873efbede08142718bc962, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40363,1695903740380; forceNewPlan=false, retain=false 2023-09-28 12:23:32,612 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=91919fe6a2f8eb8db434879c66e3ad10, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39937,1695903740345; forceNewPlan=false, retain=false 2023-09-28 12:23:32,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-28 12:23:32,763 INFO [jenkins-hbase4:45395] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-28 12:23:32,765 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=91919fe6a2f8eb8db434879c66e3ad10, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:32,765 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=3a84094c45873efbede08142718bc962, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:32,766 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695903812551.91919fe6a2f8eb8db434879c66e3ad10.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695903812765"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695903812765"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695903812765"}]},"ts":"1695903812765"} 2023-09-28 12:23:32,766 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695903812551.3a84094c45873efbede08142718bc962.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695903812765"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695903812765"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695903812765"}]},"ts":"1695903812765"} 2023-09-28 12:23:32,768 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 3a84094c45873efbede08142718bc962, server=jenkins-hbase4.apache.org,40363,1695903740380}] 2023-09-28 12:23:32,768 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 91919fe6a2f8eb8db434879c66e3ad10, server=jenkins-hbase4.apache.org,39937,1695903740345}] 2023-09-28 12:23:32,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-28 12:23:32,926 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1695903812551.91919fe6a2f8eb8db434879c66e3ad10. 2023-09-28 12:23:32,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 91919fe6a2f8eb8db434879c66e3ad10, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695903812551.91919fe6a2f8eb8db434879c66e3ad10.', STARTKEY => '1', ENDKEY => ''} 2023-09-28 12:23:32,926 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1695903812551.3a84094c45873efbede08142718bc962. 2023-09-28 12:23:32,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3a84094c45873efbede08142718bc962, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695903812551.3a84094c45873efbede08142718bc962.', STARTKEY => '', ENDKEY => '1'} 2023-09-28 12:23:32,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1695903812551.91919fe6a2f8eb8db434879c66e3ad10. service=AccessControlService 2023-09-28 12:23:32,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1695903812551.3a84094c45873efbede08142718bc962. service=AccessControlService 2023-09-28 12:23:32,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 12:23:32,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 12:23:32,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 91919fe6a2f8eb8db434879c66e3ad10 2023-09-28 12:23:32,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 3a84094c45873efbede08142718bc962 2023-09-28 12:23:32,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695903812551.91919fe6a2f8eb8db434879c66e3ad10.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 12:23:32,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695903812551.3a84094c45873efbede08142718bc962.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 12:23:32,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 91919fe6a2f8eb8db434879c66e3ad10 2023-09-28 12:23:32,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3a84094c45873efbede08142718bc962 2023-09-28 12:23:32,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 91919fe6a2f8eb8db434879c66e3ad10 2023-09-28 12:23:32,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3a84094c45873efbede08142718bc962 2023-09-28 12:23:32,928 INFO [StoreOpener-91919fe6a2f8eb8db434879c66e3ad10-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 91919fe6a2f8eb8db434879c66e3ad10 2023-09-28 12:23:32,928 INFO [StoreOpener-3a84094c45873efbede08142718bc962-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3a84094c45873efbede08142718bc962 2023-09-28 12:23:32,930 DEBUG [StoreOpener-91919fe6a2f8eb8db434879c66e3ad10-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion/91919fe6a2f8eb8db434879c66e3ad10/cf 2023-09-28 12:23:32,930 DEBUG [StoreOpener-91919fe6a2f8eb8db434879c66e3ad10-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion/91919fe6a2f8eb8db434879c66e3ad10/cf 2023-09-28 12:23:32,930 DEBUG [StoreOpener-3a84094c45873efbede08142718bc962-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a84094c45873efbede08142718bc962/cf 2023-09-28 12:23:32,930 DEBUG [StoreOpener-3a84094c45873efbede08142718bc962-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a84094c45873efbede08142718bc962/cf 2023-09-28 12:23:32,931 INFO [StoreOpener-91919fe6a2f8eb8db434879c66e3ad10-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 91919fe6a2f8eb8db434879c66e3ad10 columnFamilyName cf 2023-09-28 12:23:32,931 INFO [StoreOpener-3a84094c45873efbede08142718bc962-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3a84094c45873efbede08142718bc962 columnFamilyName cf 2023-09-28 12:23:32,932 INFO [StoreOpener-91919fe6a2f8eb8db434879c66e3ad10-1] regionserver.HStore(310): Store=91919fe6a2f8eb8db434879c66e3ad10/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 12:23:32,933 INFO [StoreOpener-3a84094c45873efbede08142718bc962-1] regionserver.HStore(310): Store=3a84094c45873efbede08142718bc962/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 12:23:32,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion/91919fe6a2f8eb8db434879c66e3ad10 2023-09-28 12:23:32,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion/91919fe6a2f8eb8db434879c66e3ad10 2023-09-28 12:23:32,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a84094c45873efbede08142718bc962 2023-09-28 12:23:32,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a84094c45873efbede08142718bc962 2023-09-28 12:23:32,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 91919fe6a2f8eb8db434879c66e3ad10 2023-09-28 12:23:32,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3a84094c45873efbede08142718bc962 2023-09-28 12:23:32,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion/91919fe6a2f8eb8db434879c66e3ad10/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 12:23:32,939 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 91919fe6a2f8eb8db434879c66e3ad10; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64698005, jitterRate=-0.03592459857463837}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 12:23:32,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 91919fe6a2f8eb8db434879c66e3ad10: 2023-09-28 12:23:32,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a84094c45873efbede08142718bc962/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 12:23:32,940 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1695903812551.91919fe6a2f8eb8db434879c66e3ad10., pid=61, masterSystemTime=1695903812920 2023-09-28 12:23:32,940 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3a84094c45873efbede08142718bc962; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66950558, jitterRate=-0.002358943223953247}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 12:23:32,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3a84094c45873efbede08142718bc962: 2023-09-28 12:23:32,941 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1695903812551.3a84094c45873efbede08142718bc962., pid=60, masterSystemTime=1695903812920 2023-09-28 12:23:32,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1695903812551.91919fe6a2f8eb8db434879c66e3ad10. 2023-09-28 12:23:32,942 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1695903812551.91919fe6a2f8eb8db434879c66e3ad10. 2023-09-28 12:23:32,943 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=91919fe6a2f8eb8db434879c66e3ad10, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:32,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1695903812551.3a84094c45873efbede08142718bc962. 2023-09-28 12:23:32,943 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695903812551.91919fe6a2f8eb8db434879c66e3ad10.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695903812943"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695903812943"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695903812943"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695903812943"}]},"ts":"1695903812943"} 2023-09-28 12:23:32,943 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1695903812551.3a84094c45873efbede08142718bc962. 2023-09-28 12:23:32,943 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=3a84094c45873efbede08142718bc962, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:32,944 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695903812551.3a84094c45873efbede08142718bc962.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695903812943"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695903812943"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695903812943"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695903812943"}]},"ts":"1695903812943"} 2023-09-28 12:23:32,947 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=59 2023-09-28 12:23:32,947 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 91919fe6a2f8eb8db434879c66e3ad10, server=jenkins-hbase4.apache.org,39937,1695903740345 in 177 msec 2023-09-28 12:23:32,948 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=58 2023-09-28 12:23:32,948 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 3a84094c45873efbede08142718bc962, server=jenkins-hbase4.apache.org,40363,1695903740380 in 179 msec 2023-09-28 12:23:32,949 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=91919fe6a2f8eb8db434879c66e3ad10, ASSIGN in 338 msec 2023-09-28 12:23:32,950 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=58, resume processing ppid=57 2023-09-28 12:23:32,950 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3a84094c45873efbede08142718bc962, ASSIGN in 339 msec 2023-09-28 12:23:32,951 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-28 12:23:32,951 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695903812951"}]},"ts":"1695903812951"} 2023-09-28 12:23:32,952 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-28 12:23:32,954 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-28 12:23:32,955 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-28 12:23:32,956 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40363] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-28 12:23:32,958 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:23:32,958 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:23:32,958 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:23:32,958 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:23:32,960 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 12:23:32,960 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 12:23:32,961 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 12:23:32,960 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 12:23:32,962 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 408 msec 2023-09-28 12:23:33,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-28 12:23:33,160 INFO [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-28 12:23:33,162 DEBUG [Listener at jenkins-hbase4.apache.org/33885] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,163 DEBUG [Listener at jenkins-hbase4.apache.org/33885] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695903812551.3a84094c45873efbede08142718bc962. 2023-09-28 12:23:33,164 INFO [Listener at jenkins-hbase4.apache.org/33885] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 12:23:33,179 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-28 12:23:33,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695903813179 (current time:1695903813179). 2023-09-28 12:23:33,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 12:23:33,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(139): Connect 0x45a31af0 to 127.0.0.1:65025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 12:23:33,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@51c0bd1b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 12:23:33,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 12:23:33,189 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50812, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 12:23:33,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45a31af0 to 127.0.0.1:65025 2023-09-28 12:23:33,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 12:23:33,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(139): Connect 0x77d25248 to 127.0.0.1:65025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 12:23:33,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2afbb2d8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 12:23:33,197 DEBUG [hconnection-0x7e07faf9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 12:23:33,199 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50816, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 12:23:33,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x77d25248 to 127.0.0.1:65025 2023-09-28 12:23:33,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 12:23:33,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-28 12:23:33,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 12:23:33,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-28 12:23:33,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-28 12:23:33,207 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-28 12:23:33,208 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695904413208 2023-09-28 12:23:33,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-28 12:23:33,208 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,209 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 12:23:33,209 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 12:23:33,210 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-28 12:23:33,211 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-28 12:23:33,212 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-28 12:23:33,212 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-28 12:23:33,213 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695904413213 2023-09-28 12:23:33,228 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,228 INFO [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-28 12:23:33,228 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:23:33,230 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-28 12:23:33,230 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-28 12:23:33,231 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,231 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,232 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:23:33,232 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:33,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:23:33,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:23:33,232 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:23:33,232 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:23:33,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:23:33,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:23:33,232 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:33,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:23:33,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:23:33,232 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:33,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,233 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,233 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:33,233 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 12:23:33,233 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,233 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-28 12:23:33,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,233 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-28 12:23:33,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-28 12:23:33,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-28 12:23:33,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,234 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-28 12:23:33,234 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-28 12:23:33,234 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,234 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,234 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-28 12:23:33,234 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,234 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:23:33,234 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-28 12:23:33,234 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-28 12:23:33,235 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:23:33,235 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-28 12:23:33,237 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-28 12:23:33,237 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-28 12:23:33,236 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:23:33,237 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35175,1695903740297' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-28 12:23:33,237 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-28 12:23:33,238 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-28 12:23:33,238 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40363,1695903740380' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-28 12:23:33,237 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-28 12:23:33,238 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39937,1695903740345' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-28 12:23:33,242 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,242 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,242 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,242 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 12:23:33,242 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,242 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:33,243 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:33,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:33,243 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,243 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 12:23:33,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:23:33,243 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:23:33,243 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 12:23:33,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:23:33,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:23:33,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:33,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:33,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:33,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:23:33,245 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39937,1695903740345' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-28 12:23:33,245 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@716d24d3[Count = 1] remaining members to acquire global barrier 2023-09-28 12:23:33,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:33,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:23:33,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:23:33,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:23:33,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:23:33,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:33,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:33,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:33,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:23:33,248 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40363,1695903740380' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-28 12:23:33,248 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@716d24d3[Count = 0] remaining members to acquire global barrier 2023-09-28 12:23:33,248 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-28 12:23:33,248 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,253 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,253 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,253 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,253 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-28 12:23:33,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,253 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-28 12:23:33,253 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:33,253 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35175,1695903740297' in zk 2023-09-28 12:23:33,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,253 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-28 12:23:33,253 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-28 12:23:33,253 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:33,253 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 12:23:33,254 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 12:23:33,254 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 12:23:33,254 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695903812551.91919fe6a2f8eb8db434879c66e3ad10. 2023-09-28 12:23:33,254 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695903812551.3a84094c45873efbede08142718bc962. 2023-09-28 12:23:33,254 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695903812551.91919fe6a2f8eb8db434879c66e3ad10. started... 2023-09-28 12:23:33,254 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 12:23:33,254 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695903812551.3a84094c45873efbede08142718bc962. started... 2023-09-28 12:23:33,255 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 12:23:33,256 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 91919fe6a2f8eb8db434879c66e3ad10: 2023-09-28 12:23:33,256 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3a84094c45873efbede08142718bc962: 2023-09-28 12:23:33,256 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695903812551.3a84094c45873efbede08142718bc962.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,256 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695903812551.91919fe6a2f8eb8db434879c66e3ad10.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,256 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 12:23:33,256 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 12:23:33,256 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 12:23:33,256 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 12:23:33,259 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-28 12:23:33,259 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:23:33,259 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-28 12:23:33,269 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695903812551.91919fe6a2f8eb8db434879c66e3ad10. completed. 2023-09-28 12:23:33,269 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695903812551.91919fe6a2f8eb8db434879c66e3ad10. 2023-09-28 12:23:33,269 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 12:23:33,269 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 12:23:33,269 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:33,269 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-28 12:23:33,269 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39937,1695903740345' in zk 2023-09-28 12:23:33,271 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-28 12:23:33,271 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:33,271 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:23:33,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:33,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:23:33,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:23:33,272 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-28 12:23:33,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:23:33,274 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695903812551.3a84094c45873efbede08142718bc962. completed. 2023-09-28 12:23:33,274 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695903812551.3a84094c45873efbede08142718bc962. 2023-09-28 12:23:33,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:23:33,274 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 12:23:33,274 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 12:23:33,274 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:33,274 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-28 12:23:33,274 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40363,1695903740380' in zk 2023-09-28 12:23:33,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:33,275 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:33,275 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-28 12:23:33,276 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:23:33,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:33,276 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-28 12:23:33,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:33,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:23:33,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:33,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:33,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:33,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39937,1695903740345': 2023-09-28 12:23:33,279 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39937,1695903740345' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-28 12:23:33,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:33,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:23:33,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:23:33,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:23:33,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:23:33,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:33,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:33,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:33,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:23:33,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:33,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:33,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:33,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40363,1695903740380': 2023-09-28 12:23:33,283 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40363,1695903740380' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-28 12:23:33,283 INFO [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-28 12:23:33,283 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 12:23:33,283 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 12:23:33,283 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,283 INFO [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 12:23:33,286 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,286 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,286 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:23:33,286 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,286 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:23:33,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:23:33,286 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:23:33,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,286 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:33,286 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:23:33,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:23:33,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:23:33,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:23:33,287 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:33,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:23:33,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:23:33,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:23:33,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:23:33,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,287 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:33,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:23:33,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:33,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:33,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:33,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:23:33,289 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:33,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,290 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:33,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:33,290 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:33,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:33,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:33,294 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:33,294 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,294 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:23:33,294 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:33,294 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:23:33,294 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:23:33,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:23:33,294 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:23:33,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:23:33,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:23:33,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:23:33,294 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,294 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:23:33,294 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:23:33,294 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:23:33,294 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:33,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:23:33,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:23:33,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:23:33,296 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:23:33,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:23:33,294 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,296 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:33,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:23:33,296 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,296 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,297 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:33,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:23:33,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:23:33,297 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:33,297 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 12:23:33,297 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,297 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,298 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-28 12:23:33,304 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,305 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,309 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 12:23:33,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-28 12:23:33,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-28 12:23:33,311 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 12:23:33,327 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,327 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-28 12:23:33,327 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,328 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,328 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695903813208Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695903813304 (+96 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695903813304Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695903813304Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695903813308 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695903813321 (+13 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695903813327 (+6 ms) 2023-09-28 12:23:33,330 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-28 12:23:33,332 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 121 msec 2023-09-28 12:23:33,511 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 12:23:33,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-28 12:23:33,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 12:23:33,514 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40363] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1695903812551.3a84094c45873efbede08142718bc962. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 12:23:33,516 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39937] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1695903812551.91919fe6a2f8eb8db434879c66e3ad10. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 12:23:33,518 DEBUG [Listener at jenkins-hbase4.apache.org/33885] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,519 DEBUG [Listener at jenkins-hbase4.apache.org/33885] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695903812551.3a84094c45873efbede08142718bc962. 2023-09-28 12:23:33,519 INFO [Listener at jenkins-hbase4.apache.org/33885] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 12:23:33,528 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-28 12:23:33,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695903813528 (current time:1695903813528). 2023-09-28 12:23:33,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 12:23:33,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(139): Connect 0x6ba22d99 to 127.0.0.1:65025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 12:23:33,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37a87d26, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 12:23:33,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 12:23:33,540 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50832, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 12:23:33,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6ba22d99 to 127.0.0.1:65025 2023-09-28 12:23:33,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 12:23:33,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(139): Connect 0x10b5292c to 127.0.0.1:65025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 12:23:33,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a011046, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 12:23:33,548 DEBUG [hconnection-0x1eb4016d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 12:23:33,549 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50834, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 12:23:33,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x10b5292c to 127.0.0.1:65025 2023-09-28 12:23:33,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 12:23:33,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-28 12:23:33,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 12:23:33,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-28 12:23:33,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-28 12:23:33,557 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-28 12:23:33,558 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695904413558 2023-09-28 12:23:33,558 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-28 12:23:33,559 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 12:23:33,559 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 12:23:33,560 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-28 12:23:33,560 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-28 12:23:33,561 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-28 12:23:33,562 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-28 12:23:33,563 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695904413563 2023-09-28 12:23:33,571 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,571 INFO [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-28 12:23:33,571 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:23:33,572 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-28 12:23:33,572 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-28 12:23:33,573 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,573 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,574 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:23:33,574 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:33,574 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:23:33,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:23:33,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:23:33,574 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:23:33,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:23:33,574 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:33,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:23:33,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:23:33,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,574 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:33,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:23:33,575 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,575 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:33,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,575 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 12:23:33,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-28 12:23:33,575 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,575 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,576 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-28 12:23:33,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-28 12:23:33,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-28 12:23:33,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,576 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-28 12:23:33,576 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-28 12:23:33,576 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,576 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-28 12:23:33,576 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,576 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:23:33,576 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-28 12:23:33,578 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-28 12:23:33,578 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-28 12:23:33,578 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:23:33,578 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,579 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-28 12:23:33,579 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-28 12:23:33,579 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:23:33,579 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-28 12:23:33,579 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-28 12:23:33,580 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-28 12:23:33,580 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40363,1695903740380' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-28 12:23:33,578 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39937,1695903740345' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-28 12:23:33,579 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35175,1695903740297' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-28 12:23:33,581 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:33,581 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:33,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:23:33,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:23:33,581 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:33,581 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,582 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:23:33,582 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,582 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 12:23:33,582 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,582 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 12:23:33,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:23:33,582 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,582 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 12:23:33,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:33,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:33,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:33,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:23:33,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40363,1695903740380' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-28 12:23:33,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43e7ec26[Count = 1] remaining members to acquire global barrier 2023-09-28 12:23:33,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:33,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:23:33,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:23:33,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:23:33,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:23:33,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:33,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:33,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:33,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:23:33,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39937,1695903740345' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-28 12:23:33,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43e7ec26[Count = 0] remaining members to acquire global barrier 2023-09-28 12:23:33,586 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-28 12:23:33,586 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,588 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,588 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,588 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,589 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:33,589 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-28 12:23:33,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,589 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-28 12:23:33,589 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-28 12:23:33,589 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:33,589 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 12:23:33,589 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 12:23:33,589 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695903812551.91919fe6a2f8eb8db434879c66e3ad10. 2023-09-28 12:23:33,589 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 12:23:33,589 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695903812551.91919fe6a2f8eb8db434879c66e3ad10. started... 2023-09-28 12:23:33,589 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 12:23:33,589 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 12:23:33,589 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-28 12:23:33,589 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35175,1695903740297' in zk 2023-09-28 12:23:33,589 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695903812551.3a84094c45873efbede08142718bc962. 2023-09-28 12:23:33,589 INFO [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 91919fe6a2f8eb8db434879c66e3ad10 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-28 12:23:33,589 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695903812551.3a84094c45873efbede08142718bc962. started... 2023-09-28 12:23:33,590 INFO [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3a84094c45873efbede08142718bc962 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-28 12:23:33,591 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-28 12:23:33,591 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:23:33,591 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-28 12:23:33,608 INFO [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309280deaa582cead43b9b5303114d37cb3ad to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309280deaa582cead43b9b5303114d37cb3ad 2023-09-28 12:23:33,608 INFO [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230928a0e1907a75aa4b338bd231d7926b5a8a to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230928a0e1907a75aa4b338bd231d7926b5a8a 2023-09-28 12:23:33,616 INFO [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion/91919fe6a2f8eb8db434879c66e3ad10/.tmp/cf/63bd81fb6d50495cb254e4ccee40c2b0 2023-09-28 12:23:33,616 INFO [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a84094c45873efbede08142718bc962/.tmp/cf/db3fccad22e64253a9f4f806bf384ef3 2023-09-28 12:23:33,620 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion/91919fe6a2f8eb8db434879c66e3ad10/.tmp/cf/63bd81fb6d50495cb254e4ccee40c2b0 as hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion/91919fe6a2f8eb8db434879c66e3ad10/cf/63bd81fb6d50495cb254e4ccee40c2b0 2023-09-28 12:23:33,621 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a84094c45873efbede08142718bc962/.tmp/cf/db3fccad22e64253a9f4f806bf384ef3 as hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a84094c45873efbede08142718bc962/cf/db3fccad22e64253a9f4f806bf384ef3 2023-09-28 12:23:33,625 INFO [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion/91919fe6a2f8eb8db434879c66e3ad10/cf/63bd81fb6d50495cb254e4ccee40c2b0, entries=47, sequenceid=6, filesize=13.5 K 2023-09-28 12:23:33,626 INFO [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a84094c45873efbede08142718bc962/cf/db3fccad22e64253a9f4f806bf384ef3, entries=3, sequenceid=6, filesize=5.4 K 2023-09-28 12:23:33,626 INFO [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 91919fe6a2f8eb8db434879c66e3ad10 in 37ms, sequenceid=6, compaction requested=false 2023-09-28 12:23:33,626 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-28 12:23:33,626 INFO [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 3a84094c45873efbede08142718bc962 in 36ms, sequenceid=6, compaction requested=false 2023-09-28 12:23:33,627 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 91919fe6a2f8eb8db434879c66e3ad10: 2023-09-28 12:23:33,628 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3a84094c45873efbede08142718bc962: 2023-09-28 12:23:33,628 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695903812551.91919fe6a2f8eb8db434879c66e3ad10.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,628 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695903812551.3a84094c45873efbede08142718bc962.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,628 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 12:23:33,628 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion/91919fe6a2f8eb8db434879c66e3ad10/cf/63bd81fb6d50495cb254e4ccee40c2b0] hfiles 2023-09-28 12:23:33,628 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 12:23:33,628 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion/91919fe6a2f8eb8db434879c66e3ad10/cf/63bd81fb6d50495cb254e4ccee40c2b0 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,628 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a84094c45873efbede08142718bc962/cf/db3fccad22e64253a9f4f806bf384ef3] hfiles 2023-09-28 12:23:33,628 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a84094c45873efbede08142718bc962/cf/db3fccad22e64253a9f4f806bf384ef3 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,637 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695903812551.3a84094c45873efbede08142718bc962. completed. 2023-09-28 12:23:33,637 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695903812551.3a84094c45873efbede08142718bc962. 2023-09-28 12:23:33,637 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 12:23:33,637 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 12:23:33,637 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:33,637 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-28 12:23:33,637 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40363,1695903740380' in zk 2023-09-28 12:23:33,637 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695903812551.91919fe6a2f8eb8db434879c66e3ad10. completed. 2023-09-28 12:23:33,637 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695903812551.91919fe6a2f8eb8db434879c66e3ad10. 2023-09-28 12:23:33,637 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 12:23:33,637 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 12:23:33,638 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:33,638 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-28 12:23:33,638 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39937,1695903740345' in zk 2023-09-28 12:23:33,639 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:33,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:33,639 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-28 12:23:33,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:23:33,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:23:33,639 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:23:33,639 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-28 12:23:33,641 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:33,641 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-28 12:23:33,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:23:33,641 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:23:33,641 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-28 12:23:33,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:23:33,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:33,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:33,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:33,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:23:33,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:33,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:33,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:33,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40363,1695903740380': 2023-09-28 12:23:33,646 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40363,1695903740380' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-28 12:23:33,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:33,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:23:33,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:23:33,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:23:33,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:23:33,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:33,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:33,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:33,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:23:33,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:33,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:33,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:33,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39937,1695903740345': 2023-09-28 12:23:33,649 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39937,1695903740345' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-28 12:23:33,649 INFO [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-28 12:23:33,649 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 12:23:33,649 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 12:23:33,649 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,649 INFO [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 12:23:33,655 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,655 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,655 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:23:33,655 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:23:33,655 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,655 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:23:33,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:23:33,656 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:23:33,656 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:33,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:23:33,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:23:33,656 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:33,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:23:33,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:23:33,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:23:33,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:23:33,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:23:33,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,657 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:33,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:23:33,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:33,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:33,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:33,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:23:33,658 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:33,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,659 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:33,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:33,659 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:33,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:33,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:33,660 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 12:23:33,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-28 12:23:33,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-28 12:23:33,661 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 12:23:33,662 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:33,662 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,662 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:33,662 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:33,662 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,662 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:23:33,662 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:33,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:23:33,662 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:23:33,662 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,662 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:23:33,662 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,662 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,662 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:23:33,662 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:23:33,662 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:33,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:23:33,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:23:33,662 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 12:23:33,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:23:33,662 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:23:33,662 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:23:33,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:23:33,664 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:33,664 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,664 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:23:33,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:23:33,664 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:23:33,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:23:33,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:23:33,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:23:33,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:23:33,665 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230928a0e1907a75aa4b338bd231d7926b5a8a, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309280deaa582cead43b9b5303114d37cb3ad] mob files 2023-09-28 12:23:33,665 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230928a0e1907a75aa4b338bd231d7926b5a8a 2023-09-28 12:23:33,665 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309280deaa582cead43b9b5303114d37cb3ad 2023-09-28 12:23:33,672 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,673 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,689 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,689 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-28 12:23:33,690 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,690 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:33,690 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695903813558Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695903813672 (+114 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695903813672Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1695903813672Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1695903813675 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695903813682 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695903813689 (+7 ms) 2023-09-28 12:23:33,692 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-28 12:23:33,694 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 133 msec 2023-09-28 12:23:33,862 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 12:23:33,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-28 12:23:33,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 12:23:33,892 DEBUG [Listener at jenkins-hbase4.apache.org/33885] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-28 12:23:33,895 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48894, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-28 12:23:33,896 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35175] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-28 12:23:33,897 DEBUG [Listener at jenkins-hbase4.apache.org/33885] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-28 12:23:33,902 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33482, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-28 12:23:33,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39937] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-28 12:23:33,903 DEBUG [Listener at jenkins-hbase4.apache.org/33885] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-28 12:23:33,906 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50836, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-28 12:23:33,906 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40363] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-28 12:23:33,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-28 12:23:33,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:33,911 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-28 12:23:33,911 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-28 12:23:33,912 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-28 12:23:33,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-28 12:23:33,914 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb9b19204dcb46ab27dd90f346b3d62a 2023-09-28 12:23:33,914 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/605c63c32676d6ce3192ea1d15459750 2023-09-28 12:23:33,915 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb9b19204dcb46ab27dd90f346b3d62a empty. 2023-09-28 12:23:33,915 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/605c63c32676d6ce3192ea1d15459750 empty. 2023-09-28 12:23:33,915 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb9b19204dcb46ab27dd90f346b3d62a 2023-09-28 12:23:33,915 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/605c63c32676d6ce3192ea1d15459750 2023-09-28 12:23:33,915 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-28 12:23:33,924 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-28 12:23:33,926 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 605c63c32676d6ce3192ea1d15459750, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695903813908.605c63c32676d6ce3192ea1d15459750.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp 2023-09-28 12:23:33,926 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => bb9b19204dcb46ab27dd90f346b3d62a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813908.bb9b19204dcb46ab27dd90f346b3d62a.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp 2023-09-28 12:23:33,936 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695903813908.605c63c32676d6ce3192ea1d15459750.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 12:23:33,936 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 605c63c32676d6ce3192ea1d15459750, disabling compactions & flushes 2023-09-28 12:23:33,936 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695903813908.605c63c32676d6ce3192ea1d15459750. 2023-09-28 12:23:33,936 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695903813908.605c63c32676d6ce3192ea1d15459750. 2023-09-28 12:23:33,936 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695903813908.605c63c32676d6ce3192ea1d15459750. after waiting 0 ms 2023-09-28 12:23:33,936 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695903813908.605c63c32676d6ce3192ea1d15459750. 2023-09-28 12:23:33,936 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695903813908.605c63c32676d6ce3192ea1d15459750. 2023-09-28 12:23:33,936 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 605c63c32676d6ce3192ea1d15459750: 2023-09-28 12:23:33,936 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813908.bb9b19204dcb46ab27dd90f346b3d62a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 12:23:33,936 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing bb9b19204dcb46ab27dd90f346b3d62a, disabling compactions & flushes 2023-09-28 12:23:33,936 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813908.bb9b19204dcb46ab27dd90f346b3d62a. 2023-09-28 12:23:33,936 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813908.bb9b19204dcb46ab27dd90f346b3d62a. 2023-09-28 12:23:33,936 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813908.bb9b19204dcb46ab27dd90f346b3d62a. after waiting 0 ms 2023-09-28 12:23:33,936 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813908.bb9b19204dcb46ab27dd90f346b3d62a. 2023-09-28 12:23:33,936 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813908.bb9b19204dcb46ab27dd90f346b3d62a. 2023-09-28 12:23:33,936 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for bb9b19204dcb46ab27dd90f346b3d62a: 2023-09-28 12:23:33,939 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-28 12:23:33,940 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695903813908.605c63c32676d6ce3192ea1d15459750.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695903813940"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695903813940"}]},"ts":"1695903813940"} 2023-09-28 12:23:33,940 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813908.bb9b19204dcb46ab27dd90f346b3d62a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695903813940"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695903813940"}]},"ts":"1695903813940"} 2023-09-28 12:23:33,942 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-28 12:23:33,947 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-28 12:23:33,947 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695903813947"}]},"ts":"1695903813947"} 2023-09-28 12:23:33,949 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-28 12:23:33,953 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-28 12:23:33,954 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-28 12:23:33,954 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-28 12:23:33,954 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-28 12:23:33,954 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-28 12:23:33,955 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bb9b19204dcb46ab27dd90f346b3d62a, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=605c63c32676d6ce3192ea1d15459750, ASSIGN}] 2023-09-28 12:23:33,960 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bb9b19204dcb46ab27dd90f346b3d62a, ASSIGN 2023-09-28 12:23:33,960 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=605c63c32676d6ce3192ea1d15459750, ASSIGN 2023-09-28 12:23:33,961 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bb9b19204dcb46ab27dd90f346b3d62a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40363,1695903740380; forceNewPlan=false, retain=false 2023-09-28 12:23:33,961 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=605c63c32676d6ce3192ea1d15459750, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39937,1695903740345; forceNewPlan=false, retain=false 2023-09-28 12:23:34,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-28 12:23:34,111 INFO [jenkins-hbase4:45395] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-28 12:23:34,114 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=bb9b19204dcb46ab27dd90f346b3d62a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:34,114 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=605c63c32676d6ce3192ea1d15459750, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:34,114 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813908.bb9b19204dcb46ab27dd90f346b3d62a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695903814114"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695903814114"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695903814114"}]},"ts":"1695903814114"} 2023-09-28 12:23:34,114 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695903813908.605c63c32676d6ce3192ea1d15459750.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695903814114"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695903814114"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695903814114"}]},"ts":"1695903814114"} 2023-09-28 12:23:34,116 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure bb9b19204dcb46ab27dd90f346b3d62a, server=jenkins-hbase4.apache.org,40363,1695903740380}] 2023-09-28 12:23:34,116 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 605c63c32676d6ce3192ea1d15459750, server=jenkins-hbase4.apache.org,39937,1695903740345}] 2023-09-28 12:23:34,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-28 12:23:34,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813908.bb9b19204dcb46ab27dd90f346b3d62a. 2023-09-28 12:23:34,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bb9b19204dcb46ab27dd90f346b3d62a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813908.bb9b19204dcb46ab27dd90f346b3d62a.', STARTKEY => '', ENDKEY => '2'} 2023-09-28 12:23:34,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1695903813908.605c63c32676d6ce3192ea1d15459750. 2023-09-28 12:23:34,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 605c63c32676d6ce3192ea1d15459750, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695903813908.605c63c32676d6ce3192ea1d15459750.', STARTKEY => '2', ENDKEY => ''} 2023-09-28 12:23:34,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813908.bb9b19204dcb46ab27dd90f346b3d62a. service=AccessControlService 2023-09-28 12:23:34,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 12:23:34,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 bb9b19204dcb46ab27dd90f346b3d62a 2023-09-28 12:23:34,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813908.bb9b19204dcb46ab27dd90f346b3d62a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 12:23:34,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bb9b19204dcb46ab27dd90f346b3d62a 2023-09-28 12:23:34,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bb9b19204dcb46ab27dd90f346b3d62a 2023-09-28 12:23:34,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1695903813908.605c63c32676d6ce3192ea1d15459750. service=AccessControlService 2023-09-28 12:23:34,272 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 12:23:34,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 605c63c32676d6ce3192ea1d15459750 2023-09-28 12:23:34,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695903813908.605c63c32676d6ce3192ea1d15459750.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 12:23:34,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 605c63c32676d6ce3192ea1d15459750 2023-09-28 12:23:34,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 605c63c32676d6ce3192ea1d15459750 2023-09-28 12:23:34,273 INFO [StoreOpener-bb9b19204dcb46ab27dd90f346b3d62a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bb9b19204dcb46ab27dd90f346b3d62a 2023-09-28 12:23:34,273 INFO [StoreOpener-605c63c32676d6ce3192ea1d15459750-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 605c63c32676d6ce3192ea1d15459750 2023-09-28 12:23:34,274 DEBUG [StoreOpener-bb9b19204dcb46ab27dd90f346b3d62a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb9b19204dcb46ab27dd90f346b3d62a/cf 2023-09-28 12:23:34,274 DEBUG [StoreOpener-bb9b19204dcb46ab27dd90f346b3d62a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb9b19204dcb46ab27dd90f346b3d62a/cf 2023-09-28 12:23:34,275 DEBUG [StoreOpener-605c63c32676d6ce3192ea1d15459750-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/605c63c32676d6ce3192ea1d15459750/cf 2023-09-28 12:23:34,275 INFO [StoreOpener-bb9b19204dcb46ab27dd90f346b3d62a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb9b19204dcb46ab27dd90f346b3d62a columnFamilyName cf 2023-09-28 12:23:34,275 DEBUG [StoreOpener-605c63c32676d6ce3192ea1d15459750-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/605c63c32676d6ce3192ea1d15459750/cf 2023-09-28 12:23:34,275 INFO [StoreOpener-605c63c32676d6ce3192ea1d15459750-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 605c63c32676d6ce3192ea1d15459750 columnFamilyName cf 2023-09-28 12:23:34,275 INFO [StoreOpener-bb9b19204dcb46ab27dd90f346b3d62a-1] regionserver.HStore(310): Store=bb9b19204dcb46ab27dd90f346b3d62a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 12:23:34,276 INFO [StoreOpener-605c63c32676d6ce3192ea1d15459750-1] regionserver.HStore(310): Store=605c63c32676d6ce3192ea1d15459750/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 12:23:34,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb9b19204dcb46ab27dd90f346b3d62a 2023-09-28 12:23:34,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/605c63c32676d6ce3192ea1d15459750 2023-09-28 12:23:34,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb9b19204dcb46ab27dd90f346b3d62a 2023-09-28 12:23:34,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/605c63c32676d6ce3192ea1d15459750 2023-09-28 12:23:34,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bb9b19204dcb46ab27dd90f346b3d62a 2023-09-28 12:23:34,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 605c63c32676d6ce3192ea1d15459750 2023-09-28 12:23:34,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb9b19204dcb46ab27dd90f346b3d62a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 12:23:34,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/605c63c32676d6ce3192ea1d15459750/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 12:23:34,282 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bb9b19204dcb46ab27dd90f346b3d62a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65511857, jitterRate=-0.023797258734703064}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 12:23:34,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bb9b19204dcb46ab27dd90f346b3d62a: 2023-09-28 12:23:34,282 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 605c63c32676d6ce3192ea1d15459750; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64026746, jitterRate=-0.04592713713645935}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 12:23:34,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 605c63c32676d6ce3192ea1d15459750: 2023-09-28 12:23:34,283 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695903813908.605c63c32676d6ce3192ea1d15459750., pid=70, masterSystemTime=1695903814268 2023-09-28 12:23:34,283 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813908.bb9b19204dcb46ab27dd90f346b3d62a., pid=69, masterSystemTime=1695903814267 2023-09-28 12:23:34,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695903813908.605c63c32676d6ce3192ea1d15459750. 2023-09-28 12:23:34,285 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1695903813908.605c63c32676d6ce3192ea1d15459750. 2023-09-28 12:23:34,285 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=605c63c32676d6ce3192ea1d15459750, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:34,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813908.bb9b19204dcb46ab27dd90f346b3d62a. 2023-09-28 12:23:34,285 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695903813908.605c63c32676d6ce3192ea1d15459750.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695903814285"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695903814285"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695903814285"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695903814285"}]},"ts":"1695903814285"} 2023-09-28 12:23:34,285 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813908.bb9b19204dcb46ab27dd90f346b3d62a. 2023-09-28 12:23:34,286 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=bb9b19204dcb46ab27dd90f346b3d62a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:34,286 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813908.bb9b19204dcb46ab27dd90f346b3d62a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695903814286"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695903814286"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695903814286"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695903814286"}]},"ts":"1695903814286"} 2023-09-28 12:23:34,289 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=68 2023-09-28 12:23:34,289 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 605c63c32676d6ce3192ea1d15459750, server=jenkins-hbase4.apache.org,39937,1695903740345 in 171 msec 2023-09-28 12:23:34,290 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-09-28 12:23:34,290 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure bb9b19204dcb46ab27dd90f346b3d62a, server=jenkins-hbase4.apache.org,40363,1695903740380 in 172 msec 2023-09-28 12:23:34,290 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=605c63c32676d6ce3192ea1d15459750, ASSIGN in 334 msec 2023-09-28 12:23:34,292 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-09-28 12:23:34,292 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bb9b19204dcb46ab27dd90f346b3d62a, ASSIGN in 335 msec 2023-09-28 12:23:34,292 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-28 12:23:34,292 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695903814292"}]},"ts":"1695903814292"} 2023-09-28 12:23:34,293 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-28 12:23:34,295 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-28 12:23:34,296 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-28 12:23:34,298 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40363] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-28 12:23:34,299 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:23:34,299 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:23:34,299 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:23:34,299 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:23:34,301 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 12:23:34,301 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 12:23:34,301 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-28 12:23:34,301 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-28 12:23:34,301 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 12:23:34,301 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 12:23:34,301 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-28 12:23:34,301 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-28 12:23:34,302 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 392 msec 2023-09-28 12:23:34,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-28 12:23:34,516 INFO [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-28 12:23:34,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions bb9b19204dcb46ab27dd90f346b3d62a, 605c63c32676d6ce3192ea1d15459750 2023-09-28 12:23:34,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[bb9b19204dcb46ab27dd90f346b3d62a, 605c63c32676d6ce3192ea1d15459750], force=true 2023-09-28 12:23:34,547 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[bb9b19204dcb46ab27dd90f346b3d62a, 605c63c32676d6ce3192ea1d15459750], force=true 2023-09-28 12:23:34,547 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[bb9b19204dcb46ab27dd90f346b3d62a, 605c63c32676d6ce3192ea1d15459750], force=true 2023-09-28 12:23:34,547 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[bb9b19204dcb46ab27dd90f346b3d62a, 605c63c32676d6ce3192ea1d15459750], force=true 2023-09-28 12:23:34,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-28 12:23:34,569 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bb9b19204dcb46ab27dd90f346b3d62a, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=605c63c32676d6ce3192ea1d15459750, UNASSIGN}] 2023-09-28 12:23:34,571 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bb9b19204dcb46ab27dd90f346b3d62a, UNASSIGN 2023-09-28 12:23:34,571 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=605c63c32676d6ce3192ea1d15459750, UNASSIGN 2023-09-28 12:23:34,572 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=bb9b19204dcb46ab27dd90f346b3d62a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:34,572 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=605c63c32676d6ce3192ea1d15459750, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:34,572 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813908.bb9b19204dcb46ab27dd90f346b3d62a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695903814572"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695903814572"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695903814572"}]},"ts":"1695903814572"} 2023-09-28 12:23:34,572 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695903813908.605c63c32676d6ce3192ea1d15459750.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695903814572"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695903814572"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695903814572"}]},"ts":"1695903814572"} 2023-09-28 12:23:34,574 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure bb9b19204dcb46ab27dd90f346b3d62a, server=jenkins-hbase4.apache.org,40363,1695903740380}] 2023-09-28 12:23:34,574 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 605c63c32676d6ce3192ea1d15459750, server=jenkins-hbase4.apache.org,39937,1695903740345}] 2023-09-28 12:23:34,579 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-28 12:23:34,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-28 12:23:34,726 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close bb9b19204dcb46ab27dd90f346b3d62a 2023-09-28 12:23:34,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bb9b19204dcb46ab27dd90f346b3d62a, disabling compactions & flushes 2023-09-28 12:23:34,727 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813908.bb9b19204dcb46ab27dd90f346b3d62a. 2023-09-28 12:23:34,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813908.bb9b19204dcb46ab27dd90f346b3d62a. 2023-09-28 12:23:34,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813908.bb9b19204dcb46ab27dd90f346b3d62a. after waiting 0 ms 2023-09-28 12:23:34,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813908.bb9b19204dcb46ab27dd90f346b3d62a. 2023-09-28 12:23:34,728 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing bb9b19204dcb46ab27dd90f346b3d62a 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-28 12:23:34,728 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 605c63c32676d6ce3192ea1d15459750 2023-09-28 12:23:34,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 605c63c32676d6ce3192ea1d15459750, disabling compactions & flushes 2023-09-28 12:23:34,729 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695903813908.605c63c32676d6ce3192ea1d15459750. 2023-09-28 12:23:34,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695903813908.605c63c32676d6ce3192ea1d15459750. 2023-09-28 12:23:34,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695903813908.605c63c32676d6ce3192ea1d15459750. after waiting 0 ms 2023-09-28 12:23:34,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695903813908.605c63c32676d6ce3192ea1d15459750. 2023-09-28 12:23:34,729 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 605c63c32676d6ce3192ea1d15459750 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-28 12:23:34,739 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/605c63c32676d6ce3192ea1d15459750/.tmp/cf/e5b3e1632b6d437ab3c0ee13cd272033 2023-09-28 12:23:34,739 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb9b19204dcb46ab27dd90f346b3d62a/.tmp/cf/f81294457efa487c81058e9781e37d99 2023-09-28 12:23:34,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb9b19204dcb46ab27dd90f346b3d62a/.tmp/cf/f81294457efa487c81058e9781e37d99 as hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb9b19204dcb46ab27dd90f346b3d62a/cf/f81294457efa487c81058e9781e37d99 2023-09-28 12:23:34,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/605c63c32676d6ce3192ea1d15459750/.tmp/cf/e5b3e1632b6d437ab3c0ee13cd272033 as hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/605c63c32676d6ce3192ea1d15459750/cf/e5b3e1632b6d437ab3c0ee13cd272033 2023-09-28 12:23:34,750 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb9b19204dcb46ab27dd90f346b3d62a/cf/f81294457efa487c81058e9781e37d99, entries=1, sequenceid=5, filesize=4.7 K 2023-09-28 12:23:34,750 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/605c63c32676d6ce3192ea1d15459750/cf/e5b3e1632b6d437ab3c0ee13cd272033, entries=1, sequenceid=5, filesize=4.7 K 2023-09-28 12:23:34,751 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for bb9b19204dcb46ab27dd90f346b3d62a in 23ms, sequenceid=5, compaction requested=false 2023-09-28 12:23:34,751 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 605c63c32676d6ce3192ea1d15459750 in 22ms, sequenceid=5, compaction requested=false 2023-09-28 12:23:34,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/605c63c32676d6ce3192ea1d15459750/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-28 12:23:34,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb9b19204dcb46ab27dd90f346b3d62a/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-28 12:23:34,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 12:23:34,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 12:23:34,764 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695903813908.605c63c32676d6ce3192ea1d15459750. 2023-09-28 12:23:34,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 605c63c32676d6ce3192ea1d15459750: 2023-09-28 12:23:34,764 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813908.bb9b19204dcb46ab27dd90f346b3d62a. 2023-09-28 12:23:34,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bb9b19204dcb46ab27dd90f346b3d62a: 2023-09-28 12:23:34,765 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 605c63c32676d6ce3192ea1d15459750 2023-09-28 12:23:34,766 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=605c63c32676d6ce3192ea1d15459750, regionState=CLOSED 2023-09-28 12:23:34,766 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695903813908.605c63c32676d6ce3192ea1d15459750.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695903814766"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695903814766"}]},"ts":"1695903814766"} 2023-09-28 12:23:34,766 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed bb9b19204dcb46ab27dd90f346b3d62a 2023-09-28 12:23:34,766 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=bb9b19204dcb46ab27dd90f346b3d62a, regionState=CLOSED 2023-09-28 12:23:34,766 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813908.bb9b19204dcb46ab27dd90f346b3d62a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695903814766"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695903814766"}]},"ts":"1695903814766"} 2023-09-28 12:23:34,769 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-09-28 12:23:34,769 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 605c63c32676d6ce3192ea1d15459750, server=jenkins-hbase4.apache.org,39937,1695903740345 in 193 msec 2023-09-28 12:23:34,769 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-09-28 12:23:34,769 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure bb9b19204dcb46ab27dd90f346b3d62a, server=jenkins-hbase4.apache.org,40363,1695903740380 in 194 msec 2023-09-28 12:23:34,773 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=605c63c32676d6ce3192ea1d15459750, UNASSIGN in 200 msec 2023-09-28 12:23:34,774 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-09-28 12:23:34,774 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bb9b19204dcb46ab27dd90f346b3d62a, UNASSIGN in 203 msec 2023-09-28 12:23:34,820 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d4ff7d5b0c4e32ec5dc218be05d0d03d/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-28 12:23:34,822 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813908.bb9b19204dcb46ab27dd90f346b3d62a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-28 12:23:34,822 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695903813908.605c63c32676d6ce3192ea1d15459750.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-28 12:23:34,822 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813909.d4ff7d5b0c4e32ec5dc218be05d0d03d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-28 12:23:34,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-28 12:23:34,873 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d4ff7d5b0c4e32ec5dc218be05d0d03d, ASSIGN}] 2023-09-28 12:23:34,874 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d4ff7d5b0c4e32ec5dc218be05d0d03d, ASSIGN 2023-09-28 12:23:34,875 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d4ff7d5b0c4e32ec5dc218be05d0d03d, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,40363,1695903740380; forceNewPlan=false, retain=false 2023-09-28 12:23:35,026 INFO [jenkins-hbase4:45395] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-28 12:23:35,027 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=d4ff7d5b0c4e32ec5dc218be05d0d03d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:35,028 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813909.d4ff7d5b0c4e32ec5dc218be05d0d03d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695903815027"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695903815027"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695903815027"}]},"ts":"1695903815027"} 2023-09-28 12:23:35,029 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure d4ff7d5b0c4e32ec5dc218be05d0d03d, server=jenkins-hbase4.apache.org,40363,1695903740380}] 2023-09-28 12:23:35,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-28 12:23:35,184 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813909.d4ff7d5b0c4e32ec5dc218be05d0d03d. 2023-09-28 12:23:35,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d4ff7d5b0c4e32ec5dc218be05d0d03d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813909.d4ff7d5b0c4e32ec5dc218be05d0d03d.', STARTKEY => '', ENDKEY => ''} 2023-09-28 12:23:35,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813909.d4ff7d5b0c4e32ec5dc218be05d0d03d. service=AccessControlService 2023-09-28 12:23:35,185 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 12:23:35,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 d4ff7d5b0c4e32ec5dc218be05d0d03d 2023-09-28 12:23:35,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813909.d4ff7d5b0c4e32ec5dc218be05d0d03d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 12:23:35,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d4ff7d5b0c4e32ec5dc218be05d0d03d 2023-09-28 12:23:35,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d4ff7d5b0c4e32ec5dc218be05d0d03d 2023-09-28 12:23:35,186 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d4ff7d5b0c4e32ec5dc218be05d0d03d/.regioninfo 2023-09-28 12:23:35,197 INFO [StoreOpener-d4ff7d5b0c4e32ec5dc218be05d0d03d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d4ff7d5b0c4e32ec5dc218be05d0d03d 2023-09-28 12:23:35,198 DEBUG [StoreOpener-d4ff7d5b0c4e32ec5dc218be05d0d03d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d4ff7d5b0c4e32ec5dc218be05d0d03d/cf 2023-09-28 12:23:35,198 DEBUG [StoreOpener-d4ff7d5b0c4e32ec5dc218be05d0d03d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d4ff7d5b0c4e32ec5dc218be05d0d03d/cf 2023-09-28 12:23:35,198 INFO [StoreOpener-d4ff7d5b0c4e32ec5dc218be05d0d03d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d4ff7d5b0c4e32ec5dc218be05d0d03d columnFamilyName cf 2023-09-28 12:23:35,226 DEBUG [StoreOpener-d4ff7d5b0c4e32ec5dc218be05d0d03d-1] regionserver.HStore(539): loaded hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d4ff7d5b0c4e32ec5dc218be05d0d03d/cf/e5b3e1632b6d437ab3c0ee13cd272033.605c63c32676d6ce3192ea1d15459750->hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/605c63c32676d6ce3192ea1d15459750/cf/e5b3e1632b6d437ab3c0ee13cd272033-top 2023-09-28 12:23:35,232 DEBUG [StoreOpener-d4ff7d5b0c4e32ec5dc218be05d0d03d-1] regionserver.HStore(539): loaded hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d4ff7d5b0c4e32ec5dc218be05d0d03d/cf/f81294457efa487c81058e9781e37d99.bb9b19204dcb46ab27dd90f346b3d62a->hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb9b19204dcb46ab27dd90f346b3d62a/cf/f81294457efa487c81058e9781e37d99-top 2023-09-28 12:23:35,233 INFO [StoreOpener-d4ff7d5b0c4e32ec5dc218be05d0d03d-1] regionserver.HStore(310): Store=d4ff7d5b0c4e32ec5dc218be05d0d03d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 12:23:35,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d4ff7d5b0c4e32ec5dc218be05d0d03d 2023-09-28 12:23:35,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d4ff7d5b0c4e32ec5dc218be05d0d03d 2023-09-28 12:23:35,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d4ff7d5b0c4e32ec5dc218be05d0d03d 2023-09-28 12:23:35,238 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d4ff7d5b0c4e32ec5dc218be05d0d03d; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74088188, jitterRate=0.1040000319480896}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 12:23:35,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d4ff7d5b0c4e32ec5dc218be05d0d03d: 2023-09-28 12:23:35,239 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813909.d4ff7d5b0c4e32ec5dc218be05d0d03d., pid=77, masterSystemTime=1695903815181 2023-09-28 12:23:35,240 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813909.d4ff7d5b0c4e32ec5dc218be05d0d03d.,because compaction is disabled. 2023-09-28 12:23:35,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813909.d4ff7d5b0c4e32ec5dc218be05d0d03d. 2023-09-28 12:23:35,241 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813909.d4ff7d5b0c4e32ec5dc218be05d0d03d. 2023-09-28 12:23:35,241 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=d4ff7d5b0c4e32ec5dc218be05d0d03d, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:35,241 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813909.d4ff7d5b0c4e32ec5dc218be05d0d03d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695903815241"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695903815241"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695903815241"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695903815241"}]},"ts":"1695903815241"} 2023-09-28 12:23:35,244 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-28 12:23:35,244 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure d4ff7d5b0c4e32ec5dc218be05d0d03d, server=jenkins-hbase4.apache.org,40363,1695903740380 in 214 msec 2023-09-28 12:23:35,246 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-28 12:23:35,246 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d4ff7d5b0c4e32ec5dc218be05d0d03d, ASSIGN in 371 msec 2023-09-28 12:23:35,247 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[bb9b19204dcb46ab27dd90f346b3d62a, 605c63c32676d6ce3192ea1d15459750], force=true in 706 msec 2023-09-28 12:23:35,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-28 12:23:35,655 INFO [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-28 12:23:35,655 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-28 12:23:35,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695903815655 (current time:1695903815655). 2023-09-28 12:23:35,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 12:23:35,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(139): Connect 0x2c7abe60 to 127.0.0.1:65025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 12:23:35,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42dd91c5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 12:23:35,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 12:23:35,669 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55520, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 12:23:35,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c7abe60 to 127.0.0.1:65025 2023-09-28 12:23:35,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 12:23:35,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(139): Connect 0x6926c0b1 to 127.0.0.1:65025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 12:23:35,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10d6ea4b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 12:23:35,678 DEBUG [hconnection-0x3eab122d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 12:23:35,681 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55532, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 12:23:35,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6926c0b1 to 127.0.0.1:65025 2023-09-28 12:23:35,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 12:23:35,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-28 12:23:35,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 12:23:35,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-28 12:23:35,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-28 12:23:35,689 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-28 12:23:35,690 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1695904415690 2023-09-28 12:23:35,690 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-28 12:23:35,693 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 12:23:35,694 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 12:23:35,694 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-28 12:23:35,694 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-28 12:23:35,695 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 6 msec 2023-09-28 12:23:35,696 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-28 12:23:35,697 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1695904415697 2023-09-28 12:23:35,707 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,707 INFO [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-28 12:23:35,707 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:23:35,709 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-28 12:23:35,709 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-28 12:23:35,709 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,709 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,711 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:23:35,711 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:35,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:23:35,711 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:23:35,711 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:23:35,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:23:35,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:23:35,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:23:35,712 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:35,712 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 12:23:35,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:23:35,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:23:35,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,712 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,712 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,713 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-28 12:23:35,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-28 12:23:35,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-28 12:23:35,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,713 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-28 12:23:35,713 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-28 12:23:35,713 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-28 12:23:35,713 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,713 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,713 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-28 12:23:35,713 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-28 12:23:35,714 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:23:35,713 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,715 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-28 12:23:35,715 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-28 12:23:35,715 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:23:35,715 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-28 12:23:35,716 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-28 12:23:35,716 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35175,1695903740297' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-28 12:23:35,713 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:23:35,716 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-28 12:23:35,717 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40363,1695903740380' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-28 12:23:35,717 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-28 12:23:35,717 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-28 12:23:35,717 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39937,1695903740345' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-28 12:23:35,718 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,719 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:35,719 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,719 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:35,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:23:35,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:23:35,719 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,719 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 12:23:35,719 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,719 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 12:23:35,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:23:35,721 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,721 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 12:23:35,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:23:35,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:35,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:35,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:35,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:23:35,723 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40363,1695903740380' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-28 12:23:35,723 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f9f5db1[Count = 0] remaining members to acquire global barrier 2023-09-28 12:23:35,723 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-28 12:23:35,723 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,724 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,724 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,724 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,724 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-28 12:23:35,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,724 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-28 12:23:35,724 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-28 12:23:35,724 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 12:23:35,724 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 12:23:35,724 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:35,724 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 12:23:35,724 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813909.d4ff7d5b0c4e32ec5dc218be05d0d03d. 2023-09-28 12:23:35,724 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-28 12:23:35,725 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813909.d4ff7d5b0c4e32ec5dc218be05d0d03d. started... 2023-09-28 12:23:35,724 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-28 12:23:35,725 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,35175,1695903740297' in zk 2023-09-28 12:23:35,725 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39937,1695903740345' in zk 2023-09-28 12:23:35,726 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d4ff7d5b0c4e32ec5dc218be05d0d03d: 2023-09-28 12:23:35,726 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813909.d4ff7d5b0c4e32ec5dc218be05d0d03d.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,726 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 12:23:35,726 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d4ff7d5b0c4e32ec5dc218be05d0d03d/cf/e5b3e1632b6d437ab3c0ee13cd272033.605c63c32676d6ce3192ea1d15459750->hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/605c63c32676d6ce3192ea1d15459750/cf/e5b3e1632b6d437ab3c0ee13cd272033-top, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d4ff7d5b0c4e32ec5dc218be05d0d03d/cf/f81294457efa487c81058e9781e37d99.bb9b19204dcb46ab27dd90f346b3d62a->hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb9b19204dcb46ab27dd90f346b3d62a/cf/f81294457efa487c81058e9781e37d99-top] hfiles 2023-09-28 12:23:35,726 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d4ff7d5b0c4e32ec5dc218be05d0d03d/cf/e5b3e1632b6d437ab3c0ee13cd272033.605c63c32676d6ce3192ea1d15459750 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,727 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d4ff7d5b0c4e32ec5dc218be05d0d03d/cf/f81294457efa487c81058e9781e37d99.bb9b19204dcb46ab27dd90f346b3d62a for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,728 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-28 12:23:35,728 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:23:35,728 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-28 12:23:35,729 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-28 12:23:35,729 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:23:35,729 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-28 12:23:35,738 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813909.d4ff7d5b0c4e32ec5dc218be05d0d03d. completed. 2023-09-28 12:23:35,738 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813909.d4ff7d5b0c4e32ec5dc218be05d0d03d. 2023-09-28 12:23:35,738 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 12:23:35,738 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 12:23:35,738 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:35,738 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-28 12:23:35,738 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,40363,1695903740380' in zk 2023-09-28 12:23:35,742 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-28 12:23:35,742 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:35,742 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:23:35,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:35,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:23:35,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:23:35,743 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-28 12:23:35,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:23:35,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:23:35,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:35,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:35,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:35,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:23:35,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:35,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:35,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:35,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,40363,1695903740380': 2023-09-28 12:23:35,746 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40363,1695903740380' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-28 12:23:35,746 INFO [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-28 12:23:35,746 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 12:23:35,746 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 12:23:35,746 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,746 INFO [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 12:23:35,747 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,747 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,747 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:23:35,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:23:35,747 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:23:35,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,747 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:23:35,747 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:23:35,748 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:23:35,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,748 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:35,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:23:35,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:23:35,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:23:35,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:23:35,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:23:35,748 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:35,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:23:35,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:23:35,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,749 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:35,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:35,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:35,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:35,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:23:35,750 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:35,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,751 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:35,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:35,751 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:35,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:35,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:35,753 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:35,753 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,753 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:23:35,754 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:23:35,754 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:23:35,754 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:23:35,754 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:23:35,753 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:35,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:23:35,754 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:35,754 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:23:35,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:23:35,754 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:23:35,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:23:35,754 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,754 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:23:35,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:23:35,754 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,754 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:35,754 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,755 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:35,755 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:35,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:23:35,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:23:35,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:23:35,755 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,755 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,755 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:23:35,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:23:35,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:23:35,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:23:35,771 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,773 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-28 12:23:35,773 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,774 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,774 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1695903815690Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695903815754 (+64 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695903815754Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695903815757 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695903815764 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1695903815773 (+9 ms) 2023-09-28 12:23:35,776 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-28 12:23:35,778 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 83 msec 2023-09-28 12:23:35,794 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 12:23:35,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-28 12:23:35,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 12:23:35,796 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903815796 2023-09-28 12:23:35,796 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35969, tgtDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903815796, rawTgtDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903815796, srcFsUri=hdfs://localhost:35969, srcDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326 2023-09-28 12:23:35,823 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35969, inputRoot=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326 2023-09-28 12:23:35,823 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2140961677_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903815796, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903815796/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,823 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35969, inputRoot=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326, snapshotDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-28 12:23:35,832 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903815796/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:35,857 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:35,858 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:35,858 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:35,859 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:36,515 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695903747070_0004_000001 (auth:SIMPLE) 2023-09-28 12:23:36,744 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/hadoop-41560799540536187.jar 2023-09-28 12:23:36,745 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:36,745 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:36,813 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/hadoop-7216092999288608196.jar 2023-09-28 12:23:36,813 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:36,814 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:36,814 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:36,815 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:36,815 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:36,815 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:36,816 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-28 12:23:36,816 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-28 12:23:36,816 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-28 12:23:36,817 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-28 12:23:36,817 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-28 12:23:36,818 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-28 12:23:36,818 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-28 12:23:36,818 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-28 12:23:36,819 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-28 12:23:36,819 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-28 12:23:36,820 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 12:23:36,820 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 12:23:36,821 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 12:23:36,821 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 12:23:36,821 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 12:23:36,822 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 12:23:36,822 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 12:23:37,175 WARN [Listener at jenkins-hbase4.apache.org/33885] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-28 12:23:37,177 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-28 12:23:37,179 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-28 12:23:37,228 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 12:23:37,228 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 12:23:37,518 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695903747070_0005_000001 (auth:SIMPLE) 2023-09-28 12:23:37,838 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-28 12:23:41,363 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695903747070_0005_000001 (auth:SIMPLE) 2023-09-28 12:23:43,580 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695903747070_0005_000001 (auth:SIMPLE) 2023-09-28 12:23:45,913 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695903747070_0005_000001 (auth:SIMPLE) 2023-09-28 12:23:47,326 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-28 12:23:47,329 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-28 12:23:47,337 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:47,337 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-28 12:23:47,337 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-28 12:23:47,338 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1679557244_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:47,338 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(367): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-28 12:23:47,338 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(367): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-28 12:23:47,338 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1679557244_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903815796/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903815796/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:47,339 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(367): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903815796/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-28 12:23:47,339 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(367): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903815796/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-28 12:23:47,345 INFO [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:47,346 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:47,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:47,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-28 12:23:47,350 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695903827350"}]},"ts":"1695903827350"} 2023-09-28 12:23:47,351 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-28 12:23:47,353 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-28 12:23:47,353 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d4ff7d5b0c4e32ec5dc218be05d0d03d, UNASSIGN}] 2023-09-28 12:23:47,355 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d4ff7d5b0c4e32ec5dc218be05d0d03d, UNASSIGN 2023-09-28 12:23:47,356 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=d4ff7d5b0c4e32ec5dc218be05d0d03d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:47,356 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813909.d4ff7d5b0c4e32ec5dc218be05d0d03d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695903827356"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695903827356"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695903827356"}]},"ts":"1695903827356"} 2023-09-28 12:23:47,357 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure d4ff7d5b0c4e32ec5dc218be05d0d03d, server=jenkins-hbase4.apache.org,40363,1695903740380}] 2023-09-28 12:23:47,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-28 12:23:47,509 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d4ff7d5b0c4e32ec5dc218be05d0d03d 2023-09-28 12:23:47,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d4ff7d5b0c4e32ec5dc218be05d0d03d, disabling compactions & flushes 2023-09-28 12:23:47,509 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813909.d4ff7d5b0c4e32ec5dc218be05d0d03d. 2023-09-28 12:23:47,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813909.d4ff7d5b0c4e32ec5dc218be05d0d03d. 2023-09-28 12:23:47,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813909.d4ff7d5b0c4e32ec5dc218be05d0d03d. after waiting 0 ms 2023-09-28 12:23:47,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813909.d4ff7d5b0c4e32ec5dc218be05d0d03d. 2023-09-28 12:23:47,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d4ff7d5b0c4e32ec5dc218be05d0d03d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-28 12:23:47,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 12:23:47,524 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813909.d4ff7d5b0c4e32ec5dc218be05d0d03d. 2023-09-28 12:23:47,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d4ff7d5b0c4e32ec5dc218be05d0d03d: 2023-09-28 12:23:47,525 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d4ff7d5b0c4e32ec5dc218be05d0d03d 2023-09-28 12:23:47,526 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=d4ff7d5b0c4e32ec5dc218be05d0d03d, regionState=CLOSED 2023-09-28 12:23:47,526 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813909.d4ff7d5b0c4e32ec5dc218be05d0d03d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695903827526"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695903827526"}]},"ts":"1695903827526"} 2023-09-28 12:23:47,528 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-28 12:23:47,528 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure d4ff7d5b0c4e32ec5dc218be05d0d03d, server=jenkins-hbase4.apache.org,40363,1695903740380 in 170 msec 2023-09-28 12:23:47,530 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-28 12:23:47,530 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d4ff7d5b0c4e32ec5dc218be05d0d03d, UNASSIGN in 175 msec 2023-09-28 12:23:47,530 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695903827530"}]},"ts":"1695903827530"} 2023-09-28 12:23:47,531 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-28 12:23:47,534 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-28 12:23:47,535 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 188 msec 2023-09-28 12:23:47,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-28 12:23:47,652 INFO [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-28 12:23:47,653 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:47,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:47,656 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:47,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:47,656 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:47,658 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40363] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:47,660 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:47,660 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:47,660 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:47,660 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:47,661 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-28 12:23:47,661 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-28 12:23:47,661 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/605c63c32676d6ce3192ea1d15459750 2023-09-28 12:23:47,661 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb9b19204dcb46ab27dd90f346b3d62a 2023-09-28 12:23:47,661 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-28 12:23:47,661 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-28 12:23:47,661 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d4ff7d5b0c4e32ec5dc218be05d0d03d 2023-09-28 12:23:47,661 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:47,661 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:47,661 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:23:47,661 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:47,662 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:47,662 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:23:47,662 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:23:47,662 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:23:47,662 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 12:23:47,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-28 12:23:47,663 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 12:23:47,663 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 12:23:47,663 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d4ff7d5b0c4e32ec5dc218be05d0d03d/cf, FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d4ff7d5b0c4e32ec5dc218be05d0d03d/recovered.edits] 2023-09-28 12:23:47,663 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb9b19204dcb46ab27dd90f346b3d62a/cf, FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb9b19204dcb46ab27dd90f346b3d62a/recovered.edits] 2023-09-28 12:23:47,664 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/605c63c32676d6ce3192ea1d15459750/cf, FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/605c63c32676d6ce3192ea1d15459750/recovered.edits] 2023-09-28 12:23:47,665 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 12:23:47,668 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb9b19204dcb46ab27dd90f346b3d62a/cf/f81294457efa487c81058e9781e37d99 to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb9b19204dcb46ab27dd90f346b3d62a/cf/f81294457efa487c81058e9781e37d99 2023-09-28 12:23:47,668 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/605c63c32676d6ce3192ea1d15459750/cf/e5b3e1632b6d437ab3c0ee13cd272033 to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/605c63c32676d6ce3192ea1d15459750/cf/e5b3e1632b6d437ab3c0ee13cd272033 2023-09-28 12:23:47,668 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d4ff7d5b0c4e32ec5dc218be05d0d03d/cf/e5b3e1632b6d437ab3c0ee13cd272033.605c63c32676d6ce3192ea1d15459750 to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d4ff7d5b0c4e32ec5dc218be05d0d03d/cf/e5b3e1632b6d437ab3c0ee13cd272033.605c63c32676d6ce3192ea1d15459750 2023-09-28 12:23:47,670 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d4ff7d5b0c4e32ec5dc218be05d0d03d/cf/f81294457efa487c81058e9781e37d99.bb9b19204dcb46ab27dd90f346b3d62a to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d4ff7d5b0c4e32ec5dc218be05d0d03d/cf/f81294457efa487c81058e9781e37d99.bb9b19204dcb46ab27dd90f346b3d62a 2023-09-28 12:23:47,671 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb9b19204dcb46ab27dd90f346b3d62a/recovered.edits/8.seqid to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb9b19204dcb46ab27dd90f346b3d62a/recovered.edits/8.seqid 2023-09-28 12:23:47,672 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb9b19204dcb46ab27dd90f346b3d62a 2023-09-28 12:23:47,672 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/605c63c32676d6ce3192ea1d15459750/recovered.edits/8.seqid to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/605c63c32676d6ce3192ea1d15459750/recovered.edits/8.seqid 2023-09-28 12:23:47,673 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/605c63c32676d6ce3192ea1d15459750 2023-09-28 12:23:47,673 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d4ff7d5b0c4e32ec5dc218be05d0d03d/recovered.edits/12.seqid to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d4ff7d5b0c4e32ec5dc218be05d0d03d/recovered.edits/12.seqid 2023-09-28 12:23:47,674 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d4ff7d5b0c4e32ec5dc218be05d0d03d 2023-09-28 12:23:47,674 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-28 12:23:47,676 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:47,678 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-28 12:23:47,680 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-28 12:23:47,681 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:47,681 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-28 12:23:47,681 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813909.d4ff7d5b0c4e32ec5dc218be05d0d03d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695903827681"}]},"ts":"9223372036854775807"} 2023-09-28 12:23:47,682 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-28 12:23:47,682 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d4ff7d5b0c4e32ec5dc218be05d0d03d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695903813909.d4ff7d5b0c4e32ec5dc218be05d0d03d.', STARTKEY => '', ENDKEY => ''}] 2023-09-28 12:23:47,682 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-28 12:23:47,682 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695903827682"}]},"ts":"9223372036854775807"} 2023-09-28 12:23:47,684 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-28 12:23:47,686 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:47,687 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 33 msec 2023-09-28 12:23:47,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-28 12:23:47,764 INFO [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-28 12:23:47,764 INFO [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:47,765 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:47,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:47,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-28 12:23:47,769 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695903827769"}]},"ts":"1695903827769"} 2023-09-28 12:23:47,770 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-28 12:23:47,772 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-28 12:23:47,772 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3a84094c45873efbede08142718bc962, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=91919fe6a2f8eb8db434879c66e3ad10, UNASSIGN}] 2023-09-28 12:23:47,774 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3a84094c45873efbede08142718bc962, UNASSIGN 2023-09-28 12:23:47,774 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=91919fe6a2f8eb8db434879c66e3ad10, UNASSIGN 2023-09-28 12:23:47,775 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=3a84094c45873efbede08142718bc962, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:47,775 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=91919fe6a2f8eb8db434879c66e3ad10, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:47,775 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695903812551.3a84094c45873efbede08142718bc962.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695903827775"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695903827775"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695903827775"}]},"ts":"1695903827775"} 2023-09-28 12:23:47,775 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695903812551.91919fe6a2f8eb8db434879c66e3ad10.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695903827775"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695903827775"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695903827775"}]},"ts":"1695903827775"} 2023-09-28 12:23:47,776 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 3a84094c45873efbede08142718bc962, server=jenkins-hbase4.apache.org,40363,1695903740380}] 2023-09-28 12:23:47,777 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 91919fe6a2f8eb8db434879c66e3ad10, server=jenkins-hbase4.apache.org,39937,1695903740345}] 2023-09-28 12:23:47,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-28 12:23:47,928 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3a84094c45873efbede08142718bc962 2023-09-28 12:23:47,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3a84094c45873efbede08142718bc962, disabling compactions & flushes 2023-09-28 12:23:47,928 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695903812551.3a84094c45873efbede08142718bc962. 2023-09-28 12:23:47,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695903812551.3a84094c45873efbede08142718bc962. 2023-09-28 12:23:47,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695903812551.3a84094c45873efbede08142718bc962. after waiting 0 ms 2023-09-28 12:23:47,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695903812551.3a84094c45873efbede08142718bc962. 2023-09-28 12:23:47,932 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 91919fe6a2f8eb8db434879c66e3ad10 2023-09-28 12:23:47,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 91919fe6a2f8eb8db434879c66e3ad10, disabling compactions & flushes 2023-09-28 12:23:47,932 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695903812551.91919fe6a2f8eb8db434879c66e3ad10. 2023-09-28 12:23:47,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695903812551.91919fe6a2f8eb8db434879c66e3ad10. 2023-09-28 12:23:47,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695903812551.91919fe6a2f8eb8db434879c66e3ad10. after waiting 0 ms 2023-09-28 12:23:47,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695903812551.91919fe6a2f8eb8db434879c66e3ad10. 2023-09-28 12:23:47,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a84094c45873efbede08142718bc962/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 12:23:47,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 12:23:47,943 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695903812551.3a84094c45873efbede08142718bc962. 2023-09-28 12:23:47,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithMergeRegion/91919fe6a2f8eb8db434879c66e3ad10/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 12:23:47,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3a84094c45873efbede08142718bc962: 2023-09-28 12:23:47,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 12:23:47,944 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695903812551.91919fe6a2f8eb8db434879c66e3ad10. 2023-09-28 12:23:47,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 91919fe6a2f8eb8db434879c66e3ad10: 2023-09-28 12:23:47,945 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3a84094c45873efbede08142718bc962 2023-09-28 12:23:47,945 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=3a84094c45873efbede08142718bc962, regionState=CLOSED 2023-09-28 12:23:47,946 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695903812551.3a84094c45873efbede08142718bc962.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695903827945"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695903827945"}]},"ts":"1695903827945"} 2023-09-28 12:23:47,946 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 91919fe6a2f8eb8db434879c66e3ad10 2023-09-28 12:23:47,946 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=91919fe6a2f8eb8db434879c66e3ad10, regionState=CLOSED 2023-09-28 12:23:47,946 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695903812551.91919fe6a2f8eb8db434879c66e3ad10.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695903827946"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695903827946"}]},"ts":"1695903827946"} 2023-09-28 12:23:47,949 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-09-28 12:23:47,949 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-09-28 12:23:47,949 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 3a84094c45873efbede08142718bc962, server=jenkins-hbase4.apache.org,40363,1695903740380 in 171 msec 2023-09-28 12:23:47,949 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 91919fe6a2f8eb8db434879c66e3ad10, server=jenkins-hbase4.apache.org,39937,1695903740345 in 171 msec 2023-09-28 12:23:47,950 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=91919fe6a2f8eb8db434879c66e3ad10, UNASSIGN in 177 msec 2023-09-28 12:23:47,951 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=84 2023-09-28 12:23:47,951 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3a84094c45873efbede08142718bc962, UNASSIGN in 177 msec 2023-09-28 12:23:47,951 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695903827951"}]},"ts":"1695903827951"} 2023-09-28 12:23:47,952 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-28 12:23:47,954 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-28 12:23:47,955 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 189 msec 2023-09-28 12:23:48,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-28 12:23:48,071 INFO [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-28 12:23:48,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:48,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:48,075 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:48,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:48,075 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:48,077 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40363] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:48,080 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a84094c45873efbede08142718bc962 2023-09-28 12:23:48,080 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/91919fe6a2f8eb8db434879c66e3ad10 2023-09-28 12:23:48,080 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:48,080 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:48,080 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:48,080 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-28 12:23:48,080 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-28 12:23:48,081 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:48,081 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-28 12:23:48,081 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:48,082 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:23:48,082 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:48,082 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:23:48,082 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:48,082 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:23:48,082 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-09-28 12:23:48,082 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:23:48,082 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-28 12:23:48,082 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a84094c45873efbede08142718bc962/cf, FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a84094c45873efbede08142718bc962/recovered.edits] 2023-09-28 12:23:48,082 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/91919fe6a2f8eb8db434879c66e3ad10/cf, FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/91919fe6a2f8eb8db434879c66e3ad10/recovered.edits] 2023-09-28 12:23:48,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-28 12:23:48,086 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/91919fe6a2f8eb8db434879c66e3ad10/cf/63bd81fb6d50495cb254e4ccee40c2b0 to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/91919fe6a2f8eb8db434879c66e3ad10/cf/63bd81fb6d50495cb254e4ccee40c2b0 2023-09-28 12:23:48,086 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a84094c45873efbede08142718bc962/cf/db3fccad22e64253a9f4f806bf384ef3 to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a84094c45873efbede08142718bc962/cf/db3fccad22e64253a9f4f806bf384ef3 2023-09-28 12:23:48,089 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/91919fe6a2f8eb8db434879c66e3ad10/recovered.edits/9.seqid to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/91919fe6a2f8eb8db434879c66e3ad10/recovered.edits/9.seqid 2023-09-28 12:23:48,089 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a84094c45873efbede08142718bc962/recovered.edits/9.seqid to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a84094c45873efbede08142718bc962/recovered.edits/9.seqid 2023-09-28 12:23:48,090 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/91919fe6a2f8eb8db434879c66e3ad10 2023-09-28 12:23:48,090 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a84094c45873efbede08142718bc962 2023-09-28 12:23:48,090 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-28 12:23:48,090 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-28 12:23:48,091 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-28 12:23:48,094 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230928a0e1907a75aa4b338bd231d7926b5a8a to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230928a0e1907a75aa4b338bd231d7926b5a8a 2023-09-28 12:23:48,095 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309280deaa582cead43b9b5303114d37cb3ad to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309280deaa582cead43b9b5303114d37cb3ad 2023-09-28 12:23:48,095 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-28 12:23:48,098 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:48,100 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-28 12:23:48,102 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-28 12:23:48,102 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:48,103 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-28 12:23:48,103 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695903812551.3a84094c45873efbede08142718bc962.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695903828103"}]},"ts":"9223372036854775807"} 2023-09-28 12:23:48,103 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695903812551.91919fe6a2f8eb8db434879c66e3ad10.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695903828103"}]},"ts":"9223372036854775807"} 2023-09-28 12:23:48,104 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-28 12:23:48,104 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3a84094c45873efbede08142718bc962, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695903812551.3a84094c45873efbede08142718bc962.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 91919fe6a2f8eb8db434879c66e3ad10, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695903812551.91919fe6a2f8eb8db434879c66e3ad10.', STARTKEY => '1', ENDKEY => ''}] 2023-09-28 12:23:48,104 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-28 12:23:48,104 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695903828104"}]},"ts":"9223372036854775807"} 2023-09-28 12:23:48,106 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-28 12:23:48,107 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:48,108 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 35 msec 2023-09-28 12:23:48,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-28 12:23:48,184 INFO [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-28 12:23:48,193 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-28 12:23:48,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:48,196 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-28 12:23:48,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 12:23:48,199 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-28 12:23:48,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 12:23:48,224 INFO [Listener at jenkins-hbase4.apache.org/33885] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=757 (was 745) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x552cecd0-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x552cecd0-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1679557244_17 at /127.0.0.1:59010 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3959 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x552cecd0-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (857873035) connection to jenkins-hbase4.apache.org/172.31.14.131:41881 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x552cecd0-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x552cecd0-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1108708027_1 at /127.0.0.1:50128 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x552cecd0-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1679557244_17 at /127.0.0.1:43912 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1108708027_1 at /127.0.0.1:58978 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1679557244_17 at /127.0.0.1:50154 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=916 (was 896) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=174 (was 178), ProcessCount=169 (was 172), AvailableMemoryMB=4641 (was 4608) - AvailableMemoryMB LEAK? - 2023-09-28 12:23:48,224 WARN [Listener at jenkins-hbase4.apache.org/33885] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-09-28 12:23:48,244 INFO [Listener at jenkins-hbase4.apache.org/33885] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=757, OpenFileDescriptor=916, MaxFileDescriptor=60000, SystemLoadAverage=174, ProcessCount=169, AvailableMemoryMB=4641 2023-09-28 12:23:48,244 WARN [Listener at jenkins-hbase4.apache.org/33885] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-09-28 12:23:48,246 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-28 12:23:48,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-28 12:23:48,249 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-28 12:23:48,249 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-28 12:23:48,249 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-28 12:23:48,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-28 12:23:48,252 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testEmptyExportFileSystemState/35b28cc894f5d353106a8c876657aa01 2023-09-28 12:23:48,252 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testEmptyExportFileSystemState/1b234439f4d029eb6007285420e8f145 2023-09-28 12:23:48,252 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testEmptyExportFileSystemState/35b28cc894f5d353106a8c876657aa01 empty. 2023-09-28 12:23:48,252 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testEmptyExportFileSystemState/1b234439f4d029eb6007285420e8f145 empty. 2023-09-28 12:23:48,253 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testEmptyExportFileSystemState/35b28cc894f5d353106a8c876657aa01 2023-09-28 12:23:48,253 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testEmptyExportFileSystemState/1b234439f4d029eb6007285420e8f145 2023-09-28 12:23:48,253 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-28 12:23:48,288 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-28 12:23:48,290 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 35b28cc894f5d353106a8c876657aa01, NAME => 'testtb-testEmptyExportFileSystemState,,1695903828245.35b28cc894f5d353106a8c876657aa01.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp 2023-09-28 12:23:48,290 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 1b234439f4d029eb6007285420e8f145, NAME => 'testtb-testEmptyExportFileSystemState,1,1695903828245.1b234439f4d029eb6007285420e8f145.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp 2023-09-28 12:23:48,297 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695903828245.1b234439f4d029eb6007285420e8f145.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 12:23:48,297 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695903828245.35b28cc894f5d353106a8c876657aa01.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 12:23:48,297 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 1b234439f4d029eb6007285420e8f145, disabling compactions & flushes 2023-09-28 12:23:48,297 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 35b28cc894f5d353106a8c876657aa01, disabling compactions & flushes 2023-09-28 12:23:48,297 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695903828245.1b234439f4d029eb6007285420e8f145. 2023-09-28 12:23:48,297 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695903828245.1b234439f4d029eb6007285420e8f145. 2023-09-28 12:23:48,297 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695903828245.35b28cc894f5d353106a8c876657aa01. 2023-09-28 12:23:48,297 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695903828245.1b234439f4d029eb6007285420e8f145. after waiting 0 ms 2023-09-28 12:23:48,297 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695903828245.1b234439f4d029eb6007285420e8f145. 2023-09-28 12:23:48,297 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695903828245.35b28cc894f5d353106a8c876657aa01. 2023-09-28 12:23:48,298 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695903828245.1b234439f4d029eb6007285420e8f145. 2023-09-28 12:23:48,298 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695903828245.35b28cc894f5d353106a8c876657aa01. after waiting 0 ms 2023-09-28 12:23:48,298 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695903828245.35b28cc894f5d353106a8c876657aa01. 2023-09-28 12:23:48,298 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 1b234439f4d029eb6007285420e8f145: 2023-09-28 12:23:48,298 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695903828245.35b28cc894f5d353106a8c876657aa01. 2023-09-28 12:23:48,298 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 35b28cc894f5d353106a8c876657aa01: 2023-09-28 12:23:48,300 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-28 12:23:48,300 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695903828245.1b234439f4d029eb6007285420e8f145.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695903828300"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695903828300"}]},"ts":"1695903828300"} 2023-09-28 12:23:48,301 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695903828245.35b28cc894f5d353106a8c876657aa01.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695903828300"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695903828300"}]},"ts":"1695903828300"} 2023-09-28 12:23:48,302 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-28 12:23:48,303 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-28 12:23:48,303 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695903828303"}]},"ts":"1695903828303"} 2023-09-28 12:23:48,304 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-28 12:23:48,308 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-28 12:23:48,309 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-28 12:23:48,309 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-28 12:23:48,309 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-28 12:23:48,309 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-28 12:23:48,309 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=35b28cc894f5d353106a8c876657aa01, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1b234439f4d029eb6007285420e8f145, ASSIGN}] 2023-09-28 12:23:48,312 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=35b28cc894f5d353106a8c876657aa01, ASSIGN 2023-09-28 12:23:48,312 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1b234439f4d029eb6007285420e8f145, ASSIGN 2023-09-28 12:23:48,312 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=35b28cc894f5d353106a8c876657aa01, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40363,1695903740380; forceNewPlan=false, retain=false 2023-09-28 12:23:48,312 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1b234439f4d029eb6007285420e8f145, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39937,1695903740345; forceNewPlan=false, retain=false 2023-09-28 12:23:48,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-28 12:23:48,462 INFO [jenkins-hbase4:45395] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-28 12:23:48,465 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=35b28cc894f5d353106a8c876657aa01, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:48,465 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=1b234439f4d029eb6007285420e8f145, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:48,465 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695903828245.35b28cc894f5d353106a8c876657aa01.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695903828465"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695903828465"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695903828465"}]},"ts":"1695903828465"} 2023-09-28 12:23:48,465 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695903828245.1b234439f4d029eb6007285420e8f145.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695903828465"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695903828465"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695903828465"}]},"ts":"1695903828465"} 2023-09-28 12:23:48,467 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 35b28cc894f5d353106a8c876657aa01, server=jenkins-hbase4.apache.org,40363,1695903740380}] 2023-09-28 12:23:48,468 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 1b234439f4d029eb6007285420e8f145, server=jenkins-hbase4.apache.org,39937,1695903740345}] 2023-09-28 12:23:48,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-28 12:23:48,622 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1695903828245.35b28cc894f5d353106a8c876657aa01. 2023-09-28 12:23:48,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 35b28cc894f5d353106a8c876657aa01, NAME => 'testtb-testEmptyExportFileSystemState,,1695903828245.35b28cc894f5d353106a8c876657aa01.', STARTKEY => '', ENDKEY => '1'} 2023-09-28 12:23:48,622 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1695903828245.1b234439f4d029eb6007285420e8f145. 2023-09-28 12:23:48,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1b234439f4d029eb6007285420e8f145, NAME => 'testtb-testEmptyExportFileSystemState,1,1695903828245.1b234439f4d029eb6007285420e8f145.', STARTKEY => '1', ENDKEY => ''} 2023-09-28 12:23:48,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1695903828245.35b28cc894f5d353106a8c876657aa01. service=AccessControlService 2023-09-28 12:23:48,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1695903828245.1b234439f4d029eb6007285420e8f145. service=AccessControlService 2023-09-28 12:23:48,622 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 12:23:48,622 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 12:23:48,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 35b28cc894f5d353106a8c876657aa01 2023-09-28 12:23:48,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 1b234439f4d029eb6007285420e8f145 2023-09-28 12:23:48,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695903828245.35b28cc894f5d353106a8c876657aa01.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 12:23:48,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695903828245.1b234439f4d029eb6007285420e8f145.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 12:23:48,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 35b28cc894f5d353106a8c876657aa01 2023-09-28 12:23:48,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1b234439f4d029eb6007285420e8f145 2023-09-28 12:23:48,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 35b28cc894f5d353106a8c876657aa01 2023-09-28 12:23:48,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1b234439f4d029eb6007285420e8f145 2023-09-28 12:23:48,624 INFO [StoreOpener-1b234439f4d029eb6007285420e8f145-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1b234439f4d029eb6007285420e8f145 2023-09-28 12:23:48,624 INFO [StoreOpener-35b28cc894f5d353106a8c876657aa01-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 35b28cc894f5d353106a8c876657aa01 2023-09-28 12:23:48,625 DEBUG [StoreOpener-1b234439f4d029eb6007285420e8f145-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testEmptyExportFileSystemState/1b234439f4d029eb6007285420e8f145/cf 2023-09-28 12:23:48,625 DEBUG [StoreOpener-1b234439f4d029eb6007285420e8f145-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testEmptyExportFileSystemState/1b234439f4d029eb6007285420e8f145/cf 2023-09-28 12:23:48,625 DEBUG [StoreOpener-35b28cc894f5d353106a8c876657aa01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testEmptyExportFileSystemState/35b28cc894f5d353106a8c876657aa01/cf 2023-09-28 12:23:48,625 DEBUG [StoreOpener-35b28cc894f5d353106a8c876657aa01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testEmptyExportFileSystemState/35b28cc894f5d353106a8c876657aa01/cf 2023-09-28 12:23:48,625 INFO [StoreOpener-1b234439f4d029eb6007285420e8f145-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1b234439f4d029eb6007285420e8f145 columnFamilyName cf 2023-09-28 12:23:48,625 INFO [StoreOpener-35b28cc894f5d353106a8c876657aa01-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 35b28cc894f5d353106a8c876657aa01 columnFamilyName cf 2023-09-28 12:23:48,627 INFO [StoreOpener-1b234439f4d029eb6007285420e8f145-1] regionserver.HStore(310): Store=1b234439f4d029eb6007285420e8f145/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 12:23:48,627 INFO [StoreOpener-35b28cc894f5d353106a8c876657aa01-1] regionserver.HStore(310): Store=35b28cc894f5d353106a8c876657aa01/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 12:23:48,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testEmptyExportFileSystemState/1b234439f4d029eb6007285420e8f145 2023-09-28 12:23:48,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testEmptyExportFileSystemState/35b28cc894f5d353106a8c876657aa01 2023-09-28 12:23:48,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testEmptyExportFileSystemState/1b234439f4d029eb6007285420e8f145 2023-09-28 12:23:48,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testEmptyExportFileSystemState/35b28cc894f5d353106a8c876657aa01 2023-09-28 12:23:48,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1b234439f4d029eb6007285420e8f145 2023-09-28 12:23:48,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 35b28cc894f5d353106a8c876657aa01 2023-09-28 12:23:48,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testEmptyExportFileSystemState/1b234439f4d029eb6007285420e8f145/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 12:23:48,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testEmptyExportFileSystemState/35b28cc894f5d353106a8c876657aa01/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 12:23:48,633 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1b234439f4d029eb6007285420e8f145; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74597709, jitterRate=0.11159248650074005}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 12:23:48,633 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 35b28cc894f5d353106a8c876657aa01; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64950449, jitterRate=-0.03216288983821869}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 12:23:48,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1b234439f4d029eb6007285420e8f145: 2023-09-28 12:23:48,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 35b28cc894f5d353106a8c876657aa01: 2023-09-28 12:23:48,634 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1695903828245.1b234439f4d029eb6007285420e8f145., pid=94, masterSystemTime=1695903828619 2023-09-28 12:23:48,636 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1695903828245.35b28cc894f5d353106a8c876657aa01., pid=93, masterSystemTime=1695903828619 2023-09-28 12:23:48,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1695903828245.1b234439f4d029eb6007285420e8f145. 2023-09-28 12:23:48,637 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1695903828245.1b234439f4d029eb6007285420e8f145. 2023-09-28 12:23:48,637 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=1b234439f4d029eb6007285420e8f145, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:48,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1695903828245.35b28cc894f5d353106a8c876657aa01. 2023-09-28 12:23:48,638 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1695903828245.1b234439f4d029eb6007285420e8f145.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695903828637"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695903828637"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695903828637"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695903828637"}]},"ts":"1695903828637"} 2023-09-28 12:23:48,638 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1695903828245.35b28cc894f5d353106a8c876657aa01. 2023-09-28 12:23:48,638 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=35b28cc894f5d353106a8c876657aa01, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:48,638 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1695903828245.35b28cc894f5d353106a8c876657aa01.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695903828638"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695903828638"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695903828638"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695903828638"}]},"ts":"1695903828638"} 2023-09-28 12:23:48,641 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=92 2023-09-28 12:23:48,641 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 1b234439f4d029eb6007285420e8f145, server=jenkins-hbase4.apache.org,39937,1695903740345 in 171 msec 2023-09-28 12:23:48,642 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=91 2023-09-28 12:23:48,642 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 35b28cc894f5d353106a8c876657aa01, server=jenkins-hbase4.apache.org,40363,1695903740380 in 173 msec 2023-09-28 12:23:48,642 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1b234439f4d029eb6007285420e8f145, ASSIGN in 332 msec 2023-09-28 12:23:48,643 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=90 2023-09-28 12:23:48,643 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=35b28cc894f5d353106a8c876657aa01, ASSIGN in 333 msec 2023-09-28 12:23:48,644 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-28 12:23:48,644 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695903828644"}]},"ts":"1695903828644"} 2023-09-28 12:23:48,645 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-28 12:23:48,647 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-28 12:23:48,647 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-28 12:23:48,649 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40363] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-28 12:23:48,650 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:23:48,650 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:23:48,650 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:23:48,650 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:23:48,651 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-28 12:23:48,651 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-28 12:23:48,651 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-28 12:23:48,651 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-28 12:23:48,653 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 405 msec 2023-09-28 12:23:48,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-28 12:23:48,853 INFO [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-28 12:23:48,855 DEBUG [Listener at jenkins-hbase4.apache.org/33885] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-28 12:23:48,855 DEBUG [Listener at jenkins-hbase4.apache.org/33885] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695903828245.35b28cc894f5d353106a8c876657aa01. 2023-09-28 12:23:48,857 INFO [Listener at jenkins-hbase4.apache.org/33885] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 12:23:48,867 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 12:23:48,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695903828867 (current time:1695903828867). 2023-09-28 12:23:48,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 12:23:48,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(139): Connect 0x32f607df to 127.0.0.1:65025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 12:23:48,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@583f4d53, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 12:23:48,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 12:23:48,882 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39726, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 12:23:48,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x32f607df to 127.0.0.1:65025 2023-09-28 12:23:48,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 12:23:48,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(139): Connect 0x678d2a77 to 127.0.0.1:65025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 12:23:48,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65c711a6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 12:23:48,890 DEBUG [hconnection-0x47b08d98-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 12:23:48,891 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39738, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 12:23:48,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x678d2a77 to 127.0.0.1:65025 2023-09-28 12:23:48,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 12:23:48,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-28 12:23:48,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 12:23:48,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 12:23:48,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-28 12:23:48,899 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-28 12:23:48,900 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695904428900 2023-09-28 12:23:48,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 12:23:48,900 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-28 12:23:48,901 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 12:23:48,901 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 12:23:48,902 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-28 12:23:48,902 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-28 12:23:48,903 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-09-28 12:23:48,906 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-28 12:23:48,906 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695904428906 2023-09-28 12:23:48,915 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,915 INFO [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-28 12:23:48,915 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:23:48,916 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-28 12:23:48,916 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-28 12:23:48,917 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,917 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,922 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:23:48,922 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:48,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:23:48,922 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:23:48,922 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:23:48,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:23:48,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:23:48,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:23:48,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:23:48,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:23:48,922 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:48,923 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:48,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,923 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:48,923 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 12:23:48,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,923 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,923 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,923 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-28 12:23:48,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-28 12:23:48,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-28 12:23:48,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,924 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-28 12:23:48,924 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-28 12:23:48,924 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-28 12:23:48,924 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,924 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,924 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-28 12:23:48,924 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-28 12:23:48,924 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,924 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:23:48,924 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-28 12:23:48,925 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:23:48,924 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:23:48,926 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-28 12:23:48,927 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-28 12:23:48,925 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-28 12:23:48,927 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-28 12:23:48,927 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40363,1695903740380' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-28 12:23:48,927 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-28 12:23:48,928 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-28 12:23:48,928 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39937,1695903740345' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-28 12:23:48,928 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35175,1695903740297' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-28 12:23:48,929 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:48,929 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,929 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:48,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:23:48,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:23:48,929 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:48,931 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,931 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,931 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 12:23:48,931 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,932 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 12:23:48,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:23:48,932 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,932 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 12:23:48,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:23:48,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:48,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:48,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:48,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:23:48,934 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40363,1695903740380' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-28 12:23:48,934 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46a7b1a8[Count = 1] remaining members to acquire global barrier 2023-09-28 12:23:48,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:48,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:23:48,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:23:48,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:23:48,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:23:48,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:48,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:48,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:48,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:23:48,937 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39937,1695903740345' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-28 12:23:48,937 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46a7b1a8[Count = 0] remaining members to acquire global barrier 2023-09-28 12:23:48,937 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-28 12:23:48,937 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,939 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,939 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,939 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,939 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:48,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,939 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-28 12:23:48,939 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-28 12:23:48,939 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-28 12:23:48,939 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:48,939 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 12:23:48,939 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-28 12:23:48,939 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 12:23:48,939 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 12:23:48,939 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35175,1695903740297' in zk 2023-09-28 12:23:48,939 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695903828245.1b234439f4d029eb6007285420e8f145. 2023-09-28 12:23:48,939 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695903828245.35b28cc894f5d353106a8c876657aa01. 2023-09-28 12:23:48,940 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695903828245.35b28cc894f5d353106a8c876657aa01. started... 2023-09-28 12:23:48,939 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 12:23:48,940 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 12:23:48,939 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695903828245.1b234439f4d029eb6007285420e8f145. started... 2023-09-28 12:23:48,940 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 35b28cc894f5d353106a8c876657aa01: 2023-09-28 12:23:48,941 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1b234439f4d029eb6007285420e8f145: 2023-09-28 12:23:48,941 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695903828245.35b28cc894f5d353106a8c876657aa01.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,941 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 12:23:48,941 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 12:23:48,941 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695903828245.1b234439f4d029eb6007285420e8f145.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,941 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 12:23:48,941 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 12:23:48,942 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-28 12:23:48,942 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:23:48,942 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-28 12:23:48,951 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695903828245.1b234439f4d029eb6007285420e8f145. completed. 2023-09-28 12:23:48,951 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695903828245.1b234439f4d029eb6007285420e8f145. 2023-09-28 12:23:48,951 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695903828245.35b28cc894f5d353106a8c876657aa01. completed. 2023-09-28 12:23:48,951 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 12:23:48,951 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 12:23:48,951 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:48,951 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695903828245.35b28cc894f5d353106a8c876657aa01. 2023-09-28 12:23:48,951 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-28 12:23:48,951 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39937,1695903740345' in zk 2023-09-28 12:23:48,951 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 12:23:48,951 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 12:23:48,951 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:48,951 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-28 12:23:48,951 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40363,1695903740380' in zk 2023-09-28 12:23:48,953 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-28 12:23:48,953 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:48,953 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:23:48,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:48,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:23:48,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:23:48,953 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-28 12:23:48,956 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:48,957 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-28 12:23:48,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:23:48,957 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:23:48,957 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-28 12:23:48,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:23:48,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:48,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:48,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:48,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:23:48,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:48,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:48,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:48,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39937,1695903740345': 2023-09-28 12:23:48,960 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39937,1695903740345' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-28 12:23:48,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:48,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:23:48,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:23:48,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:23:48,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:23:48,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:48,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:48,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:48,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:23:48,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:48,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:48,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:48,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40363,1695903740380': 2023-09-28 12:23:48,963 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40363,1695903740380' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-28 12:23:48,963 INFO [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-28 12:23:48,963 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 12:23:48,963 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 12:23:48,963 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,963 INFO [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 12:23:48,964 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,964 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,964 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:23:48,964 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,964 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,964 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:23:48,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,964 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:23:48,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,965 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:48,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:23:48,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:23:48,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:23:48,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:23:48,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:23:48,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:23:48,965 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:48,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:23:48,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:23:48,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:23:48,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,966 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:48,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:23:48,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:48,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:48,967 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:48,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:48,968 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:48,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:23:48,968 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:48,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:48,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:48,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:48,970 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:48,971 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,971 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:48,971 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:23:48,971 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:23:48,971 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:23:48,971 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:48,971 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,971 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:23:48,971 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:48,971 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:23:48,971 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:23:48,972 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:23:48,971 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,971 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:23:48,972 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-28 12:23:48,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:23:48,972 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:23:48,972 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 12:23:48,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:23:48,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:23:48,972 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:48,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:23:48,972 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:48,972 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,973 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:23:48,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:23:48,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:23:48,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:23:48,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:23:48,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:23:48,973 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-28 12:23:48,979 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:48,980 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,000 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,001 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 12:23:49,001 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-28 12:23:49,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,002 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-28 12:23:49,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695903828900Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695903828979 (+79 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695903828979Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1695903828979Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1695903828983 (+4 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695903828995 (+12 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695903829001 (+6 ms) 2023-09-28 12:23:49,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 12:23:49,005 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-28 12:23:49,006 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 104 msec 2023-09-28 12:23:49,007 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40363] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1695903828245.35b28cc894f5d353106a8c876657aa01. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 12:23:49,008 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39937] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1695903828245.1b234439f4d029eb6007285420e8f145. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 12:23:49,011 DEBUG [Listener at jenkins-hbase4.apache.org/33885] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-28 12:23:49,011 DEBUG [Listener at jenkins-hbase4.apache.org/33885] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695903828245.35b28cc894f5d353106a8c876657aa01. 2023-09-28 12:23:49,011 INFO [Listener at jenkins-hbase4.apache.org/33885] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 12:23:49,020 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 12:23:49,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695903829020 (current time:1695903829020). 2023-09-28 12:23:49,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 12:23:49,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(139): Connect 0x2a6c8981 to 127.0.0.1:65025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 12:23:49,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69f31d19, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 12:23:49,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 12:23:49,029 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39752, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 12:23:49,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2a6c8981 to 127.0.0.1:65025 2023-09-28 12:23:49,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 12:23:49,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(139): Connect 0x65311414 to 127.0.0.1:65025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 12:23:49,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b5fa9b2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 12:23:49,037 DEBUG [hconnection-0x5ab57215-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 12:23:49,040 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39758, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 12:23:49,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x65311414 to 127.0.0.1:65025 2023-09-28 12:23:49,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 12:23:49,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-28 12:23:49,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 12:23:49,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 12:23:49,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-28 12:23:49,048 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-28 12:23:49,048 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695904429048 2023-09-28 12:23:49,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 12:23:49,048 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-28 12:23:49,050 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 12:23:49,050 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 12:23:49,050 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-28 12:23:49,051 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-28 12:23:49,051 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-09-28 12:23:49,052 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-28 12:23:49,053 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695904429053 2023-09-28 12:23:49,060 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,061 INFO [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-28 12:23:49,061 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:23:49,062 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-28 12:23:49,062 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-28 12:23:49,062 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,062 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,063 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:23:49,063 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:23:49,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:23:49,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:23:49,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:23:49,063 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:23:49,063 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:49,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:23:49,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:23:49,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:23:49,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,064 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:49,064 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:49,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,064 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,064 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:49,064 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 12:23:49,064 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,064 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-28 12:23:49,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-28 12:23:49,065 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-28 12:23:49,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-28 12:23:49,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,065 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-28 12:23:49,065 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,065 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-28 12:23:49,065 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-28 12:23:49,065 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:23:49,065 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,065 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-28 12:23:49,065 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:23:49,067 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,067 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-28 12:23:49,067 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-28 12:23:49,067 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:23:49,067 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-28 12:23:49,070 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-28 12:23:49,070 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-28 12:23:49,070 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35175,1695903740297' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-28 12:23:49,067 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-28 12:23:49,070 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-28 12:23:49,070 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39937,1695903740345' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-28 12:23:49,070 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40363,1695903740380' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-28 12:23:49,072 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,072 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:49,072 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:49,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:23:49,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:23:49,073 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:23:49,073 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:49,073 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,073 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 12:23:49,073 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,073 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 12:23:49,073 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:23:49,073 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 12:23:49,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:49,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:49,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:49,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:23:49,075 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39937,1695903740345' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-28 12:23:49,075 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e745e13[Count = 1] remaining members to acquire global barrier 2023-09-28 12:23:49,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:49,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:23:49,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:23:49,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:23:49,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:23:49,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:49,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:49,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:49,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:23:49,077 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40363,1695903740380' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-28 12:23:49,077 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e745e13[Count = 0] remaining members to acquire global barrier 2023-09-28 12:23:49,077 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-28 12:23:49,077 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,080 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,080 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,080 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,081 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-28 12:23:49,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,081 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:49,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,081 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 12:23:49,081 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 12:23:49,081 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-28 12:23:49,081 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695903828245.1b234439f4d029eb6007285420e8f145. 2023-09-28 12:23:49,081 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-28 12:23:49,081 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695903828245.1b234439f4d029eb6007285420e8f145. started... 2023-09-28 12:23:49,081 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:49,081 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 12:23:49,081 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-28 12:23:49,081 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35175,1695903740297' in zk 2023-09-28 12:23:49,081 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695903828245.35b28cc894f5d353106a8c876657aa01. 2023-09-28 12:23:49,081 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 12:23:49,081 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695903828245.35b28cc894f5d353106a8c876657aa01. started... 2023-09-28 12:23:49,081 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 12:23:49,081 INFO [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1b234439f4d029eb6007285420e8f145 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-28 12:23:49,082 INFO [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 35b28cc894f5d353106a8c876657aa01 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-28 12:23:49,084 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-28 12:23:49,084 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:23:49,084 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-28 12:23:49,099 INFO [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230928f194d4421b0b430bb8f4bb50b4d0d0c6 to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230928f194d4421b0b430bb8f4bb50b4d0d0c6 2023-09-28 12:23:49,100 INFO [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309289c6950d52f754109b151b667f3adcdfd to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309289c6950d52f754109b151b667f3adcdfd 2023-09-28 12:23:49,106 INFO [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testEmptyExportFileSystemState/1b234439f4d029eb6007285420e8f145/.tmp/cf/53a5a4624d3d440fb4345de669a4ba20 2023-09-28 12:23:49,107 INFO [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testEmptyExportFileSystemState/35b28cc894f5d353106a8c876657aa01/.tmp/cf/1839a031d08f44a6804c167e269da9cb 2023-09-28 12:23:49,111 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testEmptyExportFileSystemState/1b234439f4d029eb6007285420e8f145/.tmp/cf/53a5a4624d3d440fb4345de669a4ba20 as hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testEmptyExportFileSystemState/1b234439f4d029eb6007285420e8f145/cf/53a5a4624d3d440fb4345de669a4ba20 2023-09-28 12:23:49,112 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testEmptyExportFileSystemState/35b28cc894f5d353106a8c876657aa01/.tmp/cf/1839a031d08f44a6804c167e269da9cb as hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testEmptyExportFileSystemState/35b28cc894f5d353106a8c876657aa01/cf/1839a031d08f44a6804c167e269da9cb 2023-09-28 12:23:49,116 INFO [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testEmptyExportFileSystemState/35b28cc894f5d353106a8c876657aa01/cf/1839a031d08f44a6804c167e269da9cb, entries=4, sequenceid=6, filesize=5.6 K 2023-09-28 12:23:49,116 INFO [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testEmptyExportFileSystemState/1b234439f4d029eb6007285420e8f145/cf/53a5a4624d3d440fb4345de669a4ba20, entries=46, sequenceid=6, filesize=12.9 K 2023-09-28 12:23:49,117 INFO [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 35b28cc894f5d353106a8c876657aa01 in 35ms, sequenceid=6, compaction requested=false 2023-09-28 12:23:49,117 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-28 12:23:49,117 INFO [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 1b234439f4d029eb6007285420e8f145 in 36ms, sequenceid=6, compaction requested=false 2023-09-28 12:23:49,117 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-28 12:23:49,120 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1b234439f4d029eb6007285420e8f145: 2023-09-28 12:23:49,120 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 35b28cc894f5d353106a8c876657aa01: 2023-09-28 12:23:49,120 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695903828245.1b234439f4d029eb6007285420e8f145.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,120 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695903828245.35b28cc894f5d353106a8c876657aa01.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,120 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 12:23:49,120 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 12:23:49,120 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testEmptyExportFileSystemState/1b234439f4d029eb6007285420e8f145/cf/53a5a4624d3d440fb4345de669a4ba20] hfiles 2023-09-28 12:23:49,120 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testEmptyExportFileSystemState/35b28cc894f5d353106a8c876657aa01/cf/1839a031d08f44a6804c167e269da9cb] hfiles 2023-09-28 12:23:49,120 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testEmptyExportFileSystemState/1b234439f4d029eb6007285420e8f145/cf/53a5a4624d3d440fb4345de669a4ba20 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,120 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testEmptyExportFileSystemState/35b28cc894f5d353106a8c876657aa01/cf/1839a031d08f44a6804c167e269da9cb for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,128 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695903828245.1b234439f4d029eb6007285420e8f145. completed. 2023-09-28 12:23:49,128 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695903828245.1b234439f4d029eb6007285420e8f145. 2023-09-28 12:23:49,128 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 12:23:49,128 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 12:23:49,128 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:49,128 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-28 12:23:49,128 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39937,1695903740345' in zk 2023-09-28 12:23:49,128 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695903828245.35b28cc894f5d353106a8c876657aa01. completed. 2023-09-28 12:23:49,128 DEBUG [rs(jenkins-hbase4.apache.org,40363,1695903740380)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695903828245.35b28cc894f5d353106a8c876657aa01. 2023-09-28 12:23:49,128 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 12:23:49,129 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 12:23:49,129 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:49,129 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-28 12:23:49,129 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40363,1695903740380' in zk 2023-09-28 12:23:49,130 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:49,130 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-28 12:23:49,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:49,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:23:49,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:23:49,130 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:23:49,130 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-28 12:23:49,131 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:49,131 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-28 12:23:49,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:23:49,131 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:23:49,132 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-28 12:23:49,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:23:49,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:49,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:49,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:49,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:23:49,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:49,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:49,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:49,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39937,1695903740345': 2023-09-28 12:23:49,135 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39937,1695903740345' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-28 12:23:49,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:49,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:23:49,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:23:49,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:23:49,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:23:49,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:49,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:49,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:49,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:23:49,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:49,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:49,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:49,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40363,1695903740380': 2023-09-28 12:23:49,138 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40363,1695903740380' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-28 12:23:49,138 INFO [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-28 12:23:49,139 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 12:23:49,139 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 12:23:49,139 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,139 INFO [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 12:23:49,140 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,140 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,140 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,140 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:23:49,140 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:23:49,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:23:49,140 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:23:49,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,141 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:49,140 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:23:49,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:23:49,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:23:49,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:23:49,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:23:49,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:23:49,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:23:49,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:23:49,141 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:49,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,142 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:49,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:23:49,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:49,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:49,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:49,143 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:49,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:23:49,143 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:49,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,144 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:49,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:49,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:49,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:49,147 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:49,147 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:23:49,147 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:23:49,147 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,148 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:23:49,148 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,148 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:49,148 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-28 12:23:49,148 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:23:49,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:23:49,148 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:23:49,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:23:49,147 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:23:49,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:23:49,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:23:49,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:23:49,149 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:23:49,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:23:49,148 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,148 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:49,149 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 12:23:49,150 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,150 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:49,150 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:23:49,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:23:49,150 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:49,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:23:49,150 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 12:23:49,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:23:49,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:23:49,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:23:49,150 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:49,150 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,150 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,150 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309289c6950d52f754109b151b667f3adcdfd, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230928f194d4421b0b430bb8f4bb50b4d0d0c6] mob files 2023-09-28 12:23:49,151 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309289c6950d52f754109b151b667f3adcdfd 2023-09-28 12:23:49,151 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230928f194d4421b0b430bb8f4bb50b4d0d0c6 2023-09-28 12:23:49,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-28 12:23:49,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-28 12:23:49,151 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 12:23:49,159 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,160 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,181 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,181 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-28 12:23:49,182 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,182 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,182 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695903829049Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695903829159 (+110 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1695903829159Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1695903829159Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1695903829162 (+3 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1695903829174 (+12 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695903829181 (+7 ms) 2023-09-28 12:23:49,187 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-28 12:23:49,190 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 139 msec 2023-09-28 12:23:49,351 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 12:23:49,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-28 12:23:49,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 12:23:49,353 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903829353 2023-09-28 12:23:49,353 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35969, tgtDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903829353, rawTgtDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903829353, srcFsUri=hdfs://localhost:35969, srcDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326 2023-09-28 12:23:49,375 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35969, inputRoot=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326 2023-09-28 12:23:49,375 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_367921531_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903829353, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903829353/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,375 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35969, inputRoot=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326, snapshotDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-28 12:23:49,380 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903829353/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:49,402 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:49,403 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:49,403 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:49,403 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:50,273 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/hadoop-8911527418120350399.jar 2023-09-28 12:23:50,273 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:50,274 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:50,339 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/hadoop-1135536472308527752.jar 2023-09-28 12:23:50,340 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:50,340 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:50,341 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:50,341 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:50,341 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:50,342 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-28 12:23:50,342 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-28 12:23:50,342 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-28 12:23:50,343 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-28 12:23:50,343 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-28 12:23:50,343 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-28 12:23:50,344 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-28 12:23:50,344 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-28 12:23:50,344 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-28 12:23:50,345 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-28 12:23:50,345 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-28 12:23:50,346 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 12:23:50,346 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 12:23:50,347 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 12:23:50,347 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 12:23:50,347 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 12:23:50,348 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 12:23:50,348 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 12:23:50,707 WARN [Listener at jenkins-hbase4.apache.org/33885] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-28 12:23:50,710 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-28 12:23:52,098 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 12:23:52,098 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 12:23:52,100 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695903747070_0005_000001 (auth:SIMPLE) 2023-09-28 12:23:52,240 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695903747070_0006_000001 (auth:SIMPLE) 2023-09-28 12:23:53,109 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-28 12:23:55,898 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695903747070_0006_000001 (auth:SIMPLE) 2023-09-28 12:23:59,050 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-28 12:23:59,050 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-28 12:23:59,057 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:59,057 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-28 12:23:59,058 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-28 12:23:59,058 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1679557244_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:59,059 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(367): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-28 12:23:59,059 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(367): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-28 12:23:59,059 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1679557244_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903829353/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903829353/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:59,059 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(367): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903829353/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-28 12:23:59,060 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(367): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903829353/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-28 12:23:59,066 INFO [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-28 12:23:59,067 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-09-28 12:23:59,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-28 12:23:59,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-28 12:23:59,071 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695903839071"}]},"ts":"1695903839071"} 2023-09-28 12:23:59,072 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-28 12:23:59,074 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-28 12:23:59,074 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=35b28cc894f5d353106a8c876657aa01, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1b234439f4d029eb6007285420e8f145, UNASSIGN}] 2023-09-28 12:23:59,077 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=35b28cc894f5d353106a8c876657aa01, UNASSIGN 2023-09-28 12:23:59,077 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1b234439f4d029eb6007285420e8f145, UNASSIGN 2023-09-28 12:23:59,077 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=35b28cc894f5d353106a8c876657aa01, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:23:59,077 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=1b234439f4d029eb6007285420e8f145, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:59,078 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695903828245.35b28cc894f5d353106a8c876657aa01.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695903839077"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695903839077"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695903839077"}]},"ts":"1695903839077"} 2023-09-28 12:23:59,078 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695903828245.1b234439f4d029eb6007285420e8f145.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695903839077"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695903839077"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695903839077"}]},"ts":"1695903839077"} 2023-09-28 12:23:59,079 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 35b28cc894f5d353106a8c876657aa01, server=jenkins-hbase4.apache.org,40363,1695903740380}] 2023-09-28 12:23:59,080 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 1b234439f4d029eb6007285420e8f145, server=jenkins-hbase4.apache.org,39937,1695903740345}] 2023-09-28 12:23:59,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-28 12:23:59,231 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1b234439f4d029eb6007285420e8f145 2023-09-28 12:23:59,231 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 35b28cc894f5d353106a8c876657aa01 2023-09-28 12:23:59,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1b234439f4d029eb6007285420e8f145, disabling compactions & flushes 2023-09-28 12:23:59,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 35b28cc894f5d353106a8c876657aa01, disabling compactions & flushes 2023-09-28 12:23:59,231 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695903828245.1b234439f4d029eb6007285420e8f145. 2023-09-28 12:23:59,231 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695903828245.35b28cc894f5d353106a8c876657aa01. 2023-09-28 12:23:59,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695903828245.1b234439f4d029eb6007285420e8f145. 2023-09-28 12:23:59,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695903828245.35b28cc894f5d353106a8c876657aa01. 2023-09-28 12:23:59,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695903828245.1b234439f4d029eb6007285420e8f145. after waiting 0 ms 2023-09-28 12:23:59,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695903828245.1b234439f4d029eb6007285420e8f145. 2023-09-28 12:23:59,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695903828245.35b28cc894f5d353106a8c876657aa01. after waiting 0 ms 2023-09-28 12:23:59,232 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695903828245.35b28cc894f5d353106a8c876657aa01. 2023-09-28 12:23:59,240 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testEmptyExportFileSystemState/1b234439f4d029eb6007285420e8f145/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 12:23:59,240 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testEmptyExportFileSystemState/35b28cc894f5d353106a8c876657aa01/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 12:23:59,241 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 12:23:59,241 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 12:23:59,242 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695903828245.1b234439f4d029eb6007285420e8f145. 2023-09-28 12:23:59,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1b234439f4d029eb6007285420e8f145: 2023-09-28 12:23:59,242 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695903828245.35b28cc894f5d353106a8c876657aa01. 2023-09-28 12:23:59,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 35b28cc894f5d353106a8c876657aa01: 2023-09-28 12:23:59,244 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1b234439f4d029eb6007285420e8f145 2023-09-28 12:23:59,244 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=1b234439f4d029eb6007285420e8f145, regionState=CLOSED 2023-09-28 12:23:59,244 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695903828245.1b234439f4d029eb6007285420e8f145.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695903839244"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695903839244"}]},"ts":"1695903839244"} 2023-09-28 12:23:59,245 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 35b28cc894f5d353106a8c876657aa01 2023-09-28 12:23:59,245 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=35b28cc894f5d353106a8c876657aa01, regionState=CLOSED 2023-09-28 12:23:59,245 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695903828245.35b28cc894f5d353106a8c876657aa01.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695903839245"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695903839245"}]},"ts":"1695903839245"} 2023-09-28 12:23:59,248 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-09-28 12:23:59,248 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 1b234439f4d029eb6007285420e8f145, server=jenkins-hbase4.apache.org,39937,1695903740345 in 166 msec 2023-09-28 12:23:59,249 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-09-28 12:23:59,249 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1b234439f4d029eb6007285420e8f145, UNASSIGN in 174 msec 2023-09-28 12:23:59,249 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 35b28cc894f5d353106a8c876657aa01, server=jenkins-hbase4.apache.org,40363,1695903740380 in 168 msec 2023-09-28 12:23:59,250 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=100, resume processing ppid=99 2023-09-28 12:23:59,250 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=35b28cc894f5d353106a8c876657aa01, UNASSIGN in 175 msec 2023-09-28 12:23:59,251 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695903839251"}]},"ts":"1695903839251"} 2023-09-28 12:23:59,252 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-28 12:23:59,254 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-28 12:23:59,255 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 187 msec 2023-09-28 12:23:59,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-28 12:23:59,373 INFO [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-28 12:23:59,374 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-09-28 12:23:59,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-28 12:23:59,377 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-28 12:23:59,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-28 12:23:59,378 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-28 12:23:59,379 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40363] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-28 12:23:59,382 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testEmptyExportFileSystemState/35b28cc894f5d353106a8c876657aa01 2023-09-28 12:23:59,382 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testEmptyExportFileSystemState/1b234439f4d029eb6007285420e8f145 2023-09-28 12:23:59,383 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-28 12:23:59,383 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-28 12:23:59,383 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-28 12:23:59,383 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-28 12:23:59,384 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-28 12:23:59,384 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-28 12:23:59,384 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-28 12:23:59,384 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-28 12:23:59,385 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testEmptyExportFileSystemState/35b28cc894f5d353106a8c876657aa01/cf, FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testEmptyExportFileSystemState/35b28cc894f5d353106a8c876657aa01/recovered.edits] 2023-09-28 12:23:59,385 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testEmptyExportFileSystemState/1b234439f4d029eb6007285420e8f145/cf, FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testEmptyExportFileSystemState/1b234439f4d029eb6007285420e8f145/recovered.edits] 2023-09-28 12:23:59,385 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-28 12:23:59,385 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-28 12:23:59,385 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-28 12:23:59,385 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:23:59,385 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-28 12:23:59,385 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:23:59,385 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:23:59,385 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:23:59,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-28 12:23:59,389 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testEmptyExportFileSystemState/1b234439f4d029eb6007285420e8f145/cf/53a5a4624d3d440fb4345de669a4ba20 to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testEmptyExportFileSystemState/1b234439f4d029eb6007285420e8f145/cf/53a5a4624d3d440fb4345de669a4ba20 2023-09-28 12:23:59,389 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testEmptyExportFileSystemState/35b28cc894f5d353106a8c876657aa01/cf/1839a031d08f44a6804c167e269da9cb to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testEmptyExportFileSystemState/35b28cc894f5d353106a8c876657aa01/cf/1839a031d08f44a6804c167e269da9cb 2023-09-28 12:23:59,392 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testEmptyExportFileSystemState/1b234439f4d029eb6007285420e8f145/recovered.edits/9.seqid to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testEmptyExportFileSystemState/1b234439f4d029eb6007285420e8f145/recovered.edits/9.seqid 2023-09-28 12:23:59,392 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testEmptyExportFileSystemState/35b28cc894f5d353106a8c876657aa01/recovered.edits/9.seqid to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testEmptyExportFileSystemState/35b28cc894f5d353106a8c876657aa01/recovered.edits/9.seqid 2023-09-28 12:23:59,393 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testEmptyExportFileSystemState/1b234439f4d029eb6007285420e8f145 2023-09-28 12:23:59,393 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testEmptyExportFileSystemState/35b28cc894f5d353106a8c876657aa01 2023-09-28 12:23:59,393 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-28 12:23:59,394 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-28 12:23:59,395 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-28 12:23:59,398 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309289c6950d52f754109b151b667f3adcdfd to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309289c6950d52f754109b151b667f3adcdfd 2023-09-28 12:23:59,399 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230928f194d4421b0b430bb8f4bb50b4d0d0c6 to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230928f194d4421b0b430bb8f4bb50b4d0d0c6 2023-09-28 12:23:59,400 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-28 12:23:59,402 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-28 12:23:59,404 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-28 12:23:59,406 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-28 12:23:59,407 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-28 12:23:59,407 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-28 12:23:59,407 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1695903828245.35b28cc894f5d353106a8c876657aa01.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695903839407"}]},"ts":"9223372036854775807"} 2023-09-28 12:23:59,407 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1695903828245.1b234439f4d029eb6007285420e8f145.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695903839407"}]},"ts":"9223372036854775807"} 2023-09-28 12:23:59,409 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-28 12:23:59,409 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 35b28cc894f5d353106a8c876657aa01, NAME => 'testtb-testEmptyExportFileSystemState,,1695903828245.35b28cc894f5d353106a8c876657aa01.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 1b234439f4d029eb6007285420e8f145, NAME => 'testtb-testEmptyExportFileSystemState,1,1695903828245.1b234439f4d029eb6007285420e8f145.', STARTKEY => '1', ENDKEY => ''}] 2023-09-28 12:23:59,409 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-28 12:23:59,409 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695903839409"}]},"ts":"9223372036854775807"} 2023-09-28 12:23:59,411 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-28 12:23:59,412 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-28 12:23:59,413 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 38 msec 2023-09-28 12:23:59,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-28 12:23:59,488 INFO [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-28 12:23:59,495 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-28 12:23:59,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:59,498 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-28 12:23:59,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-28 12:23:59,523 INFO [Listener at jenkins-hbase4.apache.org/33885] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=764 (was 757) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1468763819_1 at /127.0.0.1:44364 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x552cecd0-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (857873035) connection to jenkins-hbase4.apache.org/172.31.14.131:37541 from appattempt_1695903747070_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1679557244_17 at /127.0.0.1:48778 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x552cecd0-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x552cecd0-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (857873035) connection to jenkins-hbase4.apache.org/172.31.14.131:36973 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (857873035) connection to jenkins-hbase4.apache.org/172.31.14.131:44143 from appattempt_1695903747070_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1679557244_17 at /127.0.0.1:57172 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x552cecd0-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1468763819_1 at /127.0.0.1:48764 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4613 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1679557244_17 at /127.0.0.1:44906 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=924 (was 916) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=148 (was 174), ProcessCount=169 (was 169), AvailableMemoryMB=4635 (was 4641) 2023-09-28 12:23:59,523 WARN [Listener at jenkins-hbase4.apache.org/33885] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-09-28 12:23:59,542 INFO [Listener at jenkins-hbase4.apache.org/33885] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764, OpenFileDescriptor=924, MaxFileDescriptor=60000, SystemLoadAverage=148, ProcessCount=169, AvailableMemoryMB=4635 2023-09-28 12:23:59,542 WARN [Listener at jenkins-hbase4.apache.org/33885] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-09-28 12:23:59,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-28 12:23:59,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 12:23:59,547 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-28 12:23:59,547 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-28 12:23:59,547 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-28 12:23:59,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-28 12:23:59,549 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7289e01a2c054b3afd2266a576e15e4e 2023-09-28 12:23:59,549 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/94c8a6ebe79bf8a83ad4a2a87d760dce 2023-09-28 12:23:59,550 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7289e01a2c054b3afd2266a576e15e4e empty. 2023-09-28 12:23:59,550 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/94c8a6ebe79bf8a83ad4a2a87d760dce empty. 2023-09-28 12:23:59,550 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7289e01a2c054b3afd2266a576e15e4e 2023-09-28 12:23:59,550 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/94c8a6ebe79bf8a83ad4a2a87d760dce 2023-09-28 12:23:59,550 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-28 12:23:59,559 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-28 12:23:59,560 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 94c8a6ebe79bf8a83ad4a2a87d760dce, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695903839544.94c8a6ebe79bf8a83ad4a2a87d760dce.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp 2023-09-28 12:23:59,560 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7289e01a2c054b3afd2266a576e15e4e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695903839544.7289e01a2c054b3afd2266a576e15e4e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp 2023-09-28 12:23:59,580 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695903839544.94c8a6ebe79bf8a83ad4a2a87d760dce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 12:23:59,580 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 94c8a6ebe79bf8a83ad4a2a87d760dce, disabling compactions & flushes 2023-09-28 12:23:59,580 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695903839544.94c8a6ebe79bf8a83ad4a2a87d760dce. 2023-09-28 12:23:59,580 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695903839544.94c8a6ebe79bf8a83ad4a2a87d760dce. 2023-09-28 12:23:59,580 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695903839544.94c8a6ebe79bf8a83ad4a2a87d760dce. after waiting 0 ms 2023-09-28 12:23:59,580 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695903839544.94c8a6ebe79bf8a83ad4a2a87d760dce. 2023-09-28 12:23:59,580 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695903839544.94c8a6ebe79bf8a83ad4a2a87d760dce. 2023-09-28 12:23:59,580 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 94c8a6ebe79bf8a83ad4a2a87d760dce: 2023-09-28 12:23:59,582 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695903839544.7289e01a2c054b3afd2266a576e15e4e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 12:23:59,582 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 7289e01a2c054b3afd2266a576e15e4e, disabling compactions & flushes 2023-09-28 12:23:59,582 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695903839544.7289e01a2c054b3afd2266a576e15e4e. 2023-09-28 12:23:59,582 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695903839544.7289e01a2c054b3afd2266a576e15e4e. 2023-09-28 12:23:59,582 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695903839544.7289e01a2c054b3afd2266a576e15e4e. after waiting 0 ms 2023-09-28 12:23:59,582 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695903839544.7289e01a2c054b3afd2266a576e15e4e. 2023-09-28 12:23:59,582 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695903839544.7289e01a2c054b3afd2266a576e15e4e. 2023-09-28 12:23:59,582 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 7289e01a2c054b3afd2266a576e15e4e: 2023-09-28 12:23:59,585 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-28 12:23:59,586 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695903839544.94c8a6ebe79bf8a83ad4a2a87d760dce.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695903839585"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695903839585"}]},"ts":"1695903839585"} 2023-09-28 12:23:59,586 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695903839544.7289e01a2c054b3afd2266a576e15e4e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695903839585"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695903839585"}]},"ts":"1695903839585"} 2023-09-28 12:23:59,588 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-28 12:23:59,588 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-28 12:23:59,588 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695903839588"}]},"ts":"1695903839588"} 2023-09-28 12:23:59,590 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-28 12:23:59,594 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-28 12:23:59,595 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-28 12:23:59,595 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-28 12:23:59,595 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-28 12:23:59,595 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-28 12:23:59,596 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7289e01a2c054b3afd2266a576e15e4e, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=94c8a6ebe79bf8a83ad4a2a87d760dce, ASSIGN}] 2023-09-28 12:23:59,598 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=94c8a6ebe79bf8a83ad4a2a87d760dce, ASSIGN 2023-09-28 12:23:59,598 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7289e01a2c054b3afd2266a576e15e4e, ASSIGN 2023-09-28 12:23:59,599 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=94c8a6ebe79bf8a83ad4a2a87d760dce, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35175,1695903740297; forceNewPlan=false, retain=false 2023-09-28 12:23:59,599 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7289e01a2c054b3afd2266a576e15e4e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39937,1695903740345; forceNewPlan=false, retain=false 2023-09-28 12:23:59,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-28 12:23:59,749 INFO [jenkins-hbase4:45395] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-28 12:23:59,752 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=7289e01a2c054b3afd2266a576e15e4e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:59,752 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=94c8a6ebe79bf8a83ad4a2a87d760dce, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:59,752 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695903839544.7289e01a2c054b3afd2266a576e15e4e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695903839751"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695903839751"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695903839751"}]},"ts":"1695903839751"} 2023-09-28 12:23:59,752 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695903839544.94c8a6ebe79bf8a83ad4a2a87d760dce.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695903839751"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695903839751"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695903839751"}]},"ts":"1695903839751"} 2023-09-28 12:23:59,753 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 7289e01a2c054b3afd2266a576e15e4e, server=jenkins-hbase4.apache.org,39937,1695903740345}] 2023-09-28 12:23:59,754 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 94c8a6ebe79bf8a83ad4a2a87d760dce, server=jenkins-hbase4.apache.org,35175,1695903740297}] 2023-09-28 12:23:59,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-28 12:23:59,909 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1695903839544.94c8a6ebe79bf8a83ad4a2a87d760dce. 2023-09-28 12:23:59,909 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1695903839544.7289e01a2c054b3afd2266a576e15e4e. 2023-09-28 12:23:59,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 94c8a6ebe79bf8a83ad4a2a87d760dce, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695903839544.94c8a6ebe79bf8a83ad4a2a87d760dce.', STARTKEY => '1', ENDKEY => ''} 2023-09-28 12:23:59,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7289e01a2c054b3afd2266a576e15e4e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695903839544.7289e01a2c054b3afd2266a576e15e4e.', STARTKEY => '', ENDKEY => '1'} 2023-09-28 12:23:59,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1695903839544.7289e01a2c054b3afd2266a576e15e4e. service=AccessControlService 2023-09-28 12:23:59,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1695903839544.94c8a6ebe79bf8a83ad4a2a87d760dce. service=AccessControlService 2023-09-28 12:23:59,910 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 12:23:59,910 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 12:23:59,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 7289e01a2c054b3afd2266a576e15e4e 2023-09-28 12:23:59,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 94c8a6ebe79bf8a83ad4a2a87d760dce 2023-09-28 12:23:59,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695903839544.7289e01a2c054b3afd2266a576e15e4e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 12:23:59,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695903839544.94c8a6ebe79bf8a83ad4a2a87d760dce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 12:23:59,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7289e01a2c054b3afd2266a576e15e4e 2023-09-28 12:23:59,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 94c8a6ebe79bf8a83ad4a2a87d760dce 2023-09-28 12:23:59,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 94c8a6ebe79bf8a83ad4a2a87d760dce 2023-09-28 12:23:59,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7289e01a2c054b3afd2266a576e15e4e 2023-09-28 12:23:59,911 INFO [StoreOpener-7289e01a2c054b3afd2266a576e15e4e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7289e01a2c054b3afd2266a576e15e4e 2023-09-28 12:23:59,911 INFO [StoreOpener-94c8a6ebe79bf8a83ad4a2a87d760dce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 94c8a6ebe79bf8a83ad4a2a87d760dce 2023-09-28 12:23:59,912 DEBUG [StoreOpener-7289e01a2c054b3afd2266a576e15e4e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithSkipTmp/7289e01a2c054b3afd2266a576e15e4e/cf 2023-09-28 12:23:59,913 DEBUG [StoreOpener-94c8a6ebe79bf8a83ad4a2a87d760dce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithSkipTmp/94c8a6ebe79bf8a83ad4a2a87d760dce/cf 2023-09-28 12:23:59,913 DEBUG [StoreOpener-7289e01a2c054b3afd2266a576e15e4e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithSkipTmp/7289e01a2c054b3afd2266a576e15e4e/cf 2023-09-28 12:23:59,913 DEBUG [StoreOpener-94c8a6ebe79bf8a83ad4a2a87d760dce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithSkipTmp/94c8a6ebe79bf8a83ad4a2a87d760dce/cf 2023-09-28 12:23:59,913 INFO [StoreOpener-7289e01a2c054b3afd2266a576e15e4e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7289e01a2c054b3afd2266a576e15e4e columnFamilyName cf 2023-09-28 12:23:59,913 INFO [StoreOpener-94c8a6ebe79bf8a83ad4a2a87d760dce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 94c8a6ebe79bf8a83ad4a2a87d760dce columnFamilyName cf 2023-09-28 12:23:59,914 INFO [StoreOpener-7289e01a2c054b3afd2266a576e15e4e-1] regionserver.HStore(310): Store=7289e01a2c054b3afd2266a576e15e4e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 12:23:59,914 INFO [StoreOpener-94c8a6ebe79bf8a83ad4a2a87d760dce-1] regionserver.HStore(310): Store=94c8a6ebe79bf8a83ad4a2a87d760dce/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 12:23:59,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithSkipTmp/7289e01a2c054b3afd2266a576e15e4e 2023-09-28 12:23:59,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithSkipTmp/94c8a6ebe79bf8a83ad4a2a87d760dce 2023-09-28 12:23:59,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithSkipTmp/7289e01a2c054b3afd2266a576e15e4e 2023-09-28 12:23:59,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithSkipTmp/94c8a6ebe79bf8a83ad4a2a87d760dce 2023-09-28 12:23:59,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7289e01a2c054b3afd2266a576e15e4e 2023-09-28 12:23:59,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 94c8a6ebe79bf8a83ad4a2a87d760dce 2023-09-28 12:23:59,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithSkipTmp/7289e01a2c054b3afd2266a576e15e4e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 12:23:59,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithSkipTmp/94c8a6ebe79bf8a83ad4a2a87d760dce/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 12:23:59,920 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 94c8a6ebe79bf8a83ad4a2a87d760dce; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74347612, jitterRate=0.10786575078964233}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 12:23:59,920 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7289e01a2c054b3afd2266a576e15e4e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72149443, jitterRate=0.07511048018932343}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 12:23:59,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 94c8a6ebe79bf8a83ad4a2a87d760dce: 2023-09-28 12:23:59,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7289e01a2c054b3afd2266a576e15e4e: 2023-09-28 12:23:59,920 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1695903839544.94c8a6ebe79bf8a83ad4a2a87d760dce., pid=109, masterSystemTime=1695903839905 2023-09-28 12:23:59,920 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1695903839544.7289e01a2c054b3afd2266a576e15e4e., pid=108, masterSystemTime=1695903839905 2023-09-28 12:23:59,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1695903839544.94c8a6ebe79bf8a83ad4a2a87d760dce. 2023-09-28 12:23:59,922 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1695903839544.94c8a6ebe79bf8a83ad4a2a87d760dce. 2023-09-28 12:23:59,922 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=94c8a6ebe79bf8a83ad4a2a87d760dce, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:23:59,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1695903839544.7289e01a2c054b3afd2266a576e15e4e. 2023-09-28 12:23:59,922 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1695903839544.7289e01a2c054b3afd2266a576e15e4e. 2023-09-28 12:23:59,922 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695903839544.94c8a6ebe79bf8a83ad4a2a87d760dce.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695903839922"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695903839922"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695903839922"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695903839922"}]},"ts":"1695903839922"} 2023-09-28 12:23:59,923 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=7289e01a2c054b3afd2266a576e15e4e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:23:59,923 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695903839544.7289e01a2c054b3afd2266a576e15e4e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695903839923"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695903839923"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695903839923"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695903839923"}]},"ts":"1695903839923"} 2023-09-28 12:23:59,925 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-09-28 12:23:59,925 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 94c8a6ebe79bf8a83ad4a2a87d760dce, server=jenkins-hbase4.apache.org,35175,1695903740297 in 170 msec 2023-09-28 12:23:59,926 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=106 2023-09-28 12:23:59,926 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=94c8a6ebe79bf8a83ad4a2a87d760dce, ASSIGN in 330 msec 2023-09-28 12:23:59,926 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 7289e01a2c054b3afd2266a576e15e4e, server=jenkins-hbase4.apache.org,39937,1695903740345 in 171 msec 2023-09-28 12:23:59,928 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=106, resume processing ppid=105 2023-09-28 12:23:59,928 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7289e01a2c054b3afd2266a576e15e4e, ASSIGN in 331 msec 2023-09-28 12:23:59,928 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-28 12:23:59,928 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695903839928"}]},"ts":"1695903839928"} 2023-09-28 12:23:59,929 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-28 12:23:59,931 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-28 12:23:59,931 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-28 12:23:59,933 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40363] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-28 12:23:59,934 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:23:59,934 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:23:59,934 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:23:59,934 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:23:59,935 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-28 12:23:59,935 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-28 12:23:59,936 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-28 12:23:59,936 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-28 12:23:59,936 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 391 msec 2023-09-28 12:24:00,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-28 12:24:00,151 INFO [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-28 12:24:00,153 DEBUG [Listener at jenkins-hbase4.apache.org/33885] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,153 DEBUG [Listener at jenkins-hbase4.apache.org/33885] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695903839544.7289e01a2c054b3afd2266a576e15e4e. 2023-09-28 12:24:00,155 INFO [Listener at jenkins-hbase4.apache.org/33885] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 12:24:00,165 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-28 12:24:00,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695903840165 (current time:1695903840165). 2023-09-28 12:24:00,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 12:24:00,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(139): Connect 0x54cbe67c to 127.0.0.1:65025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 12:24:00,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b11c1df, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 12:24:00,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 12:24:00,175 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45948, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 12:24:00,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54cbe67c to 127.0.0.1:65025 2023-09-28 12:24:00,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 12:24:00,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(139): Connect 0x08d3532e to 127.0.0.1:65025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 12:24:00,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a0ac4e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 12:24:00,182 DEBUG [hconnection-0x269a9adc-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 12:24:00,185 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45958, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 12:24:00,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x08d3532e to 127.0.0.1:65025 2023-09-28 12:24:00,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 12:24:00,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-28 12:24:00,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 12:24:00,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-28 12:24:00,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-28 12:24:00,192 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-28 12:24:00,192 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695904440192 2023-09-28 12:24:00,193 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-28 12:24:00,194 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 12:24:00,194 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 12:24:00,195 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-28 12:24:00,195 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-28 12:24:00,196 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-09-28 12:24:00,196 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-28 12:24:00,197 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695904440197 2023-09-28 12:24:00,213 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,213 INFO [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-28 12:24:00,214 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:24:00,215 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-28 12:24:00,215 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-28 12:24:00,215 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,215 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,218 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:24:00,218 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:24:00,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:24:00,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:24:00,218 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:24:00,218 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:00,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:24:00,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:24:00,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:24:00,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:24:00,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,218 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:00,218 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:00,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,218 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,219 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,219 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:00,219 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 12:24:00,219 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-28 12:24:00,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-28 12:24:00,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-28 12:24:00,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,219 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-28 12:24:00,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,219 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-28 12:24:00,219 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-28 12:24:00,219 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,219 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-28 12:24:00,219 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,219 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,220 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-28 12:24:00,220 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-28 12:24:00,220 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:24:00,220 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:24:00,219 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:24:00,221 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-28 12:24:00,222 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-28 12:24:00,223 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-28 12:24:00,223 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35175,1695903740297' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-28 12:24:00,222 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-28 12:24:00,222 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-28 12:24:00,223 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-28 12:24:00,223 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39937,1695903740345' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-28 12:24:00,223 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40363,1695903740380' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-28 12:24:00,228 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:00,228 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:00,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:24:00,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:24:00,229 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,229 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,229 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,229 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 12:24:00,229 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:00,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:24:00,229 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,229 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 12:24:00,229 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,229 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 12:24:00,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:24:00,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:24:00,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:00,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:00,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:24:00,231 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35175,1695903740297' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-28 12:24:00,231 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@220e0f27[Count = 1] remaining members to acquire global barrier 2023-09-28 12:24:00,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:00,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:24:00,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:24:00,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:24:00,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:24:00,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:24:00,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:00,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:00,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:24:00,232 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39937,1695903740345' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-28 12:24:00,232 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@220e0f27[Count = 0] remaining members to acquire global barrier 2023-09-28 12:24:00,232 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-28 12:24:00,232 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,233 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,233 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,233 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,234 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:00,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,234 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-28 12:24:00,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,234 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-28 12:24:00,234 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 12:24:00,234 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-28 12:24:00,234 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695903839544.94c8a6ebe79bf8a83ad4a2a87d760dce. 2023-09-28 12:24:00,234 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-28 12:24:00,234 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695903839544.94c8a6ebe79bf8a83ad4a2a87d760dce. started... 2023-09-28 12:24:00,234 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40363,1695903740380' in zk 2023-09-28 12:24:00,234 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 12:24:00,234 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 12:24:00,234 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:00,235 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 12:24:00,234 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 12:24:00,235 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 94c8a6ebe79bf8a83ad4a2a87d760dce: 2023-09-28 12:24:00,234 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695903839544.7289e01a2c054b3afd2266a576e15e4e. 2023-09-28 12:24:00,235 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695903839544.7289e01a2c054b3afd2266a576e15e4e. started... 2023-09-28 12:24:00,235 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695903839544.94c8a6ebe79bf8a83ad4a2a87d760dce.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,235 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 12:24:00,235 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 12:24:00,235 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7289e01a2c054b3afd2266a576e15e4e: 2023-09-28 12:24:00,235 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695903839544.7289e01a2c054b3afd2266a576e15e4e.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,236 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 12:24:00,236 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 12:24:00,236 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-28 12:24:00,236 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:24:00,236 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-28 12:24:00,251 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695903839544.7289e01a2c054b3afd2266a576e15e4e. completed. 2023-09-28 12:24:00,251 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695903839544.7289e01a2c054b3afd2266a576e15e4e. 2023-09-28 12:24:00,251 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695903839544.94c8a6ebe79bf8a83ad4a2a87d760dce. completed. 2023-09-28 12:24:00,251 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 12:24:00,251 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 12:24:00,251 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695903839544.94c8a6ebe79bf8a83ad4a2a87d760dce. 2023-09-28 12:24:00,251 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:00,251 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 12:24:00,251 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 12:24:00,251 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:00,251 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-28 12:24:00,251 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-28 12:24:00,251 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39937,1695903740345' in zk 2023-09-28 12:24:00,251 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35175,1695903740297' in zk 2023-09-28 12:24:00,254 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-28 12:24:00,254 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:00,254 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-28 12:24:00,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:00,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:24:00,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:24:00,254 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:00,254 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:24:00,254 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:24:00,254 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-28 12:24:00,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:24:00,256 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-28 12:24:00,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:24:00,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:24:00,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:00,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:00,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:24:00,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:24:00,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:00,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:00,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39937,1695903740345': 2023-09-28 12:24:00,260 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39937,1695903740345' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-28 12:24:00,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:00,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:24:00,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:24:00,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:24:00,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:24:00,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:24:00,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:00,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:00,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:24:00,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:24:00,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:00,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:00,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35175,1695903740297': 2023-09-28 12:24:00,263 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35175,1695903740297' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-28 12:24:00,263 INFO [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-28 12:24:00,263 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 12:24:00,263 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 12:24:00,263 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,263 INFO [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 12:24:00,265 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,265 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,265 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,265 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:24:00,265 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,265 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:24:00,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,266 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:24:00,265 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:24:00,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:24:00,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:24:00,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:24:00,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:24:00,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:24:00,266 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:00,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:24:00,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:24:00,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:24:00,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:24:00,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,267 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:00,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:24:00,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:24:00,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:00,269 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:24:00,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:00,269 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:00,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:24:00,270 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:00,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:24:00,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:00,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:00,272 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:00,272 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,272 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:00,272 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:24:00,272 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:24:00,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:24:00,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:24:00,272 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:24:00,272 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,272 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:24:00,272 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:24:00,272 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:24:00,272 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:24:00,274 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:24:00,274 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:24:00,274 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:24:00,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:24:00,274 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:24:00,274 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:00,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 12:24:00,275 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:24:00,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:24:00,275 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:00,275 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:24:00,275 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,275 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:24:00,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:24:00,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:24:00,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:24:00,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-28 12:24:00,287 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,288 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,294 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 12:24:00,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-28 12:24:00,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-28 12:24:00,295 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 12:24:00,304 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,304 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-28 12:24:00,305 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,305 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,305 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695903840193Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695903840287 (+94 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695903840287Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695903840287Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695903840290 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695903840298 (+8 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695903840304 (+6 ms) 2023-09-28 12:24:00,308 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-28 12:24:00,309 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 115 msec 2023-09-28 12:24:00,495 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 12:24:00,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-28 12:24:00,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 12:24:00,499 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39937] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1695903839544.7289e01a2c054b3afd2266a576e15e4e. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 12:24:00,500 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35175] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1695903839544.94c8a6ebe79bf8a83ad4a2a87d760dce. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 12:24:00,502 DEBUG [Listener at jenkins-hbase4.apache.org/33885] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,502 DEBUG [Listener at jenkins-hbase4.apache.org/33885] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695903839544.7289e01a2c054b3afd2266a576e15e4e. 2023-09-28 12:24:00,503 INFO [Listener at jenkins-hbase4.apache.org/33885] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 12:24:00,511 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-28 12:24:00,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695903840511 (current time:1695903840511). 2023-09-28 12:24:00,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 12:24:00,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(139): Connect 0x2097cf0d to 127.0.0.1:65025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 12:24:00,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52a9fdb9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 12:24:00,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 12:24:00,522 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45966, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 12:24:00,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2097cf0d to 127.0.0.1:65025 2023-09-28 12:24:00,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 12:24:00,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(139): Connect 0x035c5b1c to 127.0.0.1:65025 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 12:24:00,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d2d13dd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 12:24:00,530 DEBUG [hconnection-0x7471f4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 12:24:00,531 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45978, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 12:24:00,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x035c5b1c to 127.0.0.1:65025 2023-09-28 12:24:00,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 12:24:00,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-28 12:24:00,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 12:24:00,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-28 12:24:00,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-28 12:24:00,538 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-28 12:24:00,539 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695904440539 2023-09-28 12:24:00,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-28 12:24:00,539 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,540 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 12:24:00,540 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 12:24:00,541 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-28 12:24:00,541 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-28 12:24:00,542 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-09-28 12:24:00,543 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-28 12:24:00,543 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695904440543 2023-09-28 12:24:00,551 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,551 INFO [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-28 12:24:00,551 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:24:00,552 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-28 12:24:00,552 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-28 12:24:00,552 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,552 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,553 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:24:00,553 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:24:00,553 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:00,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:24:00,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:24:00,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:24:00,553 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:24:00,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:24:00,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:24:00,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:24:00,554 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:00,554 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:00,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,554 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,554 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:00,554 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 12:24:00,554 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,555 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-28 12:24:00,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,555 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-28 12:24:00,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-28 12:24:00,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-28 12:24:00,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,555 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-28 12:24:00,555 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,555 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-28 12:24:00,555 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,555 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-28 12:24:00,555 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-28 12:24:00,555 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:24:00,555 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,556 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-28 12:24:00,556 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-28 12:24:00,556 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:24:00,555 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 12:24:00,556 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-28 12:24:00,558 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-28 12:24:00,558 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-28 12:24:00,558 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39937,1695903740345' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-28 12:24:00,557 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-28 12:24:00,558 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-28 12:24:00,558 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35175,1695903740297' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-28 12:24:00,558 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40363,1695903740380' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-28 12:24:00,560 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:00,560 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:00,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:24:00,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:24:00,561 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:00,561 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,561 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,561 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,561 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 12:24:00,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:24:00,561 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,561 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 12:24:00,561 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,561 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 12:24:00,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:24:00,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:24:00,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:00,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:00,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:24:00,563 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39937,1695903740345' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-28 12:24:00,563 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d9bc02[Count = 1] remaining members to acquire global barrier 2023-09-28 12:24:00,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:00,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:24:00,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:24:00,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:24:00,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:24:00,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:24:00,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:00,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:00,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:24:00,564 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35175,1695903740297' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-28 12:24:00,564 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d9bc02[Count = 0] remaining members to acquire global barrier 2023-09-28 12:24:00,564 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-28 12:24:00,565 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,568 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,568 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,568 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,568 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-28 12:24:00,568 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:00,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,568 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-28 12:24:00,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,568 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695903839544.7289e01a2c054b3afd2266a576e15e4e. 2023-09-28 12:24:00,568 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 12:24:00,568 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 12:24:00,568 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695903839544.7289e01a2c054b3afd2266a576e15e4e. started... 2023-09-28 12:24:00,568 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-28 12:24:00,568 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-28 12:24:00,568 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:00,568 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 12:24:00,568 INFO [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7289e01a2c054b3afd2266a576e15e4e 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-28 12:24:00,568 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40363,1695903740380' in zk 2023-09-28 12:24:00,569 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 12:24:00,569 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 12:24:00,569 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695903839544.94c8a6ebe79bf8a83ad4a2a87d760dce. 2023-09-28 12:24:00,569 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695903839544.94c8a6ebe79bf8a83ad4a2a87d760dce. started... 2023-09-28 12:24:00,570 INFO [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 94c8a6ebe79bf8a83ad4a2a87d760dce 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-28 12:24:00,571 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-28 12:24:00,571 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:24:00,571 DEBUG [member: 'jenkins-hbase4.apache.org,40363,1695903740380' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-28 12:24:00,585 INFO [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309288452807dd47e44d5a8d09802790dbbd5 to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309288452807dd47e44d5a8d09802790dbbd5 2023-09-28 12:24:00,586 INFO [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230928c6fa3e25d0464711932de3a5d29df6f8 to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230928c6fa3e25d0464711932de3a5d29df6f8 2023-09-28 12:24:00,594 INFO [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithSkipTmp/7289e01a2c054b3afd2266a576e15e4e/.tmp/cf/857505d4840842058aff0c5677093661 2023-09-28 12:24:00,594 INFO [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithSkipTmp/94c8a6ebe79bf8a83ad4a2a87d760dce/.tmp/cf/5baa38a5314a40929471e783515c9de8 2023-09-28 12:24:00,599 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithSkipTmp/94c8a6ebe79bf8a83ad4a2a87d760dce/.tmp/cf/5baa38a5314a40929471e783515c9de8 as hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithSkipTmp/94c8a6ebe79bf8a83ad4a2a87d760dce/cf/5baa38a5314a40929471e783515c9de8 2023-09-28 12:24:00,600 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithSkipTmp/7289e01a2c054b3afd2266a576e15e4e/.tmp/cf/857505d4840842058aff0c5677093661 as hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithSkipTmp/7289e01a2c054b3afd2266a576e15e4e/cf/857505d4840842058aff0c5677093661 2023-09-28 12:24:00,603 INFO [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithSkipTmp/94c8a6ebe79bf8a83ad4a2a87d760dce/cf/5baa38a5314a40929471e783515c9de8, entries=48, sequenceid=6, filesize=13.5 K 2023-09-28 12:24:00,604 INFO [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithSkipTmp/7289e01a2c054b3afd2266a576e15e4e/cf/857505d4840842058aff0c5677093661, entries=2, sequenceid=6, filesize=5.2 K 2023-09-28 12:24:00,604 INFO [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 94c8a6ebe79bf8a83ad4a2a87d760dce in 34ms, sequenceid=6, compaction requested=false 2023-09-28 12:24:00,604 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-28 12:24:00,604 INFO [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 7289e01a2c054b3afd2266a576e15e4e in 36ms, sequenceid=6, compaction requested=false 2023-09-28 12:24:00,604 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 94c8a6ebe79bf8a83ad4a2a87d760dce: 2023-09-28 12:24:00,606 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7289e01a2c054b3afd2266a576e15e4e: 2023-09-28 12:24:00,606 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695903839544.94c8a6ebe79bf8a83ad4a2a87d760dce.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,606 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695903839544.7289e01a2c054b3afd2266a576e15e4e.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,606 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 12:24:00,606 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 12:24:00,606 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithSkipTmp/94c8a6ebe79bf8a83ad4a2a87d760dce/cf/5baa38a5314a40929471e783515c9de8] hfiles 2023-09-28 12:24:00,606 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithSkipTmp/7289e01a2c054b3afd2266a576e15e4e/cf/857505d4840842058aff0c5677093661] hfiles 2023-09-28 12:24:00,606 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithSkipTmp/7289e01a2c054b3afd2266a576e15e4e/cf/857505d4840842058aff0c5677093661 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,606 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithSkipTmp/94c8a6ebe79bf8a83ad4a2a87d760dce/cf/5baa38a5314a40929471e783515c9de8 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,615 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695903839544.7289e01a2c054b3afd2266a576e15e4e. completed. 2023-09-28 12:24:00,615 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695903839544.94c8a6ebe79bf8a83ad4a2a87d760dce. completed. 2023-09-28 12:24:00,615 DEBUG [rs(jenkins-hbase4.apache.org,35175,1695903740297)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695903839544.94c8a6ebe79bf8a83ad4a2a87d760dce. 2023-09-28 12:24:00,615 DEBUG [rs(jenkins-hbase4.apache.org,39937,1695903740345)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695903839544.7289e01a2c054b3afd2266a576e15e4e. 2023-09-28 12:24:00,615 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 12:24:00,615 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 12:24:00,615 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 12:24:00,615 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:00,615 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 12:24:00,615 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:00,615 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-28 12:24:00,615 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-28 12:24:00,615 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39937,1695903740345' in zk 2023-09-28 12:24:00,615 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35175,1695903740297' in zk 2023-09-28 12:24:00,617 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:00,617 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-28 12:24:00,617 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-28 12:24:00,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:00,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:24:00,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:24:00,617 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:24:00,617 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:00,617 DEBUG [member: 'jenkins-hbase4.apache.org,35175,1695903740297' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-28 12:24:00,617 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:24:00,619 DEBUG [member: 'jenkins-hbase4.apache.org,39937,1695903740345' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-28 12:24:00,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:24:00,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:24:00,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:24:00,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:00,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:00,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:24:00,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:24:00,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:00,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:00,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39937,1695903740345': 2023-09-28 12:24:00,623 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39937,1695903740345' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-28 12:24:00,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:00,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:24:00,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:24:00,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:24:00,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:24:00,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:24:00,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:00,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:00,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:24:00,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:24:00,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:00,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:00,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35175,1695903740297': 2023-09-28 12:24:00,627 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35175,1695903740297' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-28 12:24:00,627 INFO [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-28 12:24:00,627 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 12:24:00,627 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 12:24:00,627 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,627 INFO [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 12:24:00,629 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,629 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 12:24:00,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 12:24:00,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,629 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:24:00,629 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,629 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,629 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:24:00,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,629 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:24:00,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,630 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:24:00,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 12:24:00,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:24:00,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:24:00,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:24:00,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:24:00,630 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:00,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:24:00,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:24:00,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,630 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:00,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 12:24:00,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:24:00,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:00,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:00,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 12:24:00,632 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:24:00,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,632 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:00,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:24:00,632 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:00,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:00,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:00,635 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:00,635 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:24:00,635 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:24:00,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:24:00,635 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:24:00,635 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:24:00,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:24:00,635 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:24:00,635 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,635 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 12:24:00,635 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,635 DEBUG [(jenkins-hbase4.apache.org,45395,1695903738972)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 12:24:00,635 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:24:00,635 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:00,636 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 12:24:00,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:24:00,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 12:24:00,635 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 12:24:00,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 12:24:00,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:24:00,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:24:00,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:24:00,637 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:24:00,637 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 12:24:00,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 12:24:00,637 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:00,637 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,637 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:00,637 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:24:00,637 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,637 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,637 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230928c6fa3e25d0464711932de3a5d29df6f8, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309288452807dd47e44d5a8d09802790dbbd5] mob files 2023-09-28 12:24:00,637 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230928c6fa3e25d0464711932de3a5d29df6f8 2023-09-28 12:24:00,637 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309288452807dd47e44d5a8d09802790dbbd5 2023-09-28 12:24:00,640 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 12:24:00,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-28 12:24:00,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-28 12:24:00,642 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 12:24:00,644 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,644 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,658 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,658 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-28 12:24:00,659 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,659 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,659 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695903840539Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695903840644 (+105 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695903840644Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1695903840644Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1695903840646 (+2 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695903840652 (+6 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695903840658 (+6 ms) 2023-09-28 12:24:00,662 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-28 12:24:00,663 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 122 msec 2023-09-28 12:24:00,842 DEBUG [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 12:24:00,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-28 12:24:00,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 12:24:00,843 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903840843 2023-09-28 12:24:00,843 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35969, tgtDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903840843, rawTgtDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903840843, srcFsUri=hdfs://localhost:35969, srcDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326 2023-09-28 12:24:00,865 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35969, inputRoot=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326 2023-09-28 12:24:00,865 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1391041602_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903840843, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903840843/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,865 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35969, inputRoot=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326, snapshotDir=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-28 12:24:00,873 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903840843/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:00,886 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-28 12:24:00,886 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-28 12:24:00,886 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-28 12:24:00,887 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-28 12:24:01,756 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/hadoop-1855161925027955761.jar 2023-09-28 12:24:01,757 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-28 12:24:01,757 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-28 12:24:01,823 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/hadoop-5806319104935170707.jar 2023-09-28 12:24:01,823 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-28 12:24:01,824 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-28 12:24:01,824 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-28 12:24:01,824 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-28 12:24:01,825 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-28 12:24:01,825 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-28 12:24:01,825 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-28 12:24:01,826 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-28 12:24:01,826 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-28 12:24:01,826 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-28 12:24:01,827 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-28 12:24:01,827 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-28 12:24:01,827 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-28 12:24:01,828 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-28 12:24:01,828 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-28 12:24:01,828 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-28 12:24:01,829 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 12:24:01,829 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 12:24:01,830 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 12:24:01,830 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 12:24:01,830 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 12:24:01,831 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 12:24:01,831 DEBUG [Listener at jenkins-hbase4.apache.org/33885] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 12:24:02,167 WARN [Listener at jenkins-hbase4.apache.org/33885] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-28 12:24:02,168 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-28 12:24:02,170 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-28 12:24:03,201 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 12:24:03,202 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 12:24:03,204 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695903747070_0006_000001 (auth:SIMPLE) 2023-09-28 12:24:04,111 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695903747070_0007_000001 (auth:SIMPLE) 2023-09-28 12:24:04,842 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-28 12:24:07,874 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695903747070_0007_000001 (auth:SIMPLE) 2023-09-28 12:24:10,084 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695903747070_0007_000001 (auth:SIMPLE) 2023-09-28 12:24:12,609 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695903747070_0007_000001 (auth:SIMPLE) 2023-09-28 12:24:14,315 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-28 12:24:14,315 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-28 12:24:14,326 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:14,326 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-28 12:24:14,326 INFO [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-28 12:24:14,327 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1679557244_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:14,327 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(367): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-28 12:24:14,327 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(367): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-28 12:24:14,327 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1679557244_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903840843/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903840843/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:14,327 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(367): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903840843/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-28 12:24:14,327 DEBUG [Listener at jenkins-hbase4.apache.org/33885] snapshot.TestExportSnapshot(367): hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/export-test/export-1695903840843/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-28 12:24:14,332 INFO [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:14,333 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:14,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:14,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-28 12:24:14,336 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695903854336"}]},"ts":"1695903854336"} 2023-09-28 12:24:14,338 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-28 12:24:14,339 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-28 12:24:14,339 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7289e01a2c054b3afd2266a576e15e4e, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=94c8a6ebe79bf8a83ad4a2a87d760dce, UNASSIGN}] 2023-09-28 12:24:14,341 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7289e01a2c054b3afd2266a576e15e4e, UNASSIGN 2023-09-28 12:24:14,341 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=94c8a6ebe79bf8a83ad4a2a87d760dce, UNASSIGN 2023-09-28 12:24:14,342 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=7289e01a2c054b3afd2266a576e15e4e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:14,342 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=94c8a6ebe79bf8a83ad4a2a87d760dce, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:14,342 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695903839544.7289e01a2c054b3afd2266a576e15e4e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695903854342"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695903854342"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695903854342"}]},"ts":"1695903854342"} 2023-09-28 12:24:14,342 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695903839544.94c8a6ebe79bf8a83ad4a2a87d760dce.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695903854342"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695903854342"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695903854342"}]},"ts":"1695903854342"} 2023-09-28 12:24:14,343 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 7289e01a2c054b3afd2266a576e15e4e, server=jenkins-hbase4.apache.org,39937,1695903740345}] 2023-09-28 12:24:14,344 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 94c8a6ebe79bf8a83ad4a2a87d760dce, server=jenkins-hbase4.apache.org,35175,1695903740297}] 2023-09-28 12:24:14,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-28 12:24:14,495 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7289e01a2c054b3afd2266a576e15e4e 2023-09-28 12:24:14,495 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 94c8a6ebe79bf8a83ad4a2a87d760dce 2023-09-28 12:24:14,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7289e01a2c054b3afd2266a576e15e4e, disabling compactions & flushes 2023-09-28 12:24:14,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 94c8a6ebe79bf8a83ad4a2a87d760dce, disabling compactions & flushes 2023-09-28 12:24:14,495 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695903839544.7289e01a2c054b3afd2266a576e15e4e. 2023-09-28 12:24:14,495 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695903839544.94c8a6ebe79bf8a83ad4a2a87d760dce. 2023-09-28 12:24:14,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695903839544.94c8a6ebe79bf8a83ad4a2a87d760dce. 2023-09-28 12:24:14,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695903839544.7289e01a2c054b3afd2266a576e15e4e. 2023-09-28 12:24:14,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695903839544.94c8a6ebe79bf8a83ad4a2a87d760dce. after waiting 0 ms 2023-09-28 12:24:14,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695903839544.94c8a6ebe79bf8a83ad4a2a87d760dce. 2023-09-28 12:24:14,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695903839544.7289e01a2c054b3afd2266a576e15e4e. after waiting 0 ms 2023-09-28 12:24:14,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695903839544.7289e01a2c054b3afd2266a576e15e4e. 2023-09-28 12:24:14,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithSkipTmp/7289e01a2c054b3afd2266a576e15e4e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 12:24:14,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/default/testtb-testExportFileSystemStateWithSkipTmp/94c8a6ebe79bf8a83ad4a2a87d760dce/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 12:24:14,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 12:24:14,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 12:24:14,508 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695903839544.7289e01a2c054b3afd2266a576e15e4e. 2023-09-28 12:24:14,508 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695903839544.94c8a6ebe79bf8a83ad4a2a87d760dce. 2023-09-28 12:24:14,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7289e01a2c054b3afd2266a576e15e4e: 2023-09-28 12:24:14,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 94c8a6ebe79bf8a83ad4a2a87d760dce: 2023-09-28 12:24:14,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7289e01a2c054b3afd2266a576e15e4e 2023-09-28 12:24:14,510 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=7289e01a2c054b3afd2266a576e15e4e, regionState=CLOSED 2023-09-28 12:24:14,510 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695903839544.7289e01a2c054b3afd2266a576e15e4e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695903854510"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695903854510"}]},"ts":"1695903854510"} 2023-09-28 12:24:14,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 94c8a6ebe79bf8a83ad4a2a87d760dce 2023-09-28 12:24:14,511 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=94c8a6ebe79bf8a83ad4a2a87d760dce, regionState=CLOSED 2023-09-28 12:24:14,511 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695903839544.94c8a6ebe79bf8a83ad4a2a87d760dce.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695903854511"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695903854511"}]},"ts":"1695903854511"} 2023-09-28 12:24:14,513 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-09-28 12:24:14,513 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 7289e01a2c054b3afd2266a576e15e4e, server=jenkins-hbase4.apache.org,39937,1695903740345 in 168 msec 2023-09-28 12:24:14,513 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-09-28 12:24:14,513 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 94c8a6ebe79bf8a83ad4a2a87d760dce, server=jenkins-hbase4.apache.org,35175,1695903740297 in 168 msec 2023-09-28 12:24:14,514 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7289e01a2c054b3afd2266a576e15e4e, UNASSIGN in 174 msec 2023-09-28 12:24:14,515 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=116, resume processing ppid=114 2023-09-28 12:24:14,515 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=94c8a6ebe79bf8a83ad4a2a87d760dce, UNASSIGN in 174 msec 2023-09-28 12:24:14,515 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695903854515"}]},"ts":"1695903854515"} 2023-09-28 12:24:14,516 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-28 12:24:14,518 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-28 12:24:14,519 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 185 msec 2023-09-28 12:24:14,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-28 12:24:14,638 INFO [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-28 12:24:14,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:14,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:14,642 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:14,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:14,643 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:14,644 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40363] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:14,646 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7289e01a2c054b3afd2266a576e15e4e 2023-09-28 12:24:14,646 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/94c8a6ebe79bf8a83ad4a2a87d760dce 2023-09-28 12:24:14,647 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:14,647 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:14,647 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:14,647 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:14,648 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-28 12:24:14,648 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-28 12:24:14,648 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-28 12:24:14,648 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-28 12:24:14,648 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7289e01a2c054b3afd2266a576e15e4e/cf, FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7289e01a2c054b3afd2266a576e15e4e/recovered.edits] 2023-09-28 12:24:14,649 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/94c8a6ebe79bf8a83ad4a2a87d760dce/cf, FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/94c8a6ebe79bf8a83ad4a2a87d760dce/recovered.edits] 2023-09-28 12:24:14,649 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:14,649 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:24:14,649 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:14,649 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:24:14,649 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:14,649 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:24:14,653 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:14,653 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 12:24:14,653 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7289e01a2c054b3afd2266a576e15e4e/cf/857505d4840842058aff0c5677093661 to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/7289e01a2c054b3afd2266a576e15e4e/cf/857505d4840842058aff0c5677093661 2023-09-28 12:24:14,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-28 12:24:14,654 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/94c8a6ebe79bf8a83ad4a2a87d760dce/cf/5baa38a5314a40929471e783515c9de8 to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/94c8a6ebe79bf8a83ad4a2a87d760dce/cf/5baa38a5314a40929471e783515c9de8 2023-09-28 12:24:14,656 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7289e01a2c054b3afd2266a576e15e4e/recovered.edits/9.seqid to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/7289e01a2c054b3afd2266a576e15e4e/recovered.edits/9.seqid 2023-09-28 12:24:14,657 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7289e01a2c054b3afd2266a576e15e4e 2023-09-28 12:24:14,657 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/94c8a6ebe79bf8a83ad4a2a87d760dce/recovered.edits/9.seqid to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/94c8a6ebe79bf8a83ad4a2a87d760dce/recovered.edits/9.seqid 2023-09-28 12:24:14,658 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/94c8a6ebe79bf8a83ad4a2a87d760dce 2023-09-28 12:24:14,658 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-28 12:24:14,658 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-28 12:24:14,659 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-28 12:24:14,662 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230928c6fa3e25d0464711932de3a5d29df6f8 to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230928c6fa3e25d0464711932de3a5d29df6f8 2023-09-28 12:24:14,664 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309288452807dd47e44d5a8d09802790dbbd5 to hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309288452807dd47e44d5a8d09802790dbbd5 2023-09-28 12:24:14,664 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-28 12:24:14,666 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:14,668 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-28 12:24:14,670 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-28 12:24:14,671 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:14,671 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-28 12:24:14,671 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695903839544.7289e01a2c054b3afd2266a576e15e4e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695903854671"}]},"ts":"9223372036854775807"} 2023-09-28 12:24:14,672 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695903839544.94c8a6ebe79bf8a83ad4a2a87d760dce.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695903854671"}]},"ts":"9223372036854775807"} 2023-09-28 12:24:14,673 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-28 12:24:14,673 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7289e01a2c054b3afd2266a576e15e4e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695903839544.7289e01a2c054b3afd2266a576e15e4e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 94c8a6ebe79bf8a83ad4a2a87d760dce, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695903839544.94c8a6ebe79bf8a83ad4a2a87d760dce.', STARTKEY => '1', ENDKEY => ''}] 2023-09-28 12:24:14,673 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-28 12:24:14,673 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695903854673"}]},"ts":"9223372036854775807"} 2023-09-28 12:24:14,675 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-28 12:24:14,677 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:14,678 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 38 msec 2023-09-28 12:24:14,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-28 12:24:14,755 INFO [Listener at jenkins-hbase4.apache.org/33885] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-28 12:24:14,762 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-28 12:24:14,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:14,765 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-28 12:24:14,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45395] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 12:24:14,794 INFO [Listener at jenkins-hbase4.apache.org/33885] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764 (was 764), OpenFileDescriptor=904 (was 924), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=216 (was 148) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=4551 (was 4635) 2023-09-28 12:24:14,794 WARN [Listener at jenkins-hbase4.apache.org/33885] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-09-28 12:24:14,795 INFO [Listener at jenkins-hbase4.apache.org/33885] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-28 12:24:14,808 INFO [Listener at jenkins-hbase4.apache.org/33885] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-28 12:24:14,919 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1695903747070_0007_01_000001 is : 143 2023-09-28 12:24:20,076 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-28 12:24:28,931 INFO [Listener at jenkins-hbase4.apache.org/33885] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-28 12:24:43,048 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-28 12:24:43,049 INFO [Listener at jenkins-hbase4.apache.org/33885] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-28 12:24:43,156 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-28 12:24:43,164 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-28 12:24:43,165 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-28 12:24:43,175 INFO [Listener at jenkins-hbase4.apache.org/33885] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-28 12:24:43,278 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-28 12:24:43,278 INFO [Listener at jenkins-hbase4.apache.org/33885] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-28 12:24:43,278 INFO [Listener at jenkins-hbase4.apache.org/33885] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-28 12:24:43,278 INFO [Listener at jenkins-hbase4.apache.org/33885] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-28 12:24:43,279 DEBUG [Listener at jenkins-hbase4.apache.org/33885] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45bc384d to 127.0.0.1:65025 2023-09-28 12:24:43,279 DEBUG [Listener at jenkins-hbase4.apache.org/33885] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 12:24:43,279 DEBUG [Listener at jenkins-hbase4.apache.org/33885] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-28 12:24:43,279 DEBUG [Listener at jenkins-hbase4.apache.org/33885] util.JVMClusterUtil(257): Found active master hash=393527703, stopped=false 2023-09-28 12:24:43,279 DEBUG [Listener at jenkins-hbase4.apache.org/33885] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 12:24:43,279 DEBUG [Listener at jenkins-hbase4.apache.org/33885] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-28 12:24:43,279 INFO [Listener at jenkins-hbase4.apache.org/33885] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,45395,1695903738972 2023-09-28 12:24:43,281 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-28 12:24:43,281 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-28 12:24:43,281 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 12:24:43,281 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-28 12:24:43,281 INFO [Listener at jenkins-hbase4.apache.org/33885] procedure2.ProcedureExecutor(628): Stopping 2023-09-28 12:24:43,281 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-28 12:24:43,281 DEBUG [Listener at jenkins-hbase4.apache.org/33885] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b44492b to 127.0.0.1:65025 2023-09-28 12:24:43,281 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-28 12:24:43,281 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-28 12:24:43,281 DEBUG [Listener at jenkins-hbase4.apache.org/33885] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 12:24:43,282 INFO [Listener at jenkins-hbase4.apache.org/33885] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,35175,1695903740297' ***** 2023-09-28 12:24:43,282 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-28 12:24:43,282 DEBUG [Listener at jenkins-hbase4.apache.org/33885] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 12:24:43,282 INFO [Listener at jenkins-hbase4.apache.org/33885] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-28 12:24:43,282 INFO [Listener at jenkins-hbase4.apache.org/33885] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39937,1695903740345' ***** 2023-09-28 12:24:43,282 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-28 12:24:43,282 DEBUG [Listener at jenkins-hbase4.apache.org/33885] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 12:24:43,282 INFO [Listener at jenkins-hbase4.apache.org/33885] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-28 12:24:43,282 INFO [Listener at jenkins-hbase4.apache.org/33885] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40363,1695903740380' ***** 2023-09-28 12:24:43,282 INFO [RS:0;jenkins-hbase4:35175] regionserver.HeapMemoryManager(220): Stopping 2023-09-28 12:24:43,282 INFO [RS:1;jenkins-hbase4:39937] regionserver.HeapMemoryManager(220): Stopping 2023-09-28 12:24:43,282 DEBUG [Listener at jenkins-hbase4.apache.org/33885] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 12:24:43,283 INFO [RS:0;jenkins-hbase4:35175] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-28 12:24:43,283 INFO [Listener at jenkins-hbase4.apache.org/33885] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-28 12:24:43,283 INFO [RS:0;jenkins-hbase4:35175] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-28 12:24:43,283 INFO [RS:1;jenkins-hbase4:39937] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-28 12:24:43,283 INFO [RS:0;jenkins-hbase4:35175] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:43,283 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-28 12:24:43,283 DEBUG [RS:0;jenkins-hbase4:35175] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5050f720 to 127.0.0.1:65025 2023-09-28 12:24:43,283 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-28 12:24:43,283 DEBUG [RS:0;jenkins-hbase4:35175] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 12:24:43,283 INFO [RS:1;jenkins-hbase4:39937] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-28 12:24:43,283 INFO [RS:2;jenkins-hbase4:40363] regionserver.HeapMemoryManager(220): Stopping 2023-09-28 12:24:43,285 INFO [RS:1;jenkins-hbase4:39937] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:43,285 INFO [RS:2;jenkins-hbase4:40363] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-28 12:24:43,285 INFO [RS:0;jenkins-hbase4:35175] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,35175,1695903740297; all regions closed. 2023-09-28 12:24:43,285 INFO [RS:2;jenkins-hbase4:40363] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-28 12:24:43,285 DEBUG [RS:1;jenkins-hbase4:39937] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x43591350 to 127.0.0.1:65025 2023-09-28 12:24:43,285 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-28 12:24:43,285 DEBUG [RS:1;jenkins-hbase4:39937] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 12:24:43,285 INFO [RS:2;jenkins-hbase4:40363] regionserver.HRegionServer(3305): Received CLOSE for 60fcb1e86482093d728cff835802f62d 2023-09-28 12:24:43,287 INFO [RS:1;jenkins-hbase4:39937] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39937,1695903740345; all regions closed. 2023-09-28 12:24:43,287 INFO [RS:2;jenkins-hbase4:40363] regionserver.HRegionServer(3305): Received CLOSE for b76c299f3a811003291b50d263ea4180 2023-09-28 12:24:43,287 INFO [RS:2;jenkins-hbase4:40363] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:24:43,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 60fcb1e86482093d728cff835802f62d, disabling compactions & flushes 2023-09-28 12:24:43,288 DEBUG [RS:2;jenkins-hbase4:40363] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x32647569 to 127.0.0.1:65025 2023-09-28 12:24:43,288 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695903743195.60fcb1e86482093d728cff835802f62d. 2023-09-28 12:24:43,288 DEBUG [RS:2;jenkins-hbase4:40363] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 12:24:43,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695903743195.60fcb1e86482093d728cff835802f62d. 2023-09-28 12:24:43,289 INFO [RS:2;jenkins-hbase4:40363] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-28 12:24:43,289 INFO [RS:2;jenkins-hbase4:40363] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-28 12:24:43,289 INFO [RS:2;jenkins-hbase4:40363] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-28 12:24:43,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695903743195.60fcb1e86482093d728cff835802f62d. after waiting 0 ms 2023-09-28 12:24:43,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695903743195.60fcb1e86482093d728cff835802f62d. 2023-09-28 12:24:43,289 INFO [RS:2;jenkins-hbase4:40363] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-28 12:24:43,289 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 60fcb1e86482093d728cff835802f62d 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-28 12:24:43,289 INFO [RS:2;jenkins-hbase4:40363] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-09-28 12:24:43,289 DEBUG [RS:2;jenkins-hbase4:40363] regionserver.HRegionServer(1478): Online Regions={60fcb1e86482093d728cff835802f62d=hbase:acl,,1695903743195.60fcb1e86482093d728cff835802f62d., 1588230740=hbase:meta,,1.1588230740, b76c299f3a811003291b50d263ea4180=hbase:namespace,,1695903742469.b76c299f3a811003291b50d263ea4180.} 2023-09-28 12:24:43,290 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-28 12:24:43,290 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-28 12:24:43,290 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-28 12:24:43,290 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-28 12:24:43,290 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-28 12:24:43,290 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-09-28 12:24:43,291 DEBUG [RS:2;jenkins-hbase4:40363] regionserver.HRegionServer(1504): Waiting on 1588230740, 60fcb1e86482093d728cff835802f62d, b76c299f3a811003291b50d263ea4180 2023-09-28 12:24:43,309 DEBUG [RS:1;jenkins-hbase4:39937] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/oldWALs 2023-09-28 12:24:43,309 DEBUG [RS:0;jenkins-hbase4:35175] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/oldWALs 2023-09-28 12:24:43,309 INFO [RS:1;jenkins-hbase4:39937] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39937%2C1695903740345:(num 1695903742022) 2023-09-28 12:24:43,309 INFO [RS:0;jenkins-hbase4:35175] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35175%2C1695903740297:(num 1695903742022) 2023-09-28 12:24:43,309 DEBUG [RS:1;jenkins-hbase4:39937] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 12:24:43,309 DEBUG [RS:0;jenkins-hbase4:35175] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 12:24:43,309 INFO [RS:1;jenkins-hbase4:39937] regionserver.LeaseManager(133): Closed leases 2023-09-28 12:24:43,309 INFO [RS:0;jenkins-hbase4:35175] regionserver.LeaseManager(133): Closed leases 2023-09-28 12:24:43,311 INFO [RS:0;jenkins-hbase4:35175] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-28 12:24:43,311 INFO [RS:1;jenkins-hbase4:39937] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-28 12:24:43,312 INFO [RS:0;jenkins-hbase4:35175] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-28 12:24:43,312 INFO [RS:1;jenkins-hbase4:39937] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-28 12:24:43,312 INFO [RS:0;jenkins-hbase4:35175] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-28 12:24:43,312 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-28 12:24:43,312 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-28 12:24:43,312 INFO [RS:0;jenkins-hbase4:35175] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-28 12:24:43,312 INFO [RS:1;jenkins-hbase4:39937] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-28 12:24:43,312 INFO [RS:1;jenkins-hbase4:39937] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-28 12:24:43,315 INFO [RS:0;jenkins-hbase4:35175] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35175 2023-09-28 12:24:43,317 INFO [RS:1;jenkins-hbase4:39937] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39937 2023-09-28 12:24:43,319 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/acl/60fcb1e86482093d728cff835802f62d/.tmp/l/c2e97dc5eb4144e9810b83e99249cafa 2023-09-28 12:24:43,321 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:43,321 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-28 12:24:43,321 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:43,321 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35175,1695903740297 2023-09-28 12:24:43,321 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-28 12:24:43,321 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-28 12:24:43,321 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-28 12:24:43,322 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35175,1695903740297] 2023-09-28 12:24:43,323 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35175,1695903740297; numProcessing=1 2023-09-28 12:24:43,325 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:43,325 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-28 12:24:43,325 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:43,325 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39937,1695903740345 2023-09-28 12:24:43,325 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/meta/1588230740/.tmp/info/0d59d01d38c74ae3a19f673ab62af1f8 2023-09-28 12:24:43,326 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c2e97dc5eb4144e9810b83e99249cafa 2023-09-28 12:24:43,326 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35175,1695903740297 already deleted, retry=false 2023-09-28 12:24:43,326 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35175,1695903740297 expired; onlineServers=2 2023-09-28 12:24:43,327 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39937,1695903740345] 2023-09-28 12:24:43,327 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39937,1695903740345; numProcessing=2 2023-09-28 12:24:43,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/acl/60fcb1e86482093d728cff835802f62d/.tmp/l/c2e97dc5eb4144e9810b83e99249cafa as hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/acl/60fcb1e86482093d728cff835802f62d/l/c2e97dc5eb4144e9810b83e99249cafa 2023-09-28 12:24:43,328 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39937,1695903740345 already deleted, retry=false 2023-09-28 12:24:43,328 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39937,1695903740345 expired; onlineServers=1 2023-09-28 12:24:43,331 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0d59d01d38c74ae3a19f673ab62af1f8 2023-09-28 12:24:43,332 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c2e97dc5eb4144e9810b83e99249cafa 2023-09-28 12:24:43,333 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/acl/60fcb1e86482093d728cff835802f62d/l/c2e97dc5eb4144e9810b83e99249cafa, entries=7, sequenceid=18, filesize=5.2 K 2023-09-28 12:24:43,334 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 60fcb1e86482093d728cff835802f62d in 45ms, sequenceid=18, compaction requested=false 2023-09-28 12:24:43,345 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/acl/60fcb1e86482093d728cff835802f62d/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-28 12:24:43,345 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 12:24:43,346 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1695903743195.60fcb1e86482093d728cff835802f62d. 2023-09-28 12:24:43,346 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 60fcb1e86482093d728cff835802f62d: 2023-09-28 12:24:43,346 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1695903743195.60fcb1e86482093d728cff835802f62d. 2023-09-28 12:24:43,347 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b76c299f3a811003291b50d263ea4180, disabling compactions & flushes 2023-09-28 12:24:43,347 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695903742469.b76c299f3a811003291b50d263ea4180. 2023-09-28 12:24:43,347 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695903742469.b76c299f3a811003291b50d263ea4180. 2023-09-28 12:24:43,347 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695903742469.b76c299f3a811003291b50d263ea4180. after waiting 0 ms 2023-09-28 12:24:43,347 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695903742469.b76c299f3a811003291b50d263ea4180. 2023-09-28 12:24:43,347 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing b76c299f3a811003291b50d263ea4180 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-28 12:24:43,351 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/meta/1588230740/.tmp/rep_barrier/e75278c75d8b435bad57a6ad4d9bc708 2023-09-28 12:24:43,352 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-28 12:24:43,357 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e75278c75d8b435bad57a6ad4d9bc708 2023-09-28 12:24:43,362 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-28 12:24:43,369 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/namespace/b76c299f3a811003291b50d263ea4180/.tmp/info/cf0b36a112d54de9be84439abf600950 2023-09-28 12:24:43,372 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-28 12:24:43,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/namespace/b76c299f3a811003291b50d263ea4180/.tmp/info/cf0b36a112d54de9be84439abf600950 as hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/namespace/b76c299f3a811003291b50d263ea4180/info/cf0b36a112d54de9be84439abf600950 2023-09-28 12:24:43,379 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/meta/1588230740/.tmp/table/e279dfb80f3d4e60b0a8d55c27db0e30 2023-09-28 12:24:43,379 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/namespace/b76c299f3a811003291b50d263ea4180/info/cf0b36a112d54de9be84439abf600950, entries=2, sequenceid=6, filesize=4.8 K 2023-09-28 12:24:43,380 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for b76c299f3a811003291b50d263ea4180 in 33ms, sequenceid=6, compaction requested=false 2023-09-28 12:24:43,385 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e279dfb80f3d4e60b0a8d55c27db0e30 2023-09-28 12:24:43,386 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/namespace/b76c299f3a811003291b50d263ea4180/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 12:24:43,386 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 12:24:43,386 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/meta/1588230740/.tmp/info/0d59d01d38c74ae3a19f673ab62af1f8 as hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/meta/1588230740/info/0d59d01d38c74ae3a19f673ab62af1f8 2023-09-28 12:24:43,387 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695903742469.b76c299f3a811003291b50d263ea4180. 2023-09-28 12:24:43,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b76c299f3a811003291b50d263ea4180: 2023-09-28 12:24:43,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1695903742469.b76c299f3a811003291b50d263ea4180. 2023-09-28 12:24:43,390 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0d59d01d38c74ae3a19f673ab62af1f8 2023-09-28 12:24:43,391 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/meta/1588230740/info/0d59d01d38c74ae3a19f673ab62af1f8, entries=48, sequenceid=131, filesize=10.3 K 2023-09-28 12:24:43,391 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/meta/1588230740/.tmp/rep_barrier/e75278c75d8b435bad57a6ad4d9bc708 as hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/meta/1588230740/rep_barrier/e75278c75d8b435bad57a6ad4d9bc708 2023-09-28 12:24:43,396 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e75278c75d8b435bad57a6ad4d9bc708 2023-09-28 12:24:43,396 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/meta/1588230740/rep_barrier/e75278c75d8b435bad57a6ad4d9bc708, entries=13, sequenceid=131, filesize=6.4 K 2023-09-28 12:24:43,397 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/meta/1588230740/.tmp/table/e279dfb80f3d4e60b0a8d55c27db0e30 as hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/meta/1588230740/table/e279dfb80f3d4e60b0a8d55c27db0e30 2023-09-28 12:24:43,401 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e279dfb80f3d4e60b0a8d55c27db0e30 2023-09-28 12:24:43,401 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/meta/1588230740/table/e279dfb80f3d4e60b0a8d55c27db0e30, entries=24, sequenceid=131, filesize=6.9 K 2023-09-28 12:24:43,402 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 112ms, sequenceid=131, compaction requested=false 2023-09-28 12:24:43,411 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-28 12:24:43,412 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 12:24:43,412 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-28 12:24:43,412 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-28 12:24:43,412 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-28 12:24:43,412 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-28 12:24:43,425 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-28 12:24:43,425 INFO [RS:0;jenkins-hbase4:35175] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,35175,1695903740297; zookeeper connection closed. 2023-09-28 12:24:43,425 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:35175-0x100f27ca02f0001, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-28 12:24:43,425 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1342e277] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1342e277 2023-09-28 12:24:43,491 INFO [RS:2;jenkins-hbase4:40363] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40363,1695903740380; all regions closed. 2023-09-28 12:24:43,496 DEBUG [RS:2;jenkins-hbase4:40363] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/oldWALs 2023-09-28 12:24:43,496 INFO [RS:2;jenkins-hbase4:40363] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40363%2C1695903740380.meta:.meta(num 1695903742180) 2023-09-28 12:24:43,501 DEBUG [RS:2;jenkins-hbase4:40363] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/oldWALs 2023-09-28 12:24:43,501 INFO [RS:2;jenkins-hbase4:40363] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40363%2C1695903740380:(num 1695903742022) 2023-09-28 12:24:43,501 DEBUG [RS:2;jenkins-hbase4:40363] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 12:24:43,501 INFO [RS:2;jenkins-hbase4:40363] regionserver.LeaseManager(133): Closed leases 2023-09-28 12:24:43,501 INFO [RS:2;jenkins-hbase4:40363] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-28 12:24:43,501 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-28 12:24:43,502 INFO [RS:2;jenkins-hbase4:40363] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40363 2023-09-28 12:24:43,504 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40363,1695903740380 2023-09-28 12:24:43,504 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-28 12:24:43,510 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40363,1695903740380] 2023-09-28 12:24:43,510 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40363,1695903740380; numProcessing=3 2023-09-28 12:24:43,511 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40363,1695903740380 already deleted, retry=false 2023-09-28 12:24:43,511 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40363,1695903740380 expired; onlineServers=0 2023-09-28 12:24:43,511 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45395,1695903738972' ***** 2023-09-28 12:24:43,511 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-28 12:24:43,512 DEBUG [M:0;jenkins-hbase4:45395] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5649cbac, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-28 12:24:43,512 INFO [M:0;jenkins-hbase4:45395] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45395,1695903738972 2023-09-28 12:24:43,512 INFO [M:0;jenkins-hbase4:45395] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45395,1695903738972; all regions closed. 2023-09-28 12:24:43,512 DEBUG [M:0;jenkins-hbase4:45395] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 12:24:43,512 DEBUG [M:0;jenkins-hbase4:45395] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-28 12:24:43,512 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-28 12:24:43,512 DEBUG [M:0;jenkins-hbase4:45395] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-28 12:24:43,512 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695903741651] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695903741651,5,FailOnTimeoutGroup] 2023-09-28 12:24:43,512 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695903741651] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695903741651,5,FailOnTimeoutGroup] 2023-09-28 12:24:43,512 INFO [M:0;jenkins-hbase4:45395] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-28 12:24:43,512 INFO [M:0;jenkins-hbase4:45395] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-28 12:24:43,512 INFO [M:0;jenkins-hbase4:45395] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-09-28 12:24:43,512 DEBUG [M:0;jenkins-hbase4:45395] master.HMaster(1512): Stopping service threads 2023-09-28 12:24:43,513 INFO [M:0;jenkins-hbase4:45395] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-28 12:24:43,513 ERROR [M:0;jenkins-hbase4:45395] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-09-28 12:24:43,513 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-09-28 12:24:43,513 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 12:24:43,513 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-28 12:24:43,513 INFO [M:0;jenkins-hbase4:45395] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-28 12:24:43,513 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-28 12:24:43,514 DEBUG [M:0;jenkins-hbase4:45395] zookeeper.ZKUtil(398): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-28 12:24:43,514 WARN [M:0;jenkins-hbase4:45395] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-28 12:24:43,514 INFO [M:0;jenkins-hbase4:45395] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-28 12:24:43,514 INFO [M:0;jenkins-hbase4:45395] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-28 12:24:43,515 DEBUG [M:0;jenkins-hbase4:45395] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-28 12:24:43,515 INFO [M:0;jenkins-hbase4:45395] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-28 12:24:43,515 DEBUG [M:0;jenkins-hbase4:45395] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-28 12:24:43,515 DEBUG [M:0;jenkins-hbase4:45395] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-28 12:24:43,515 DEBUG [M:0;jenkins-hbase4:45395] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-28 12:24:43,515 INFO [M:0;jenkins-hbase4:45395] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.89 KB heapSize=452.19 KB 2023-09-28 12:24:43,525 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-28 12:24:43,525 INFO [RS:1;jenkins-hbase4:39937] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39937,1695903740345; zookeeper connection closed. 2023-09-28 12:24:43,525 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:39937-0x100f27ca02f0002, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-28 12:24:43,529 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@fe2e50d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@fe2e50d 2023-09-28 12:24:43,529 INFO [M:0;jenkins-hbase4:45395] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.89 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/3f3ff417d83d4b4c94fde1694e9cdb59 2023-09-28 12:24:43,534 INFO [M:0;jenkins-hbase4:45395] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3f3ff417d83d4b4c94fde1694e9cdb59 2023-09-28 12:24:43,535 DEBUG [M:0;jenkins-hbase4:45395] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/3f3ff417d83d4b4c94fde1694e9cdb59 as hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/3f3ff417d83d4b4c94fde1694e9cdb59 2023-09-28 12:24:43,539 INFO [M:0;jenkins-hbase4:45395] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3f3ff417d83d4b4c94fde1694e9cdb59 2023-09-28 12:24:43,539 INFO [M:0;jenkins-hbase4:45395] regionserver.HStore(1080): Added hdfs://localhost:35969/user/jenkins/test-data/1c6b7d0f-5c32-732c-6298-13f4be843326/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/3f3ff417d83d4b4c94fde1694e9cdb59, entries=119, sequenceid=899, filesize=28.7 K 2023-09-28 12:24:43,540 INFO [M:0;jenkins-hbase4:45395] regionserver.HRegion(2948): Finished flush of dataSize ~375.89 KB/384916, heapSize ~452.17 KB/463024, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 25ms, sequenceid=899, compaction requested=false 2023-09-28 12:24:43,542 INFO [M:0;jenkins-hbase4:45395] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-28 12:24:43,542 DEBUG [M:0;jenkins-hbase4:45395] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-28 12:24:43,546 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-28 12:24:43,546 INFO [M:0;jenkins-hbase4:45395] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-28 12:24:43,547 INFO [M:0;jenkins-hbase4:45395] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45395 2023-09-28 12:24:43,549 DEBUG [M:0;jenkins-hbase4:45395] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,45395,1695903738972 already deleted, retry=false 2023-09-28 12:24:43,625 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-28 12:24:43,625 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): regionserver:40363-0x100f27ca02f0003, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-28 12:24:43,625 INFO [RS:2;jenkins-hbase4:40363] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40363,1695903740380; zookeeper connection closed. 2023-09-28 12:24:43,626 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6f5f9aed] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6f5f9aed 2023-09-28 12:24:43,626 INFO [Listener at jenkins-hbase4.apache.org/33885] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-28 12:24:43,725 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-28 12:24:43,725 INFO [M:0;jenkins-hbase4:45395] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45395,1695903738972; zookeeper connection closed. 2023-09-28 12:24:43,726 DEBUG [Listener at localhost/44031-EventThread] zookeeper.ZKWatcher(600): master:45395-0x100f27ca02f0000, quorum=127.0.0.1:65025, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-28 12:24:43,727 WARN [Listener at jenkins-hbase4.apache.org/33885] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-28 12:24:43,730 INFO [Listener at jenkins-hbase4.apache.org/33885] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-28 12:24:43,833 WARN [BP-1914219063-172.31.14.131-1695903735202 heartbeating to localhost/127.0.0.1:35969] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-28 12:24:43,833 WARN [BP-1914219063-172.31.14.131-1695903735202 heartbeating to localhost/127.0.0.1:35969] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1914219063-172.31.14.131-1695903735202 (Datanode Uuid b1d48ce5-9a61-4e82-942d-61abe6523395) service to localhost/127.0.0.1:35969 2023-09-28 12:24:43,835 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/cluster_f5b5db01-ec3b-43d5-fd0c-5c90c5632a48/dfs/data/data5/current/BP-1914219063-172.31.14.131-1695903735202] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-28 12:24:43,835 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/cluster_f5b5db01-ec3b-43d5-fd0c-5c90c5632a48/dfs/data/data6/current/BP-1914219063-172.31.14.131-1695903735202] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-28 12:24:43,837 WARN [Listener at jenkins-hbase4.apache.org/33885] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-28 12:24:43,839 INFO [Listener at jenkins-hbase4.apache.org/33885] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-28 12:24:43,941 WARN [BP-1914219063-172.31.14.131-1695903735202 heartbeating to localhost/127.0.0.1:35969] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-28 12:24:43,941 WARN [BP-1914219063-172.31.14.131-1695903735202 heartbeating to localhost/127.0.0.1:35969] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1914219063-172.31.14.131-1695903735202 (Datanode Uuid 68ce23cf-aee2-4c1f-a48d-418a0ae52c54) service to localhost/127.0.0.1:35969 2023-09-28 12:24:43,942 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/cluster_f5b5db01-ec3b-43d5-fd0c-5c90c5632a48/dfs/data/data3/current/BP-1914219063-172.31.14.131-1695903735202] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-28 12:24:43,942 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/cluster_f5b5db01-ec3b-43d5-fd0c-5c90c5632a48/dfs/data/data4/current/BP-1914219063-172.31.14.131-1695903735202] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-28 12:24:43,944 WARN [Listener at jenkins-hbase4.apache.org/33885] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-28 12:24:43,946 INFO [Listener at jenkins-hbase4.apache.org/33885] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-28 12:24:44,050 WARN [BP-1914219063-172.31.14.131-1695903735202 heartbeating to localhost/127.0.0.1:35969] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-28 12:24:44,050 WARN [BP-1914219063-172.31.14.131-1695903735202 heartbeating to localhost/127.0.0.1:35969] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1914219063-172.31.14.131-1695903735202 (Datanode Uuid 9faeacd2-c233-4faf-ac73-e190841d9d6d) service to localhost/127.0.0.1:35969 2023-09-28 12:24:44,050 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/cluster_f5b5db01-ec3b-43d5-fd0c-5c90c5632a48/dfs/data/data1/current/BP-1914219063-172.31.14.131-1695903735202] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-28 12:24:44,051 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/15870207-2795-67c7-a83e-6cc186c11bf9/cluster_f5b5db01-ec3b-43d5-fd0c-5c90c5632a48/dfs/data/data2/current/BP-1914219063-172.31.14.131-1695903735202] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-28 12:24:44,071 INFO [Listener at jenkins-hbase4.apache.org/33885] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-28 12:24:44,197 INFO [Listener at jenkins-hbase4.apache.org/33885] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-28 12:24:44,280 INFO [Listener at jenkins-hbase4.apache.org/33885] hbase.HBaseTestingUtility(1293): Minicluster is down