2023-07-23 05:06:25,487 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-23 05:06:25,761 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555 2023-07-23 05:06:25,762 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-23 05:06:25,762 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-23 05:06:25,810 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-23 05:06:26,062 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-23 05:06:26,063 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/cluster_6208cc7e-f826-e9bd-232f-095b41f2684b, deleteOnExit=true 2023-07-23 05:06:26,063 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-23 05:06:26,064 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/test.cache.data in system properties and HBase conf 2023-07-23 05:06:26,064 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/hadoop.tmp.dir in system properties and HBase conf 2023-07-23 05:06:26,065 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/hadoop.log.dir in system properties and HBase conf 2023-07-23 05:06:26,065 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-23 05:06:26,066 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-23 05:06:26,066 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-23 05:06:26,416 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-23 05:06:26,422 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-23 05:06:26,423 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-23 05:06:26,423 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-23 05:06:26,424 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-23 05:06:26,424 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-23 05:06:26,424 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-23 05:06:26,425 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-23 05:06:26,425 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-23 05:06:26,426 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-23 05:06:26,426 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/nfs.dump.dir in system properties and HBase conf 2023-07-23 05:06:26,427 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/java.io.tmpdir in system properties and HBase conf 2023-07-23 05:06:26,427 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-23 05:06:26,427 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-23 05:06:26,428 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-23 05:06:27,047 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-23 05:06:27,051 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-23 05:06:27,326 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-23 05:06:27,496 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-23 05:06:27,514 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 05:06:27,560 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 05:06:27,602 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/java.io.tmpdir/Jetty_localhost_34123_hdfs____32z00r/webapp 2023-07-23 05:06:27,756 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34123 2023-07-23 05:06:27,804 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-23 05:06:27,804 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-23 05:06:28,332 WARN [Listener at localhost/38911] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-23 05:06:28,421 WARN [Listener at localhost/38911] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-23 05:06:28,446 WARN [Listener at localhost/38911] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 05:06:28,455 INFO [Listener at localhost/38911] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 05:06:28,464 INFO [Listener at localhost/38911] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/java.io.tmpdir/Jetty_localhost_33385_datanode____k3tat3/webapp 2023-07-23 05:06:28,607 INFO [Listener at localhost/38911] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33385 2023-07-23 05:06:29,161 WARN [Listener at localhost/41551] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-23 05:06:29,186 WARN [Listener at localhost/41551] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-23 05:06:29,190 WARN [Listener at localhost/41551] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 05:06:29,192 INFO [Listener at localhost/41551] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 05:06:29,201 INFO [Listener at localhost/41551] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/java.io.tmpdir/Jetty_localhost_44847_datanode____.uncpjy/webapp 2023-07-23 05:06:29,343 INFO [Listener at localhost/41551] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44847 2023-07-23 05:06:29,364 WARN [Listener at localhost/39067] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-23 05:06:29,409 WARN [Listener at localhost/39067] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-23 05:06:29,414 WARN [Listener at localhost/39067] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 05:06:29,416 INFO [Listener at localhost/39067] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 05:06:29,421 INFO [Listener at localhost/39067] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/java.io.tmpdir/Jetty_localhost_33309_datanode____.3g2br1/webapp 2023-07-23 05:06:29,588 INFO [Listener at localhost/39067] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33309 2023-07-23 05:06:29,612 WARN [Listener at localhost/37217] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-23 05:06:29,970 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x99094ec011ce82ee: Processing first storage report for DS-43e79616-8982-404d-ba59-1c5d5b1ada11 from datanode f8c0bac9-7d8b-4c0a-8f24-8f087d075de8 2023-07-23 05:06:29,972 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x99094ec011ce82ee: from storage DS-43e79616-8982-404d-ba59-1c5d5b1ada11 node DatanodeRegistration(127.0.0.1:34817, datanodeUuid=f8c0bac9-7d8b-4c0a-8f24-8f087d075de8, infoPort=45583, infoSecurePort=0, ipcPort=41551, storageInfo=lv=-57;cid=testClusterID;nsid=143271863;c=1690088787127), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-23 05:06:29,972 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6bbe5e4c3dc20339: Processing first storage report for DS-573e87f4-e926-4d4e-8342-e478e1946468 from datanode 5c98c315-51cd-4a00-834d-484be290f5e1 2023-07-23 05:06:29,972 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6bbe5e4c3dc20339: from storage DS-573e87f4-e926-4d4e-8342-e478e1946468 node DatanodeRegistration(127.0.0.1:35881, datanodeUuid=5c98c315-51cd-4a00-834d-484be290f5e1, infoPort=39389, infoSecurePort=0, ipcPort=39067, storageInfo=lv=-57;cid=testClusterID;nsid=143271863;c=1690088787127), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-23 05:06:29,973 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x449ee0c5bb22d0fb: Processing first storage report for DS-49129683-d539-467d-a078-aea2fb6a2e0f from datanode 66f08036-e875-4e1c-807f-72dfe6e3dd5b 2023-07-23 05:06:29,973 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x449ee0c5bb22d0fb: from storage DS-49129683-d539-467d-a078-aea2fb6a2e0f node DatanodeRegistration(127.0.0.1:37587, datanodeUuid=66f08036-e875-4e1c-807f-72dfe6e3dd5b, infoPort=33777, infoSecurePort=0, ipcPort=37217, storageInfo=lv=-57;cid=testClusterID;nsid=143271863;c=1690088787127), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-23 05:06:29,973 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x99094ec011ce82ee: Processing first storage report for DS-261e781b-4a33-41a6-bea3-eb2fdd0fda24 from datanode f8c0bac9-7d8b-4c0a-8f24-8f087d075de8 2023-07-23 05:06:29,973 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x99094ec011ce82ee: from storage DS-261e781b-4a33-41a6-bea3-eb2fdd0fda24 node DatanodeRegistration(127.0.0.1:34817, datanodeUuid=f8c0bac9-7d8b-4c0a-8f24-8f087d075de8, infoPort=45583, infoSecurePort=0, ipcPort=41551, storageInfo=lv=-57;cid=testClusterID;nsid=143271863;c=1690088787127), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-23 05:06:29,973 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6bbe5e4c3dc20339: Processing first storage report for DS-29ca8d0f-d063-4fde-9260-c17f6110491b from datanode 5c98c315-51cd-4a00-834d-484be290f5e1 2023-07-23 05:06:29,973 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6bbe5e4c3dc20339: from storage DS-29ca8d0f-d063-4fde-9260-c17f6110491b node DatanodeRegistration(127.0.0.1:35881, datanodeUuid=5c98c315-51cd-4a00-834d-484be290f5e1, infoPort=39389, infoSecurePort=0, ipcPort=39067, storageInfo=lv=-57;cid=testClusterID;nsid=143271863;c=1690088787127), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-23 05:06:29,973 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x449ee0c5bb22d0fb: Processing first storage report for DS-b966d267-4c01-4e02-8a77-381715204ddb from datanode 66f08036-e875-4e1c-807f-72dfe6e3dd5b 2023-07-23 05:06:29,973 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x449ee0c5bb22d0fb: from storage DS-b966d267-4c01-4e02-8a77-381715204ddb node DatanodeRegistration(127.0.0.1:37587, datanodeUuid=66f08036-e875-4e1c-807f-72dfe6e3dd5b, infoPort=33777, infoSecurePort=0, ipcPort=37217, storageInfo=lv=-57;cid=testClusterID;nsid=143271863;c=1690088787127), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-23 05:06:30,133 DEBUG [Listener at localhost/37217] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555 2023-07-23 05:06:30,222 INFO [Listener at localhost/37217] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/cluster_6208cc7e-f826-e9bd-232f-095b41f2684b/zookeeper_0, clientPort=57388, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/cluster_6208cc7e-f826-e9bd-232f-095b41f2684b/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/cluster_6208cc7e-f826-e9bd-232f-095b41f2684b/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-23 05:06:30,244 INFO [Listener at localhost/37217] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57388 2023-07-23 05:06:30,256 INFO [Listener at localhost/37217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 05:06:30,259 INFO [Listener at localhost/37217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 05:06:30,972 INFO [Listener at localhost/37217] util.FSUtils(471): Created version file at hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd with version=8 2023-07-23 05:06:30,972 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/hbase-staging 2023-07-23 05:06:31,334 INFO [Listener at localhost/37217] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-23 05:06:31,919 INFO [Listener at localhost/37217] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-23 05:06:31,971 INFO [Listener at localhost/37217] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 05:06:31,971 INFO [Listener at localhost/37217] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-23 05:06:31,972 INFO [Listener at localhost/37217] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-23 05:06:31,972 INFO [Listener at localhost/37217] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 05:06:31,972 INFO [Listener at localhost/37217] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-23 05:06:32,184 INFO [Listener at localhost/37217] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-23 05:06:32,270 DEBUG [Listener at localhost/37217] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-23 05:06:32,389 INFO [Listener at localhost/37217] ipc.NettyRpcServer(120): Bind to /172.31.14.131:32809 2023-07-23 05:06:32,409 INFO [Listener at localhost/37217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 05:06:32,411 INFO [Listener at localhost/37217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 05:06:32,442 INFO [Listener at localhost/37217] zookeeper.RecoverableZooKeeper(93): Process identifier=master:32809 connecting to ZooKeeper ensemble=127.0.0.1:57388 2023-07-23 05:06:32,518 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:328090x0, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-23 05:06:32,523 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:32809-0x1019092dbbb0000 connected 2023-07-23 05:06:32,559 DEBUG [Listener at localhost/37217] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-23 05:06:32,560 DEBUG [Listener at localhost/37217] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 05:06:32,573 DEBUG [Listener at localhost/37217] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-23 05:06:32,582 DEBUG [Listener at localhost/37217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=32809 2023-07-23 05:06:32,583 DEBUG [Listener at localhost/37217] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=32809 2023-07-23 05:06:32,585 DEBUG [Listener at localhost/37217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=32809 2023-07-23 05:06:32,585 DEBUG [Listener at localhost/37217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=32809 2023-07-23 05:06:32,586 DEBUG [Listener at localhost/37217] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=32809 2023-07-23 05:06:32,594 INFO [Listener at localhost/37217] master.HMaster(444): hbase.rootdir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd, hbase.cluster.distributed=false 2023-07-23 05:06:32,661 INFO [Listener at localhost/37217] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-23 05:06:32,661 INFO [Listener at localhost/37217] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 05:06:32,662 INFO [Listener at localhost/37217] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-23 05:06:32,662 INFO [Listener at localhost/37217] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-23 05:06:32,662 INFO [Listener at localhost/37217] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 05:06:32,662 INFO [Listener at localhost/37217] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-23 05:06:32,667 INFO [Listener at localhost/37217] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-23 05:06:32,671 INFO [Listener at localhost/37217] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45437 2023-07-23 05:06:32,674 INFO [Listener at localhost/37217] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-23 05:06:32,683 INFO [Listener at localhost/37217] mob.MobFileCache(124): MobFileCache disabled 2023-07-23 05:06:32,684 INFO [Listener at localhost/37217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 05:06:32,687 INFO [Listener at localhost/37217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 05:06:32,689 INFO [Listener at localhost/37217] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45437 connecting to ZooKeeper ensemble=127.0.0.1:57388 2023-07-23 05:06:32,694 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:454370x0, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-23 05:06:32,695 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45437-0x1019092dbbb0001 connected 2023-07-23 05:06:32,695 DEBUG [Listener at localhost/37217] zookeeper.ZKUtil(164): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-23 05:06:32,697 DEBUG [Listener at localhost/37217] zookeeper.ZKUtil(164): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 05:06:32,698 DEBUG [Listener at localhost/37217] zookeeper.ZKUtil(164): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-23 05:06:32,698 DEBUG [Listener at localhost/37217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45437 2023-07-23 05:06:32,702 DEBUG [Listener at localhost/37217] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45437 2023-07-23 05:06:32,703 DEBUG [Listener at localhost/37217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45437 2023-07-23 05:06:32,704 DEBUG [Listener at localhost/37217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45437 2023-07-23 05:06:32,704 DEBUG [Listener at localhost/37217] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45437 2023-07-23 05:06:32,721 INFO [Listener at localhost/37217] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-23 05:06:32,721 INFO [Listener at localhost/37217] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 05:06:32,721 INFO [Listener at localhost/37217] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-23 05:06:32,722 INFO [Listener at localhost/37217] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-23 05:06:32,722 INFO [Listener at localhost/37217] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 05:06:32,722 INFO [Listener at localhost/37217] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-23 05:06:32,722 INFO [Listener at localhost/37217] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-23 05:06:32,725 INFO [Listener at localhost/37217] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44949 2023-07-23 05:06:32,726 INFO [Listener at localhost/37217] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-23 05:06:32,729 INFO [Listener at localhost/37217] mob.MobFileCache(124): MobFileCache disabled 2023-07-23 05:06:32,730 INFO [Listener at localhost/37217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 05:06:32,732 INFO [Listener at localhost/37217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 05:06:32,735 INFO [Listener at localhost/37217] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44949 connecting to ZooKeeper ensemble=127.0.0.1:57388 2023-07-23 05:06:32,740 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:449490x0, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-23 05:06:32,741 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44949-0x1019092dbbb0002 connected 2023-07-23 05:06:32,741 DEBUG [Listener at localhost/37217] zookeeper.ZKUtil(164): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-23 05:06:32,742 DEBUG [Listener at localhost/37217] zookeeper.ZKUtil(164): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 05:06:32,743 DEBUG [Listener at localhost/37217] zookeeper.ZKUtil(164): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-23 05:06:32,744 DEBUG [Listener at localhost/37217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44949 2023-07-23 05:06:32,745 DEBUG [Listener at localhost/37217] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44949 2023-07-23 05:06:32,745 DEBUG [Listener at localhost/37217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44949 2023-07-23 05:06:32,746 DEBUG [Listener at localhost/37217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44949 2023-07-23 05:06:32,746 DEBUG [Listener at localhost/37217] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44949 2023-07-23 05:06:32,758 INFO [Listener at localhost/37217] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-23 05:06:32,758 INFO [Listener at localhost/37217] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 05:06:32,758 INFO [Listener at localhost/37217] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-23 05:06:32,758 INFO [Listener at localhost/37217] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-23 05:06:32,758 INFO [Listener at localhost/37217] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 05:06:32,758 INFO [Listener at localhost/37217] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-23 05:06:32,758 INFO [Listener at localhost/37217] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-23 05:06:32,760 INFO [Listener at localhost/37217] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37855 2023-07-23 05:06:32,760 INFO [Listener at localhost/37217] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-23 05:06:32,761 INFO [Listener at localhost/37217] mob.MobFileCache(124): MobFileCache disabled 2023-07-23 05:06:32,762 INFO [Listener at localhost/37217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 05:06:32,764 INFO [Listener at localhost/37217] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 05:06:32,767 INFO [Listener at localhost/37217] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37855 connecting to ZooKeeper ensemble=127.0.0.1:57388 2023-07-23 05:06:32,772 DEBUG [Listener at localhost/37217] zookeeper.ZKUtil(164): regionserver:378550x0, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-23 05:06:32,772 DEBUG [Listener at localhost/37217] zookeeper.ZKUtil(164): regionserver:378550x0, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 05:06:32,773 DEBUG [Listener at localhost/37217] zookeeper.ZKUtil(164): regionserver:378550x0, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-23 05:06:32,774 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:378550x0, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-23 05:06:32,779 DEBUG [Listener at localhost/37217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37855 2023-07-23 05:06:32,780 DEBUG [Listener at localhost/37217] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37855 2023-07-23 05:06:32,780 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37855-0x1019092dbbb0003 connected 2023-07-23 05:06:32,780 DEBUG [Listener at localhost/37217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37855 2023-07-23 05:06:32,782 DEBUG [Listener at localhost/37217] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37855 2023-07-23 05:06:32,782 DEBUG [Listener at localhost/37217] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37855 2023-07-23 05:06:32,788 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,32809,1690088791154 2023-07-23 05:06:32,800 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-23 05:06:32,802 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,32809,1690088791154 2023-07-23 05:06:32,830 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-23 05:06:32,830 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-23 05:06:32,830 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-23 05:06:32,831 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-23 05:06:32,830 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 05:06:32,833 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-23 05:06:32,835 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,32809,1690088791154 from backup master directory 2023-07-23 05:06:32,835 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-23 05:06:32,842 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,32809,1690088791154 2023-07-23 05:06:32,843 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-23 05:06:32,844 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-23 05:06:32,844 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,32809,1690088791154 2023-07-23 05:06:32,848 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-23 05:06:32,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-23 05:06:32,976 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/hbase.id with ID: a2c388bd-d33a-4ba6-beca-32c8dda7c63f 2023-07-23 05:06:33,026 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 05:06:33,045 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 05:06:33,133 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x26ff111b to 127.0.0.1:57388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:06:33,199 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d5fbaa8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:06:33,231 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-23 05:06:33,233 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-23 05:06:33,257 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-23 05:06:33,257 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-23 05:06:33,260 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-23 05:06:33,266 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-23 05:06:33,268 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-23 05:06:33,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/MasterData/data/master/store-tmp 2023-07-23 05:06:33,374 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:06:33,374 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-23 05:06:33,374 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 05:06:33,374 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 05:06:33,375 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-23 05:06:33,375 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 05:06:33,375 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 05:06:33,375 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-23 05:06:33,377 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/MasterData/WALs/jenkins-hbase4.apache.org,32809,1690088791154 2023-07-23 05:06:33,402 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C32809%2C1690088791154, suffix=, logDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/MasterData/WALs/jenkins-hbase4.apache.org,32809,1690088791154, archiveDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/MasterData/oldWALs, maxLogs=10 2023-07-23 05:06:33,470 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37587,DS-49129683-d539-467d-a078-aea2fb6a2e0f,DISK] 2023-07-23 05:06:33,470 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35881,DS-573e87f4-e926-4d4e-8342-e478e1946468,DISK] 2023-07-23 05:06:33,470 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34817,DS-43e79616-8982-404d-ba59-1c5d5b1ada11,DISK] 2023-07-23 05:06:33,479 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-23 05:06:33,563 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/MasterData/WALs/jenkins-hbase4.apache.org,32809,1690088791154/jenkins-hbase4.apache.org%2C32809%2C1690088791154.1690088793413 2023-07-23 05:06:33,567 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35881,DS-573e87f4-e926-4d4e-8342-e478e1946468,DISK], DatanodeInfoWithStorage[127.0.0.1:34817,DS-43e79616-8982-404d-ba59-1c5d5b1ada11,DISK], DatanodeInfoWithStorage[127.0.0.1:37587,DS-49129683-d539-467d-a078-aea2fb6a2e0f,DISK]] 2023-07-23 05:06:33,567 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-23 05:06:33,568 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:06:33,572 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-23 05:06:33,574 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-23 05:06:33,650 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-23 05:06:33,662 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-23 05:06:33,702 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-23 05:06:33,720 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:06:33,732 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-23 05:06:33,736 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-23 05:06:33,758 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-23 05:06:33,769 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 05:06:33,771 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74188459, jitterRate=0.1054941862821579}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 05:06:33,771 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-23 05:06:33,775 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-23 05:06:33,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-23 05:06:33,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-23 05:06:33,814 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-23 05:06:33,817 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-23 05:06:33,864 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 47 msec 2023-07-23 05:06:33,864 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-23 05:06:33,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-23 05:06:33,906 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-23 05:06:33,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-23 05:06:33,942 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-23 05:06:33,943 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-23 05:06:33,951 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-23 05:06:33,958 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-23 05:06:33,962 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 05:06:33,970 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-23 05:06:33,974 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-23 05:06:33,993 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-23 05:06:34,000 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-23 05:06:34,000 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-23 05:06:34,000 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-23 05:06:34,000 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 05:06:34,000 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-23 05:06:34,008 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,32809,1690088791154, sessionid=0x1019092dbbb0000, setting cluster-up flag (Was=false) 2023-07-23 05:06:34,030 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 05:06:34,037 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-23 05:06:34,039 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,32809,1690088791154 2023-07-23 05:06:34,047 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 05:06:34,054 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-23 05:06:34,055 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,32809,1690088791154 2023-07-23 05:06:34,059 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp 2023-07-23 05:06:34,091 INFO [RS:2;jenkins-hbase4:37855] regionserver.HRegionServer(951): ClusterId : a2c388bd-d33a-4ba6-beca-32c8dda7c63f 2023-07-23 05:06:34,091 INFO [RS:0;jenkins-hbase4:45437] regionserver.HRegionServer(951): ClusterId : a2c388bd-d33a-4ba6-beca-32c8dda7c63f 2023-07-23 05:06:34,093 INFO [RS:1;jenkins-hbase4:44949] regionserver.HRegionServer(951): ClusterId : a2c388bd-d33a-4ba6-beca-32c8dda7c63f 2023-07-23 05:06:34,100 DEBUG [RS:1;jenkins-hbase4:44949] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-23 05:06:34,100 DEBUG [RS:2;jenkins-hbase4:37855] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-23 05:06:34,100 DEBUG [RS:0;jenkins-hbase4:45437] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-23 05:06:34,109 DEBUG [RS:0;jenkins-hbase4:45437] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-23 05:06:34,109 DEBUG [RS:0;jenkins-hbase4:45437] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-23 05:06:34,109 DEBUG [RS:1;jenkins-hbase4:44949] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-23 05:06:34,109 DEBUG [RS:1;jenkins-hbase4:44949] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-23 05:06:34,109 DEBUG [RS:2;jenkins-hbase4:37855] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-23 05:06:34,109 DEBUG [RS:2;jenkins-hbase4:37855] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-23 05:06:34,116 DEBUG [RS:1;jenkins-hbase4:44949] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-23 05:06:34,118 DEBUG [RS:1;jenkins-hbase4:44949] zookeeper.ReadOnlyZKClient(139): Connect 0x48fe145d to 127.0.0.1:57388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:06:34,120 DEBUG [RS:0;jenkins-hbase4:45437] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-23 05:06:34,122 DEBUG [RS:2;jenkins-hbase4:37855] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-23 05:06:34,127 DEBUG [RS:2;jenkins-hbase4:37855] zookeeper.ReadOnlyZKClient(139): Connect 0x7b050d2d to 127.0.0.1:57388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:06:34,127 DEBUG [RS:0;jenkins-hbase4:45437] zookeeper.ReadOnlyZKClient(139): Connect 0x0c5e5cea to 127.0.0.1:57388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:06:34,167 DEBUG [RS:1;jenkins-hbase4:44949] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@367aeaac, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:06:34,169 DEBUG [RS:1;jenkins-hbase4:44949] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@43f2df93, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-23 05:06:34,179 DEBUG [RS:0;jenkins-hbase4:45437] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@495cc305, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:06:34,179 DEBUG [RS:0;jenkins-hbase4:45437] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e712753, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-23 05:06:34,184 DEBUG [RS:2;jenkins-hbase4:37855] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@246de2c5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:06:34,184 DEBUG [RS:2;jenkins-hbase4:37855] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d4e6af0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-23 05:06:34,190 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-23 05:06:34,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:06:34,196 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-23 05:06:34,202 DEBUG [RS:2;jenkins-hbase4:37855] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:37855 2023-07-23 05:06:34,207 DEBUG [RS:1;jenkins-hbase4:44949] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:44949 2023-07-23 05:06:34,205 DEBUG [RS:0;jenkins-hbase4:45437] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:45437 2023-07-23 05:06:34,209 INFO [RS:0;jenkins-hbase4:45437] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-23 05:06:34,209 INFO [RS:2;jenkins-hbase4:37855] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-23 05:06:34,209 INFO [RS:2;jenkins-hbase4:37855] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-23 05:06:34,209 INFO [RS:1;jenkins-hbase4:44949] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-23 05:06:34,209 INFO [RS:1;jenkins-hbase4:44949] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-23 05:06:34,209 INFO [RS:0;jenkins-hbase4:45437] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-23 05:06:34,210 DEBUG [RS:2;jenkins-hbase4:37855] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-23 05:06:34,210 DEBUG [RS:0;jenkins-hbase4:45437] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-23 05:06:34,210 DEBUG [RS:1;jenkins-hbase4:44949] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-23 05:06:34,213 INFO [RS:2;jenkins-hbase4:37855] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:06:34,213 INFO [RS:0;jenkins-hbase4:45437] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:06:34,215 DEBUG [RS:2;jenkins-hbase4:37855] regionserver.HRegionServer(1022): About to register with Master. 2023-07-23 05:06:34,215 INFO [RS:1;jenkins-hbase4:44949] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:06:34,216 DEBUG [RS:1;jenkins-hbase4:44949] regionserver.HRegionServer(1022): About to register with Master. 2023-07-23 05:06:34,215 DEBUG [RS:0;jenkins-hbase4:45437] regionserver.HRegionServer(1022): About to register with Master. 2023-07-23 05:06:34,219 INFO [RS:1;jenkins-hbase4:44949] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,32809,1690088791154 with isa=jenkins-hbase4.apache.org/172.31.14.131:44949, startcode=1690088792720 2023-07-23 05:06:34,220 INFO [RS:0;jenkins-hbase4:45437] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,32809,1690088791154 with isa=jenkins-hbase4.apache.org/172.31.14.131:45437, startcode=1690088792660 2023-07-23 05:06:34,220 INFO [RS:2;jenkins-hbase4:37855] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,32809,1690088791154 with isa=jenkins-hbase4.apache.org/172.31.14.131:37855, startcode=1690088792757 2023-07-23 05:06:34,254 DEBUG [RS:1;jenkins-hbase4:44949] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-23 05:06:34,254 DEBUG [RS:0;jenkins-hbase4:45437] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-23 05:06:34,256 DEBUG [RS:2;jenkins-hbase4:37855] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-23 05:06:34,336 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-23 05:06:34,347 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-23 05:06:34,347 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-23 05:06:34,347 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-23 05:06:34,347 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-23 05:06:34,347 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-23 05:06:34,348 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,348 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-23 05:06:34,348 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,355 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1690088824355 2023-07-23 05:06:34,359 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46291, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-23 05:06:34,359 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60621, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-23 05:06:34,359 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-23 05:06:34,359 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57011, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-23 05:06:34,367 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-23 05:06:34,368 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-23 05:06:34,369 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32809] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-23 05:06:34,373 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-23 05:06:34,378 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-23 05:06:34,379 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32809] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-23 05:06:34,384 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32809] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-23 05:06:34,387 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-23 05:06:34,389 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-23 05:06:34,389 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-23 05:06:34,389 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-23 05:06:34,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:34,394 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-23 05:06:34,396 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-23 05:06:34,397 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-23 05:06:34,403 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-23 05:06:34,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-23 05:06:34,406 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690088794406,5,FailOnTimeoutGroup] 2023-07-23 05:06:34,406 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690088794406,5,FailOnTimeoutGroup] 2023-07-23 05:06:34,406 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:34,407 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-23 05:06:34,408 DEBUG [RS:0;jenkins-hbase4:45437] regionserver.HRegionServer(2830): Master is not running yet 2023-07-23 05:06:34,408 DEBUG [RS:1;jenkins-hbase4:44949] regionserver.HRegionServer(2830): Master is not running yet 2023-07-23 05:06:34,408 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:34,408 DEBUG [RS:2;jenkins-hbase4:37855] regionserver.HRegionServer(2830): Master is not running yet 2023-07-23 05:06:34,408 WARN [RS:1;jenkins-hbase4:44949] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-23 05:06:34,408 WARN [RS:0;jenkins-hbase4:45437] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-23 05:06:34,408 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:34,408 WARN [RS:2;jenkins-hbase4:37855] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-23 05:06:34,467 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-23 05:06:34,468 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-23 05:06:34,469 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd 2023-07-23 05:06:34,504 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:06:34,507 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-23 05:06:34,510 INFO [RS:1;jenkins-hbase4:44949] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,32809,1690088791154 with isa=jenkins-hbase4.apache.org/172.31.14.131:44949, startcode=1690088792720 2023-07-23 05:06:34,510 INFO [RS:2;jenkins-hbase4:37855] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,32809,1690088791154 with isa=jenkins-hbase4.apache.org/172.31.14.131:37855, startcode=1690088792757 2023-07-23 05:06:34,510 INFO [RS:0;jenkins-hbase4:45437] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,32809,1690088791154 with isa=jenkins-hbase4.apache.org/172.31.14.131:45437, startcode=1690088792660 2023-07-23 05:06:34,512 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/meta/1588230740/info 2023-07-23 05:06:34,513 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-23 05:06:34,514 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:06:34,514 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-23 05:06:34,516 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32809] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:06:34,519 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/meta/1588230740/rep_barrier 2023-07-23 05:06:34,519 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-23 05:06:34,520 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:06:34,521 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-23 05:06:34,523 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/meta/1588230740/table 2023-07-23 05:06:34,524 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32809] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:34,525 DEBUG [RS:2;jenkins-hbase4:37855] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd 2023-07-23 05:06:34,525 DEBUG [RS:2;jenkins-hbase4:37855] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38911 2023-07-23 05:06:34,525 DEBUG [RS:2;jenkins-hbase4:37855] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-23 05:06:34,527 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32809] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:34,527 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-23 05:06:34,528 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:06:34,530 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/meta/1588230740 2023-07-23 05:06:34,537 DEBUG [RS:1;jenkins-hbase4:44949] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd 2023-07-23 05:06:34,537 DEBUG [RS:0;jenkins-hbase4:45437] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd 2023-07-23 05:06:34,538 DEBUG [RS:1;jenkins-hbase4:44949] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38911 2023-07-23 05:06:34,538 DEBUG [RS:1;jenkins-hbase4:44949] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-23 05:06:34,538 DEBUG [RS:0;jenkins-hbase4:45437] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38911 2023-07-23 05:06:34,539 DEBUG [RS:0;jenkins-hbase4:45437] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-23 05:06:34,538 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/meta/1588230740 2023-07-23 05:06:34,540 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 05:06:34,543 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-23 05:06:34,545 DEBUG [RS:2;jenkins-hbase4:37855] zookeeper.ZKUtil(162): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:06:34,545 WARN [RS:2;jenkins-hbase4:37855] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-23 05:06:34,545 INFO [RS:2;jenkins-hbase4:37855] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-23 05:06:34,546 DEBUG [RS:2;jenkins-hbase4:37855] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/WALs/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:06:34,546 DEBUG [RS:1;jenkins-hbase4:44949] zookeeper.ZKUtil(162): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:34,547 DEBUG [RS:0;jenkins-hbase4:45437] zookeeper.ZKUtil(162): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:34,548 WARN [RS:0;jenkins-hbase4:45437] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-23 05:06:34,550 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-23 05:06:34,548 INFO [RS:0;jenkins-hbase4:45437] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-23 05:06:34,551 DEBUG [RS:0;jenkins-hbase4:45437] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/WALs/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:34,546 WARN [RS:1;jenkins-hbase4:44949] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-23 05:06:34,552 INFO [RS:1;jenkins-hbase4:44949] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-23 05:06:34,552 DEBUG [RS:1;jenkins-hbase4:44949] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/WALs/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:34,553 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37855,1690088792757] 2023-07-23 05:06:34,553 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45437,1690088792660] 2023-07-23 05:06:34,553 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44949,1690088792720] 2023-07-23 05:06:34,582 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 05:06:34,585 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60440227, jitterRate=-0.09937043488025665}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-23 05:06:34,585 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-23 05:06:34,585 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-23 05:06:34,585 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-23 05:06:34,586 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-23 05:06:34,586 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-23 05:06:34,586 DEBUG [RS:0;jenkins-hbase4:45437] zookeeper.ZKUtil(162): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:06:34,586 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-23 05:06:34,586 DEBUG [RS:2;jenkins-hbase4:37855] zookeeper.ZKUtil(162): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:06:34,586 DEBUG [RS:1;jenkins-hbase4:44949] zookeeper.ZKUtil(162): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:06:34,586 DEBUG [RS:0;jenkins-hbase4:45437] zookeeper.ZKUtil(162): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:34,587 DEBUG [RS:2;jenkins-hbase4:37855] zookeeper.ZKUtil(162): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:34,587 DEBUG [RS:1;jenkins-hbase4:44949] zookeeper.ZKUtil(162): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:34,587 DEBUG [RS:0;jenkins-hbase4:45437] zookeeper.ZKUtil(162): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:34,588 DEBUG [RS:2;jenkins-hbase4:37855] zookeeper.ZKUtil(162): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:34,588 DEBUG [RS:1;jenkins-hbase4:44949] zookeeper.ZKUtil(162): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:34,592 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-23 05:06:34,592 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-23 05:06:34,600 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-23 05:06:34,600 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-23 05:06:34,605 DEBUG [RS:0;jenkins-hbase4:45437] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-23 05:06:34,605 DEBUG [RS:1;jenkins-hbase4:44949] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-23 05:06:34,605 DEBUG [RS:2;jenkins-hbase4:37855] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-23 05:06:34,613 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-23 05:06:34,618 INFO [RS:1;jenkins-hbase4:44949] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-23 05:06:34,618 INFO [RS:0;jenkins-hbase4:45437] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-23 05:06:34,619 INFO [RS:2;jenkins-hbase4:37855] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-23 05:06:34,633 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-23 05:06:34,637 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-23 05:06:34,660 INFO [RS:1;jenkins-hbase4:44949] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-23 05:06:34,660 INFO [RS:2;jenkins-hbase4:37855] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-23 05:06:34,671 INFO [RS:0;jenkins-hbase4:45437] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-23 05:06:34,681 INFO [RS:1;jenkins-hbase4:44949] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-23 05:06:34,681 INFO [RS:2;jenkins-hbase4:37855] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-23 05:06:34,682 INFO [RS:1;jenkins-hbase4:44949] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:34,682 INFO [RS:0;jenkins-hbase4:45437] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-23 05:06:34,682 INFO [RS:2;jenkins-hbase4:37855] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:34,683 INFO [RS:0;jenkins-hbase4:45437] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:34,687 INFO [RS:1;jenkins-hbase4:44949] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-23 05:06:34,687 INFO [RS:0;jenkins-hbase4:45437] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-23 05:06:34,689 INFO [RS:2;jenkins-hbase4:37855] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-23 05:06:34,702 INFO [RS:2;jenkins-hbase4:37855] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:34,702 INFO [RS:0;jenkins-hbase4:45437] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:34,702 INFO [RS:1;jenkins-hbase4:44949] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:34,703 DEBUG [RS:2;jenkins-hbase4:37855] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,703 DEBUG [RS:0;jenkins-hbase4:45437] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,703 DEBUG [RS:2;jenkins-hbase4:37855] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,704 DEBUG [RS:0;jenkins-hbase4:45437] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,704 DEBUG [RS:2;jenkins-hbase4:37855] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,704 DEBUG [RS:0;jenkins-hbase4:45437] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,704 DEBUG [RS:2;jenkins-hbase4:37855] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,704 DEBUG [RS:0;jenkins-hbase4:45437] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,703 DEBUG [RS:1;jenkins-hbase4:44949] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,704 DEBUG [RS:0;jenkins-hbase4:45437] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,704 DEBUG [RS:1;jenkins-hbase4:44949] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,704 DEBUG [RS:0;jenkins-hbase4:45437] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-23 05:06:34,704 DEBUG [RS:1;jenkins-hbase4:44949] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,704 DEBUG [RS:0;jenkins-hbase4:45437] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,704 DEBUG [RS:1;jenkins-hbase4:44949] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,705 DEBUG [RS:0;jenkins-hbase4:45437] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,705 DEBUG [RS:1;jenkins-hbase4:44949] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,705 DEBUG [RS:0;jenkins-hbase4:45437] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,705 DEBUG [RS:1;jenkins-hbase4:44949] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-23 05:06:34,705 DEBUG [RS:1;jenkins-hbase4:44949] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,705 DEBUG [RS:1;jenkins-hbase4:44949] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,704 DEBUG [RS:2;jenkins-hbase4:37855] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,705 DEBUG [RS:1;jenkins-hbase4:44949] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,706 DEBUG [RS:2;jenkins-hbase4:37855] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-23 05:06:34,706 DEBUG [RS:1;jenkins-hbase4:44949] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,706 DEBUG [RS:2;jenkins-hbase4:37855] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,706 DEBUG [RS:2;jenkins-hbase4:37855] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,706 DEBUG [RS:2;jenkins-hbase4:37855] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,706 DEBUG [RS:2;jenkins-hbase4:37855] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,705 DEBUG [RS:0;jenkins-hbase4:45437] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 05:06:34,724 INFO [RS:0;jenkins-hbase4:45437] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:34,725 INFO [RS:0;jenkins-hbase4:45437] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:34,725 INFO [RS:0;jenkins-hbase4:45437] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:34,733 INFO [RS:2;jenkins-hbase4:37855] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:34,733 INFO [RS:2;jenkins-hbase4:37855] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:34,733 INFO [RS:2;jenkins-hbase4:37855] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:34,738 INFO [RS:1;jenkins-hbase4:44949] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:34,739 INFO [RS:1;jenkins-hbase4:44949] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:34,739 INFO [RS:1;jenkins-hbase4:44949] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:34,745 INFO [RS:0;jenkins-hbase4:45437] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-23 05:06:34,749 INFO [RS:0;jenkins-hbase4:45437] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45437,1690088792660-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:34,756 INFO [RS:2;jenkins-hbase4:37855] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-23 05:06:34,757 INFO [RS:2;jenkins-hbase4:37855] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37855,1690088792757-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:34,757 INFO [RS:1;jenkins-hbase4:44949] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-23 05:06:34,758 INFO [RS:1;jenkins-hbase4:44949] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44949,1690088792720-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:34,789 DEBUG [jenkins-hbase4:32809] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-23 05:06:34,798 DEBUG [jenkins-hbase4:32809] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 05:06:34,798 INFO [RS:2;jenkins-hbase4:37855] regionserver.Replication(203): jenkins-hbase4.apache.org,37855,1690088792757 started 2023-07-23 05:06:34,799 INFO [RS:2;jenkins-hbase4:37855] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,37855,1690088792757, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37855, sessionid=0x1019092dbbb0003 2023-07-23 05:06:34,800 DEBUG [RS:2;jenkins-hbase4:37855] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-23 05:06:34,800 DEBUG [RS:2;jenkins-hbase4:37855] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:06:34,800 DEBUG [RS:2;jenkins-hbase4:37855] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37855,1690088792757' 2023-07-23 05:06:34,800 DEBUG [RS:2;jenkins-hbase4:37855] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-23 05:06:34,800 INFO [RS:0;jenkins-hbase4:45437] regionserver.Replication(203): jenkins-hbase4.apache.org,45437,1690088792660 started 2023-07-23 05:06:34,800 INFO [RS:0;jenkins-hbase4:45437] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,45437,1690088792660, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45437, sessionid=0x1019092dbbb0001 2023-07-23 05:06:34,802 DEBUG [RS:2;jenkins-hbase4:37855] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-23 05:06:34,803 DEBUG [RS:2;jenkins-hbase4:37855] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-23 05:06:34,803 DEBUG [RS:2;jenkins-hbase4:37855] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-23 05:06:34,803 DEBUG [RS:2;jenkins-hbase4:37855] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:06:34,803 DEBUG [RS:2;jenkins-hbase4:37855] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37855,1690088792757' 2023-07-23 05:06:34,804 DEBUG [RS:2;jenkins-hbase4:37855] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:06:34,804 DEBUG [RS:2;jenkins-hbase4:37855] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:06:34,805 DEBUG [RS:2;jenkins-hbase4:37855] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-23 05:06:34,805 INFO [RS:2;jenkins-hbase4:37855] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-23 05:06:34,805 INFO [RS:2;jenkins-hbase4:37855] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-23 05:06:34,816 DEBUG [jenkins-hbase4:32809] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 05:06:34,816 DEBUG [jenkins-hbase4:32809] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 05:06:34,816 DEBUG [jenkins-hbase4:32809] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 05:06:34,816 DEBUG [jenkins-hbase4:32809] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 05:06:34,818 INFO [RS:1;jenkins-hbase4:44949] regionserver.Replication(203): jenkins-hbase4.apache.org,44949,1690088792720 started 2023-07-23 05:06:34,818 DEBUG [RS:0;jenkins-hbase4:45437] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-23 05:06:34,819 INFO [RS:1;jenkins-hbase4:44949] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,44949,1690088792720, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44949, sessionid=0x1019092dbbb0002 2023-07-23 05:06:34,819 DEBUG [RS:0;jenkins-hbase4:45437] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:34,820 DEBUG [RS:1;jenkins-hbase4:44949] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-23 05:06:34,821 DEBUG [RS:1;jenkins-hbase4:44949] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:34,821 DEBUG [RS:1;jenkins-hbase4:44949] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44949,1690088792720' 2023-07-23 05:06:34,821 DEBUG [RS:1;jenkins-hbase4:44949] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-23 05:06:34,820 DEBUG [RS:0;jenkins-hbase4:45437] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45437,1690088792660' 2023-07-23 05:06:34,821 DEBUG [RS:0;jenkins-hbase4:45437] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-23 05:06:34,822 DEBUG [RS:0;jenkins-hbase4:45437] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-23 05:06:34,822 DEBUG [RS:1;jenkins-hbase4:44949] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-23 05:06:34,823 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44949,1690088792720, state=OPENING 2023-07-23 05:06:34,823 DEBUG [RS:1;jenkins-hbase4:44949] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-23 05:06:34,823 DEBUG [RS:1;jenkins-hbase4:44949] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-23 05:06:34,823 DEBUG [RS:0;jenkins-hbase4:45437] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-23 05:06:34,823 DEBUG [RS:0;jenkins-hbase4:45437] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-23 05:06:34,823 DEBUG [RS:1;jenkins-hbase4:44949] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:34,831 DEBUG [RS:1;jenkins-hbase4:44949] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44949,1690088792720' 2023-07-23 05:06:34,831 DEBUG [RS:1;jenkins-hbase4:44949] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:06:34,823 DEBUG [RS:0;jenkins-hbase4:45437] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:34,831 DEBUG [RS:0;jenkins-hbase4:45437] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45437,1690088792660' 2023-07-23 05:06:34,831 DEBUG [RS:0;jenkins-hbase4:45437] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:06:34,832 DEBUG [RS:1;jenkins-hbase4:44949] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:06:34,832 DEBUG [RS:0;jenkins-hbase4:45437] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:06:34,833 DEBUG [RS:1;jenkins-hbase4:44949] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-23 05:06:34,833 INFO [RS:1;jenkins-hbase4:44949] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-23 05:06:34,839 INFO [RS:1;jenkins-hbase4:44949] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-23 05:06:34,840 DEBUG [RS:0;jenkins-hbase4:45437] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-23 05:06:34,840 INFO [RS:0;jenkins-hbase4:45437] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-23 05:06:34,840 INFO [RS:0;jenkins-hbase4:45437] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-23 05:06:34,841 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-23 05:06:34,844 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 05:06:34,845 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-23 05:06:34,851 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44949,1690088792720}] 2023-07-23 05:06:34,919 INFO [RS:2;jenkins-hbase4:37855] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37855%2C1690088792757, suffix=, logDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/WALs/jenkins-hbase4.apache.org,37855,1690088792757, archiveDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/oldWALs, maxLogs=32 2023-07-23 05:06:34,947 INFO [RS:0;jenkins-hbase4:45437] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45437%2C1690088792660, suffix=, logDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/WALs/jenkins-hbase4.apache.org,45437,1690088792660, archiveDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/oldWALs, maxLogs=32 2023-07-23 05:06:34,948 INFO [RS:1;jenkins-hbase4:44949] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44949%2C1690088792720, suffix=, logDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/WALs/jenkins-hbase4.apache.org,44949,1690088792720, archiveDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/oldWALs, maxLogs=32 2023-07-23 05:06:34,948 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34817,DS-43e79616-8982-404d-ba59-1c5d5b1ada11,DISK] 2023-07-23 05:06:34,948 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37587,DS-49129683-d539-467d-a078-aea2fb6a2e0f,DISK] 2023-07-23 05:06:34,948 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35881,DS-573e87f4-e926-4d4e-8342-e478e1946468,DISK] 2023-07-23 05:06:34,964 INFO [RS:2;jenkins-hbase4:37855] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/WALs/jenkins-hbase4.apache.org,37855,1690088792757/jenkins-hbase4.apache.org%2C37855%2C1690088792757.1690088794921 2023-07-23 05:06:34,965 DEBUG [RS:2;jenkins-hbase4:37855] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37587,DS-49129683-d539-467d-a078-aea2fb6a2e0f,DISK], DatanodeInfoWithStorage[127.0.0.1:34817,DS-43e79616-8982-404d-ba59-1c5d5b1ada11,DISK], DatanodeInfoWithStorage[127.0.0.1:35881,DS-573e87f4-e926-4d4e-8342-e478e1946468,DISK]] 2023-07-23 05:06:35,012 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37587,DS-49129683-d539-467d-a078-aea2fb6a2e0f,DISK] 2023-07-23 05:06:35,012 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34817,DS-43e79616-8982-404d-ba59-1c5d5b1ada11,DISK] 2023-07-23 05:06:35,012 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35881,DS-573e87f4-e926-4d4e-8342-e478e1946468,DISK] 2023-07-23 05:06:35,014 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35881,DS-573e87f4-e926-4d4e-8342-e478e1946468,DISK] 2023-07-23 05:06:35,014 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34817,DS-43e79616-8982-404d-ba59-1c5d5b1ada11,DISK] 2023-07-23 05:06:35,019 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37587,DS-49129683-d539-467d-a078-aea2fb6a2e0f,DISK] 2023-07-23 05:06:35,058 INFO [RS:0;jenkins-hbase4:45437] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/WALs/jenkins-hbase4.apache.org,45437,1690088792660/jenkins-hbase4.apache.org%2C45437%2C1690088792660.1690088794949 2023-07-23 05:06:35,060 INFO [RS:1;jenkins-hbase4:44949] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/WALs/jenkins-hbase4.apache.org,44949,1690088792720/jenkins-hbase4.apache.org%2C44949%2C1690088792720.1690088794950 2023-07-23 05:06:35,071 DEBUG [RS:1;jenkins-hbase4:44949] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34817,DS-43e79616-8982-404d-ba59-1c5d5b1ada11,DISK], DatanodeInfoWithStorage[127.0.0.1:37587,DS-49129683-d539-467d-a078-aea2fb6a2e0f,DISK], DatanodeInfoWithStorage[127.0.0.1:35881,DS-573e87f4-e926-4d4e-8342-e478e1946468,DISK]] 2023-07-23 05:06:35,071 DEBUG [RS:0;jenkins-hbase4:45437] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34817,DS-43e79616-8982-404d-ba59-1c5d5b1ada11,DISK], DatanodeInfoWithStorage[127.0.0.1:35881,DS-573e87f4-e926-4d4e-8342-e478e1946468,DISK], DatanodeInfoWithStorage[127.0.0.1:37587,DS-49129683-d539-467d-a078-aea2fb6a2e0f,DISK]] 2023-07-23 05:06:35,103 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:35,107 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-23 05:06:35,112 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40660, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-23 05:06:35,134 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-23 05:06:35,134 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-23 05:06:35,139 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44949%2C1690088792720.meta, suffix=.meta, logDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/WALs/jenkins-hbase4.apache.org,44949,1690088792720, archiveDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/oldWALs, maxLogs=32 2023-07-23 05:06:35,161 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35881,DS-573e87f4-e926-4d4e-8342-e478e1946468,DISK] 2023-07-23 05:06:35,162 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34817,DS-43e79616-8982-404d-ba59-1c5d5b1ada11,DISK] 2023-07-23 05:06:35,166 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37587,DS-49129683-d539-467d-a078-aea2fb6a2e0f,DISK] 2023-07-23 05:06:35,178 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/WALs/jenkins-hbase4.apache.org,44949,1690088792720/jenkins-hbase4.apache.org%2C44949%2C1690088792720.meta.1690088795140.meta 2023-07-23 05:06:35,178 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35881,DS-573e87f4-e926-4d4e-8342-e478e1946468,DISK], DatanodeInfoWithStorage[127.0.0.1:34817,DS-43e79616-8982-404d-ba59-1c5d5b1ada11,DISK], DatanodeInfoWithStorage[127.0.0.1:37587,DS-49129683-d539-467d-a078-aea2fb6a2e0f,DISK]] 2023-07-23 05:06:35,179 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-23 05:06:35,180 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-23 05:06:35,181 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:06:35,182 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-23 05:06:35,185 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-23 05:06:35,187 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-23 05:06:35,200 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-23 05:06:35,200 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:06:35,201 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-23 05:06:35,201 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-23 05:06:35,204 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-23 05:06:35,208 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/meta/1588230740/info 2023-07-23 05:06:35,208 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/meta/1588230740/info 2023-07-23 05:06:35,209 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-23 05:06:35,210 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:06:35,210 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-23 05:06:35,212 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/meta/1588230740/rep_barrier 2023-07-23 05:06:35,212 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/meta/1588230740/rep_barrier 2023-07-23 05:06:35,213 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-23 05:06:35,214 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:06:35,214 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-23 05:06:35,216 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/meta/1588230740/table 2023-07-23 05:06:35,216 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/meta/1588230740/table 2023-07-23 05:06:35,216 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-23 05:06:35,218 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:06:35,220 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/meta/1588230740 2023-07-23 05:06:35,229 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/meta/1588230740 2023-07-23 05:06:35,234 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-23 05:06:35,237 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-23 05:06:35,238 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60231169, jitterRate=-0.10248564183712006}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-23 05:06:35,241 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-23 05:06:35,259 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1690088795093 2023-07-23 05:06:35,288 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-23 05:06:35,289 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-23 05:06:35,292 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44949,1690088792720, state=OPEN 2023-07-23 05:06:35,296 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-23 05:06:35,296 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-23 05:06:35,303 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-23 05:06:35,303 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44949,1690088792720 in 446 msec 2023-07-23 05:06:35,310 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-23 05:06:35,311 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 692 msec 2023-07-23 05:06:35,318 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1110 sec 2023-07-23 05:06:35,319 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1690088795319, completionTime=-1 2023-07-23 05:06:35,319 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-23 05:06:35,319 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-23 05:06:35,434 DEBUG [hconnection-0x76a1f2b0-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:06:35,442 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40670, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:06:35,477 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-23 05:06:35,477 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1690088855477 2023-07-23 05:06:35,477 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1690088915477 2023-07-23 05:06:35,477 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 158 msec 2023-07-23 05:06:35,508 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32809,1690088791154-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:35,508 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32809,1690088791154-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:35,508 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32809,1690088791154-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:35,511 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:32809, period=300000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:35,512 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-23 05:06:35,524 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-23 05:06:35,536 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-23 05:06:35,537 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-23 05:06:35,548 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-23 05:06:35,552 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 05:06:35,555 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 05:06:35,591 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/hbase/namespace/b436f5555f6fd67c866f08a780730e90 2023-07-23 05:06:35,594 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/hbase/namespace/b436f5555f6fd67c866f08a780730e90 empty. 2023-07-23 05:06:35,595 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/hbase/namespace/b436f5555f6fd67c866f08a780730e90 2023-07-23 05:06:35,595 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-23 05:06:35,653 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-23 05:06:35,656 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => b436f5555f6fd67c866f08a780730e90, NAME => 'hbase:namespace,,1690088795537.b436f5555f6fd67c866f08a780730e90.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp 2023-07-23 05:06:35,687 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690088795537.b436f5555f6fd67c866f08a780730e90.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:06:35,687 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing b436f5555f6fd67c866f08a780730e90, disabling compactions & flushes 2023-07-23 05:06:35,687 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690088795537.b436f5555f6fd67c866f08a780730e90. 2023-07-23 05:06:35,687 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690088795537.b436f5555f6fd67c866f08a780730e90. 2023-07-23 05:06:35,687 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690088795537.b436f5555f6fd67c866f08a780730e90. after waiting 0 ms 2023-07-23 05:06:35,687 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690088795537.b436f5555f6fd67c866f08a780730e90. 2023-07-23 05:06:35,687 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690088795537.b436f5555f6fd67c866f08a780730e90. 2023-07-23 05:06:35,687 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for b436f5555f6fd67c866f08a780730e90: 2023-07-23 05:06:35,693 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 05:06:35,716 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1690088795537.b436f5555f6fd67c866f08a780730e90.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690088795697"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088795697"}]},"ts":"1690088795697"} 2023-07-23 05:06:35,753 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-23 05:06:35,756 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 05:06:35,761 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088795756"}]},"ts":"1690088795756"} 2023-07-23 05:06:35,767 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-23 05:06:35,773 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 05:06:35,776 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 05:06:35,776 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 05:06:35,776 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 05:06:35,776 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 05:06:35,780 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=b436f5555f6fd67c866f08a780730e90, ASSIGN}] 2023-07-23 05:06:35,785 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=b436f5555f6fd67c866f08a780730e90, ASSIGN 2023-07-23 05:06:35,787 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=b436f5555f6fd67c866f08a780730e90, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44949,1690088792720; forceNewPlan=false, retain=false 2023-07-23 05:06:35,940 INFO [jenkins-hbase4:32809] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-23 05:06:35,941 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=b436f5555f6fd67c866f08a780730e90, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:35,941 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1690088795537.b436f5555f6fd67c866f08a780730e90.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690088795941"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088795941"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088795941"}]},"ts":"1690088795941"} 2023-07-23 05:06:35,947 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure b436f5555f6fd67c866f08a780730e90, server=jenkins-hbase4.apache.org,44949,1690088792720}] 2023-07-23 05:06:36,122 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1690088795537.b436f5555f6fd67c866f08a780730e90. 2023-07-23 05:06:36,122 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b436f5555f6fd67c866f08a780730e90, NAME => 'hbase:namespace,,1690088795537.b436f5555f6fd67c866f08a780730e90.', STARTKEY => '', ENDKEY => ''} 2023-07-23 05:06:36,122 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1690088795537.b436f5555f6fd67c866f08a780730e90. service=AccessControlService 2023-07-23 05:06:36,123 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:06:36,124 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace b436f5555f6fd67c866f08a780730e90 2023-07-23 05:06:36,124 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690088795537.b436f5555f6fd67c866f08a780730e90.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:06:36,124 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b436f5555f6fd67c866f08a780730e90 2023-07-23 05:06:36,124 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b436f5555f6fd67c866f08a780730e90 2023-07-23 05:06:36,127 INFO [StoreOpener-b436f5555f6fd67c866f08a780730e90-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region b436f5555f6fd67c866f08a780730e90 2023-07-23 05:06:36,130 DEBUG [StoreOpener-b436f5555f6fd67c866f08a780730e90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/namespace/b436f5555f6fd67c866f08a780730e90/info 2023-07-23 05:06:36,130 DEBUG [StoreOpener-b436f5555f6fd67c866f08a780730e90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/namespace/b436f5555f6fd67c866f08a780730e90/info 2023-07-23 05:06:36,131 INFO [StoreOpener-b436f5555f6fd67c866f08a780730e90-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b436f5555f6fd67c866f08a780730e90 columnFamilyName info 2023-07-23 05:06:36,132 INFO [StoreOpener-b436f5555f6fd67c866f08a780730e90-1] regionserver.HStore(310): Store=b436f5555f6fd67c866f08a780730e90/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:06:36,134 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/namespace/b436f5555f6fd67c866f08a780730e90 2023-07-23 05:06:36,135 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/namespace/b436f5555f6fd67c866f08a780730e90 2023-07-23 05:06:36,141 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b436f5555f6fd67c866f08a780730e90 2023-07-23 05:06:36,144 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/namespace/b436f5555f6fd67c866f08a780730e90/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 05:06:36,145 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b436f5555f6fd67c866f08a780730e90; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75383548, jitterRate=0.1233024001121521}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 05:06:36,146 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b436f5555f6fd67c866f08a780730e90: 2023-07-23 05:06:36,148 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1690088795537.b436f5555f6fd67c866f08a780730e90., pid=6, masterSystemTime=1690088796113 2023-07-23 05:06:36,153 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1690088795537.b436f5555f6fd67c866f08a780730e90. 2023-07-23 05:06:36,153 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1690088795537.b436f5555f6fd67c866f08a780730e90. 2023-07-23 05:06:36,154 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=b436f5555f6fd67c866f08a780730e90, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:36,155 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1690088795537.b436f5555f6fd67c866f08a780730e90.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690088796153"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690088796153"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690088796153"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690088796153"}]},"ts":"1690088796153"} 2023-07-23 05:06:36,164 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-23 05:06:36,164 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure b436f5555f6fd67c866f08a780730e90, server=jenkins-hbase4.apache.org,44949,1690088792720 in 213 msec 2023-07-23 05:06:36,168 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-23 05:06:36,169 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=b436f5555f6fd67c866f08a780730e90, ASSIGN in 384 msec 2023-07-23 05:06:36,170 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 05:06:36,170 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088796170"}]},"ts":"1690088796170"} 2023-07-23 05:06:36,174 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-23 05:06:36,178 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 05:06:36,180 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 640 msec 2023-07-23 05:06:36,251 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-23 05:06:36,253 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-23 05:06:36,253 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 05:06:36,294 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-23 05:06:36,322 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-23 05:06:36,331 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 48 msec 2023-07-23 05:06:36,338 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-23 05:06:36,350 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-23 05:06:36,356 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-07-23 05:06:36,365 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-23 05:06:36,367 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-23 05:06:36,368 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.524sec 2023-07-23 05:06:36,371 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-23 05:06:36,373 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-23 05:06:36,373 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-23 05:06:36,374 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32809,1690088791154-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-23 05:06:36,375 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32809,1690088791154-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-23 05:06:36,396 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-23 05:06:36,398 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-23 05:06:36,401 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 05:06:36,401 DEBUG [Listener at localhost/37217] zookeeper.ReadOnlyZKClient(139): Connect 0x543dfa23 to 127.0.0.1:57388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:06:36,403 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 05:06:36,406 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-23 05:06:36,409 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/hbase/acl/50be53dc87e8bcba1c8172066674b195 2023-07-23 05:06:36,411 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/hbase/acl/50be53dc87e8bcba1c8172066674b195 empty. 2023-07-23 05:06:36,413 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/hbase/acl/50be53dc87e8bcba1c8172066674b195 2023-07-23 05:06:36,413 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-23 05:06:36,414 DEBUG [Listener at localhost/37217] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17ce1483, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:06:36,415 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-23 05:06:36,442 DEBUG [hconnection-0x462f8946-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:06:36,445 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-23 05:06:36,447 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 50be53dc87e8bcba1c8172066674b195, NAME => 'hbase:acl,,1690088796392.50be53dc87e8bcba1c8172066674b195.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp 2023-07-23 05:06:36,457 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40674, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:06:36,460 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,32809,1690088791154 2023-07-23 05:06:36,462 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-23 05:06:36,463 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/test.cache.data in system properties and HBase conf 2023-07-23 05:06:36,463 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/hadoop.tmp.dir in system properties and HBase conf 2023-07-23 05:06:36,463 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/hadoop.log.dir in system properties and HBase conf 2023-07-23 05:06:36,463 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-23 05:06:36,463 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-23 05:06:36,463 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-23 05:06:36,464 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-23 05:06:36,464 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-23 05:06:36,464 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-23 05:06:36,464 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-23 05:06:36,464 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-23 05:06:36,464 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-23 05:06:36,464 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-23 05:06:36,464 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-23 05:06:36,464 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-23 05:06:36,464 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/nfs.dump.dir in system properties and HBase conf 2023-07-23 05:06:36,464 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/java.io.tmpdir in system properties and HBase conf 2023-07-23 05:06:36,465 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-23 05:06:36,465 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-23 05:06:36,465 INFO [Listener at localhost/37217] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-23 05:06:36,484 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690088796392.50be53dc87e8bcba1c8172066674b195.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:06:36,484 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 50be53dc87e8bcba1c8172066674b195, disabling compactions & flushes 2023-07-23 05:06:36,484 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690088796392.50be53dc87e8bcba1c8172066674b195. 2023-07-23 05:06:36,484 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690088796392.50be53dc87e8bcba1c8172066674b195. 2023-07-23 05:06:36,484 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690088796392.50be53dc87e8bcba1c8172066674b195. after waiting 0 ms 2023-07-23 05:06:36,484 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690088796392.50be53dc87e8bcba1c8172066674b195. 2023-07-23 05:06:36,484 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1690088796392.50be53dc87e8bcba1c8172066674b195. 2023-07-23 05:06:36,484 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 50be53dc87e8bcba1c8172066674b195: 2023-07-23 05:06:36,492 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 05:06:36,494 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1690088796392.50be53dc87e8bcba1c8172066674b195.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690088796494"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088796494"}]},"ts":"1690088796494"} 2023-07-23 05:06:36,498 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-23 05:06:36,500 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 05:06:36,501 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088796500"}]},"ts":"1690088796500"} 2023-07-23 05:06:36,503 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-23 05:06:36,509 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 05:06:36,510 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 05:06:36,510 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 05:06:36,510 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 05:06:36,510 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 05:06:36,510 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=50be53dc87e8bcba1c8172066674b195, ASSIGN}] 2023-07-23 05:06:36,515 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=50be53dc87e8bcba1c8172066674b195, ASSIGN 2023-07-23 05:06:36,521 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-23 05:06:36,521 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=50be53dc87e8bcba1c8172066674b195, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45437,1690088792660; forceNewPlan=false, retain=false 2023-07-23 05:06:36,688 INFO [jenkins-hbase4:32809] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-23 05:06:36,689 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=50be53dc87e8bcba1c8172066674b195, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:36,689 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1690088796392.50be53dc87e8bcba1c8172066674b195.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690088796689"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088796689"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088796689"}]},"ts":"1690088796689"} 2023-07-23 05:06:36,697 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 50be53dc87e8bcba1c8172066674b195, server=jenkins-hbase4.apache.org,45437,1690088792660}] 2023-07-23 05:06:36,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-23 05:06:36,854 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:36,855 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-23 05:06:36,861 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33860, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-23 05:06:36,870 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1690088796392.50be53dc87e8bcba1c8172066674b195. 2023-07-23 05:06:36,870 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 50be53dc87e8bcba1c8172066674b195, NAME => 'hbase:acl,,1690088796392.50be53dc87e8bcba1c8172066674b195.', STARTKEY => '', ENDKEY => ''} 2023-07-23 05:06:36,871 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1690088796392.50be53dc87e8bcba1c8172066674b195. service=AccessControlService 2023-07-23 05:06:36,871 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:06:36,871 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 50be53dc87e8bcba1c8172066674b195 2023-07-23 05:06:36,872 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690088796392.50be53dc87e8bcba1c8172066674b195.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:06:36,872 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 50be53dc87e8bcba1c8172066674b195 2023-07-23 05:06:36,872 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 50be53dc87e8bcba1c8172066674b195 2023-07-23 05:06:36,876 INFO [StoreOpener-50be53dc87e8bcba1c8172066674b195-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 50be53dc87e8bcba1c8172066674b195 2023-07-23 05:06:36,880 DEBUG [StoreOpener-50be53dc87e8bcba1c8172066674b195-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/acl/50be53dc87e8bcba1c8172066674b195/l 2023-07-23 05:06:36,880 DEBUG [StoreOpener-50be53dc87e8bcba1c8172066674b195-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/acl/50be53dc87e8bcba1c8172066674b195/l 2023-07-23 05:06:36,881 INFO [StoreOpener-50be53dc87e8bcba1c8172066674b195-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 50be53dc87e8bcba1c8172066674b195 columnFamilyName l 2023-07-23 05:06:36,882 INFO [StoreOpener-50be53dc87e8bcba1c8172066674b195-1] regionserver.HStore(310): Store=50be53dc87e8bcba1c8172066674b195/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:06:36,884 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/acl/50be53dc87e8bcba1c8172066674b195 2023-07-23 05:06:36,894 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/acl/50be53dc87e8bcba1c8172066674b195 2023-07-23 05:06:36,903 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 50be53dc87e8bcba1c8172066674b195 2023-07-23 05:06:36,915 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/acl/50be53dc87e8bcba1c8172066674b195/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 05:06:36,916 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 50be53dc87e8bcba1c8172066674b195; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73583651, jitterRate=0.09648184478282928}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 05:06:36,917 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 50be53dc87e8bcba1c8172066674b195: 2023-07-23 05:06:36,918 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1690088796392.50be53dc87e8bcba1c8172066674b195., pid=11, masterSystemTime=1690088796854 2023-07-23 05:06:36,924 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1690088796392.50be53dc87e8bcba1c8172066674b195. 2023-07-23 05:06:36,924 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1690088796392.50be53dc87e8bcba1c8172066674b195. 2023-07-23 05:06:36,925 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=50be53dc87e8bcba1c8172066674b195, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:36,926 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1690088796392.50be53dc87e8bcba1c8172066674b195.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690088796925"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690088796925"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690088796925"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690088796925"}]},"ts":"1690088796925"} 2023-07-23 05:06:36,934 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-23 05:06:36,934 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 50be53dc87e8bcba1c8172066674b195, server=jenkins-hbase4.apache.org,45437,1690088792660 in 233 msec 2023-07-23 05:06:36,942 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-23 05:06:36,942 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=50be53dc87e8bcba1c8172066674b195, ASSIGN in 424 msec 2023-07-23 05:06:36,943 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 05:06:36,944 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088796944"}]},"ts":"1690088796944"} 2023-07-23 05:06:36,947 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-23 05:06:36,951 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 05:06:36,959 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 555 msec 2023-07-23 05:06:37,022 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-23 05:06:37,022 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-23 05:06:37,042 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-23 05:06:37,731 WARN [Thread-384] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 05:06:38,053 INFO [Thread-384] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 05:06:38,059 INFO [Thread-384] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_43271_jobhistory____ej5hxy/webapp 2023-07-23 05:06:38,212 INFO [Thread-384] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-23 05:06:38,213 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-23 05:06:38,213 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-23 05:06:38,216 INFO [Thread-384] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-23 05:06:38,280 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 05:06:38,565 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 05:06:38,855 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-23 05:06:38,894 INFO [Thread-384] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:43271 2023-07-23 05:06:39,229 WARN [Listener at jenkins-hbase4.apache.org/36481] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 05:06:39,648 WARN [Listener at jenkins-hbase4.apache.org/36481] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-23 05:06:39,649 INFO [Listener at jenkins-hbase4.apache.org/36481] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 05:06:39,671 INFO [Listener at jenkins-hbase4.apache.org/36481] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35211_cluster____9h68ac/webapp 2023-07-23 05:06:39,765 INFO [Listener at jenkins-hbase4.apache.org/36481] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-23 05:06:39,765 INFO [Listener at jenkins-hbase4.apache.org/36481] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-23 05:06:39,765 INFO [Listener at jenkins-hbase4.apache.org/36481] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-23 05:06:39,766 INFO [Listener at jenkins-hbase4.apache.org/36481] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-23 05:06:39,778 INFO [Listener at jenkins-hbase4.apache.org/36481] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 05:06:40,012 INFO [Listener at jenkins-hbase4.apache.org/36481] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 05:06:40,159 INFO [Listener at jenkins-hbase4.apache.org/36481] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 05:06:40,170 INFO [Listener at jenkins-hbase4.apache.org/36481] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35211 2023-07-23 05:06:40,642 WARN [Listener at jenkins-hbase4.apache.org/34107] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 05:06:40,665 WARN [Listener at jenkins-hbase4.apache.org/34107] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-23 05:06:40,666 INFO [Listener at jenkins-hbase4.apache.org/34107] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 05:06:40,672 INFO [Listener at jenkins-hbase4.apache.org/34107] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_44379_node____tlvehf/webapp 2023-07-23 05:06:40,727 INFO [Listener at jenkins-hbase4.apache.org/34107] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-23 05:06:40,727 INFO [Listener at jenkins-hbase4.apache.org/34107] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-23 05:06:40,728 INFO [Listener at jenkins-hbase4.apache.org/34107] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-23 05:06:40,728 INFO [Listener at jenkins-hbase4.apache.org/34107] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-23 05:06:40,738 INFO [Listener at jenkins-hbase4.apache.org/34107] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 05:06:40,765 INFO [Listener at jenkins-hbase4.apache.org/34107] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 05:06:40,809 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 05:06:40,884 INFO [Listener at jenkins-hbase4.apache.org/34107] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 05:06:40,897 INFO [Listener at jenkins-hbase4.apache.org/34107] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:44379 2023-07-23 05:06:40,935 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-23 05:06:40,937 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-23 05:06:40,938 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-23 05:06:41,093 WARN [Listener at jenkins-hbase4.apache.org/33827] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 05:06:41,098 WARN [Listener at jenkins-hbase4.apache.org/33827] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-23 05:06:41,099 INFO [Listener at jenkins-hbase4.apache.org/33827] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 05:06:41,104 INFO [Listener at jenkins-hbase4.apache.org/33827] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_43701_node____sf8xcn/webapp 2023-07-23 05:06:41,153 INFO [Listener at jenkins-hbase4.apache.org/33827] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-23 05:06:41,153 INFO [Listener at jenkins-hbase4.apache.org/33827] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-23 05:06:41,154 INFO [Listener at jenkins-hbase4.apache.org/33827] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-23 05:06:41,154 INFO [Listener at jenkins-hbase4.apache.org/33827] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-23 05:06:41,160 INFO [Listener at jenkins-hbase4.apache.org/33827] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 05:06:41,173 INFO [Listener at jenkins-hbase4.apache.org/33827] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 05:06:41,252 INFO [Listener at jenkins-hbase4.apache.org/33827] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 05:06:41,281 INFO [Listener at jenkins-hbase4.apache.org/33827] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:43701 2023-07-23 05:06:41,308 INFO [Listener at jenkins-hbase4.apache.org/33827] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-23 05:06:41,312 INFO [Listener at jenkins-hbase4.apache.org/33827] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 05:06:41,328 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:06:41,328 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-23 05:06:41,329 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:06:41,329 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-23 05:06:41,329 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-23 05:06:41,329 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-23 05:06:41,330 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:06:41,330 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-23 05:06:41,330 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-23 05:06:41,330 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-23 05:06:41,397 INFO [Listener at jenkins-hbase4.apache.org/33827] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=704, OpenFileDescriptor=901, MaxFileDescriptor=60000, SystemLoadAverage=112, ProcessCount=172, AvailableMemoryMB=8490 2023-07-23 05:06:41,397 WARN [Listener at jenkins-hbase4.apache.org/33827] hbase.ResourceChecker(130): Thread=704 is superior to 500 2023-07-23 05:06:41,417 DEBUG [Listener at jenkins-hbase4.apache.org/33827] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-23 05:06:41,451 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37236, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-23 05:06:41,461 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-23 05:06:41,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-23 05:06:41,469 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 05:06:41,473 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-23 05:06:41,473 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 05:06:41,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-23 05:06:41,488 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportWithTargetName/5b2af58262bba3dea77b159a3c00206d 2023-07-23 05:06:41,489 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportWithTargetName/5b2af58262bba3dea77b159a3c00206d empty. 2023-07-23 05:06:41,490 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportWithTargetName/5b2af58262bba3dea77b159a3c00206d 2023-07-23 05:06:41,499 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportWithTargetName/b119aeea37855bdcd969ef25a21dbe96 2023-07-23 05:06:41,500 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportWithTargetName/b119aeea37855bdcd969ef25a21dbe96 empty. 2023-07-23 05:06:41,503 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportWithTargetName/b119aeea37855bdcd969ef25a21dbe96 2023-07-23 05:06:41,503 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-23 05:06:41,548 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-23 05:06:41,551 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => b119aeea37855bdcd969ef25a21dbe96, NAME => 'testtb-testExportWithTargetName,1,1690088801460.b119aeea37855bdcd969ef25a21dbe96.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp 2023-07-23 05:06:41,552 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5b2af58262bba3dea77b159a3c00206d, NAME => 'testtb-testExportWithTargetName,,1690088801460.5b2af58262bba3dea77b159a3c00206d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp 2023-07-23 05:06:41,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-23 05:06:41,641 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690088801460.b119aeea37855bdcd969ef25a21dbe96.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:06:41,642 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing b119aeea37855bdcd969ef25a21dbe96, disabling compactions & flushes 2023-07-23 05:06:41,643 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690088801460.b119aeea37855bdcd969ef25a21dbe96. 2023-07-23 05:06:41,643 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690088801460.b119aeea37855bdcd969ef25a21dbe96. 2023-07-23 05:06:41,643 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690088801460.b119aeea37855bdcd969ef25a21dbe96. after waiting 0 ms 2023-07-23 05:06:41,643 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690088801460.b119aeea37855bdcd969ef25a21dbe96. 2023-07-23 05:06:41,643 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690088801460.b119aeea37855bdcd969ef25a21dbe96. 2023-07-23 05:06:41,643 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for b119aeea37855bdcd969ef25a21dbe96: 2023-07-23 05:06:41,648 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690088801460.5b2af58262bba3dea77b159a3c00206d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:06:41,648 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 5b2af58262bba3dea77b159a3c00206d, disabling compactions & flushes 2023-07-23 05:06:41,648 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690088801460.5b2af58262bba3dea77b159a3c00206d. 2023-07-23 05:06:41,648 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690088801460.5b2af58262bba3dea77b159a3c00206d. 2023-07-23 05:06:41,648 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690088801460.5b2af58262bba3dea77b159a3c00206d. after waiting 0 ms 2023-07-23 05:06:41,648 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690088801460.5b2af58262bba3dea77b159a3c00206d. 2023-07-23 05:06:41,648 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690088801460.5b2af58262bba3dea77b159a3c00206d. 2023-07-23 05:06:41,648 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 5b2af58262bba3dea77b159a3c00206d: 2023-07-23 05:06:41,656 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 05:06:41,658 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690088801460.b119aeea37855bdcd969ef25a21dbe96.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690088801658"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088801658"}]},"ts":"1690088801658"} 2023-07-23 05:06:41,658 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690088801460.5b2af58262bba3dea77b159a3c00206d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690088801658"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088801658"}]},"ts":"1690088801658"} 2023-07-23 05:06:41,719 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 05:06:41,721 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 05:06:41,721 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088801721"}]},"ts":"1690088801721"} 2023-07-23 05:06:41,724 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-23 05:06:41,729 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 05:06:41,732 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 05:06:41,732 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 05:06:41,732 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 05:06:41,732 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 05:06:41,733 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5b2af58262bba3dea77b159a3c00206d, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b119aeea37855bdcd969ef25a21dbe96, ASSIGN}] 2023-07-23 05:06:41,737 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b119aeea37855bdcd969ef25a21dbe96, ASSIGN 2023-07-23 05:06:41,737 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5b2af58262bba3dea77b159a3c00206d, ASSIGN 2023-07-23 05:06:41,738 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b119aeea37855bdcd969ef25a21dbe96, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44949,1690088792720; forceNewPlan=false, retain=false 2023-07-23 05:06:41,738 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5b2af58262bba3dea77b159a3c00206d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45437,1690088792660; forceNewPlan=false, retain=false 2023-07-23 05:06:41,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-23 05:06:41,889 INFO [jenkins-hbase4:32809] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 05:06:41,892 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=5b2af58262bba3dea77b159a3c00206d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:41,892 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=b119aeea37855bdcd969ef25a21dbe96, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:41,892 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690088801460.b119aeea37855bdcd969ef25a21dbe96.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690088801892"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088801892"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088801892"}]},"ts":"1690088801892"} 2023-07-23 05:06:41,892 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690088801460.5b2af58262bba3dea77b159a3c00206d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690088801892"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088801892"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088801892"}]},"ts":"1690088801892"} 2023-07-23 05:06:41,896 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure b119aeea37855bdcd969ef25a21dbe96, server=jenkins-hbase4.apache.org,44949,1690088792720}] 2023-07-23 05:06:41,898 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 5b2af58262bba3dea77b159a3c00206d, server=jenkins-hbase4.apache.org,45437,1690088792660}] 2023-07-23 05:06:42,057 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1690088801460.b119aeea37855bdcd969ef25a21dbe96. 2023-07-23 05:06:42,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b119aeea37855bdcd969ef25a21dbe96, NAME => 'testtb-testExportWithTargetName,1,1690088801460.b119aeea37855bdcd969ef25a21dbe96.', STARTKEY => '1', ENDKEY => ''} 2023-07-23 05:06:42,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1690088801460.b119aeea37855bdcd969ef25a21dbe96. service=AccessControlService 2023-07-23 05:06:42,058 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:06:42,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName b119aeea37855bdcd969ef25a21dbe96 2023-07-23 05:06:42,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690088801460.b119aeea37855bdcd969ef25a21dbe96.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:06:42,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b119aeea37855bdcd969ef25a21dbe96 2023-07-23 05:06:42,059 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1690088801460.5b2af58262bba3dea77b159a3c00206d. 2023-07-23 05:06:42,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b119aeea37855bdcd969ef25a21dbe96 2023-07-23 05:06:42,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5b2af58262bba3dea77b159a3c00206d, NAME => 'testtb-testExportWithTargetName,,1690088801460.5b2af58262bba3dea77b159a3c00206d.', STARTKEY => '', ENDKEY => '1'} 2023-07-23 05:06:42,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1690088801460.5b2af58262bba3dea77b159a3c00206d. service=AccessControlService 2023-07-23 05:06:42,060 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:06:42,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 5b2af58262bba3dea77b159a3c00206d 2023-07-23 05:06:42,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690088801460.5b2af58262bba3dea77b159a3c00206d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:06:42,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5b2af58262bba3dea77b159a3c00206d 2023-07-23 05:06:42,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5b2af58262bba3dea77b159a3c00206d 2023-07-23 05:06:42,064 INFO [StoreOpener-b119aeea37855bdcd969ef25a21dbe96-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b119aeea37855bdcd969ef25a21dbe96 2023-07-23 05:06:42,067 INFO [StoreOpener-5b2af58262bba3dea77b159a3c00206d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5b2af58262bba3dea77b159a3c00206d 2023-07-23 05:06:42,068 DEBUG [StoreOpener-b119aeea37855bdcd969ef25a21dbe96-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportWithTargetName/b119aeea37855bdcd969ef25a21dbe96/cf 2023-07-23 05:06:42,068 DEBUG [StoreOpener-b119aeea37855bdcd969ef25a21dbe96-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportWithTargetName/b119aeea37855bdcd969ef25a21dbe96/cf 2023-07-23 05:06:42,069 DEBUG [StoreOpener-5b2af58262bba3dea77b159a3c00206d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportWithTargetName/5b2af58262bba3dea77b159a3c00206d/cf 2023-07-23 05:06:42,069 DEBUG [StoreOpener-5b2af58262bba3dea77b159a3c00206d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportWithTargetName/5b2af58262bba3dea77b159a3c00206d/cf 2023-07-23 05:06:42,073 INFO [StoreOpener-b119aeea37855bdcd969ef25a21dbe96-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b119aeea37855bdcd969ef25a21dbe96 columnFamilyName cf 2023-07-23 05:06:42,073 INFO [StoreOpener-5b2af58262bba3dea77b159a3c00206d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5b2af58262bba3dea77b159a3c00206d columnFamilyName cf 2023-07-23 05:06:42,077 INFO [StoreOpener-5b2af58262bba3dea77b159a3c00206d-1] regionserver.HStore(310): Store=5b2af58262bba3dea77b159a3c00206d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:06:42,077 INFO [StoreOpener-b119aeea37855bdcd969ef25a21dbe96-1] regionserver.HStore(310): Store=b119aeea37855bdcd969ef25a21dbe96/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:06:42,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportWithTargetName/b119aeea37855bdcd969ef25a21dbe96 2023-07-23 05:06:42,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportWithTargetName/b119aeea37855bdcd969ef25a21dbe96 2023-07-23 05:06:42,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportWithTargetName/5b2af58262bba3dea77b159a3c00206d 2023-07-23 05:06:42,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportWithTargetName/5b2af58262bba3dea77b159a3c00206d 2023-07-23 05:06:42,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b119aeea37855bdcd969ef25a21dbe96 2023-07-23 05:06:42,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportWithTargetName/b119aeea37855bdcd969ef25a21dbe96/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 05:06:42,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b119aeea37855bdcd969ef25a21dbe96; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65562854, jitterRate=-0.023037344217300415}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 05:06:42,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b119aeea37855bdcd969ef25a21dbe96: 2023-07-23 05:06:42,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-23 05:06:42,100 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1690088801460.b119aeea37855bdcd969ef25a21dbe96., pid=15, masterSystemTime=1690088802050 2023-07-23 05:06:42,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5b2af58262bba3dea77b159a3c00206d 2023-07-23 05:06:42,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1690088801460.b119aeea37855bdcd969ef25a21dbe96. 2023-07-23 05:06:42,103 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1690088801460.b119aeea37855bdcd969ef25a21dbe96. 2023-07-23 05:06:42,105 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=b119aeea37855bdcd969ef25a21dbe96, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:42,105 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1690088801460.b119aeea37855bdcd969ef25a21dbe96.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690088802104"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690088802104"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690088802104"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690088802104"}]},"ts":"1690088802104"} 2023-07-23 05:06:42,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportWithTargetName/5b2af58262bba3dea77b159a3c00206d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 05:06:42,106 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5b2af58262bba3dea77b159a3c00206d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71497958, jitterRate=0.06540259718894958}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 05:06:42,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5b2af58262bba3dea77b159a3c00206d: 2023-07-23 05:06:42,111 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1690088801460.5b2af58262bba3dea77b159a3c00206d., pid=16, masterSystemTime=1690088802051 2023-07-23 05:06:42,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1690088801460.5b2af58262bba3dea77b159a3c00206d. 2023-07-23 05:06:42,116 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1690088801460.5b2af58262bba3dea77b159a3c00206d. 2023-07-23 05:06:42,117 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=5b2af58262bba3dea77b159a3c00206d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:42,121 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1690088801460.5b2af58262bba3dea77b159a3c00206d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690088802117"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690088802117"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690088802117"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690088802117"}]},"ts":"1690088802117"} 2023-07-23 05:06:42,123 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-23 05:06:42,125 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure b119aeea37855bdcd969ef25a21dbe96, server=jenkins-hbase4.apache.org,44949,1690088792720 in 217 msec 2023-07-23 05:06:42,130 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b119aeea37855bdcd969ef25a21dbe96, ASSIGN in 392 msec 2023-07-23 05:06:42,133 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-23 05:06:42,133 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 5b2af58262bba3dea77b159a3c00206d, server=jenkins-hbase4.apache.org,45437,1690088792660 in 228 msec 2023-07-23 05:06:42,141 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-23 05:06:42,141 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5b2af58262bba3dea77b159a3c00206d, ASSIGN in 400 msec 2023-07-23 05:06:42,143 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 05:06:42,143 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088802143"}]},"ts":"1690088802143"} 2023-07-23 05:06:42,145 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-23 05:06:42,149 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 05:06:42,154 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-23 05:06:42,164 DEBUG [PEWorker-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:06:42,168 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33986, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:06:42,175 DEBUG [hconnection-0x13bbc716-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:06:42,179 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59814, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2023-07-23 05:06:42,188 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45437] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-23 05:06:42,221 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-23 05:06:42,221 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-23 05:06:42,221 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-23 05:06:42,221 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-23 05:06:42,221 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 05:06:42,231 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 05:06:42,231 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-23 05:06:42,231 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-23 05:06:42,231 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-23 05:06:42,232 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-23 05:06:42,236 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 770 msec 2023-07-23 05:06:42,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-23 05:06:42,602 INFO [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-23 05:06:42,606 DEBUG [Listener at jenkins-hbase4.apache.org/33827] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-23 05:06:42,608 DEBUG [Listener at jenkins-hbase4.apache.org/33827] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1690088801460.5b2af58262bba3dea77b159a3c00206d. 2023-07-23 05:06:42,611 INFO [Listener at jenkins-hbase4.apache.org/33827] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 05:06:42,643 DEBUG [hconnection-0x462f8946-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:06:42,650 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33998, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:06:42,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-23 05:06:42,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690088802674 (current time:1690088802674). 2023-07-23 05:06:42,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 05:06:42,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] zookeeper.ReadOnlyZKClient(139): Connect 0x47ef4f48 to 127.0.0.1:57388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:06:42,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@134c316c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:06:42,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:06:42,695 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59828, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:06:42,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x47ef4f48 to 127.0.0.1:57388 2023-07-23 05:06:42,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:06:42,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] zookeeper.ReadOnlyZKClient(139): Connect 0x25a26c4e to 127.0.0.1:57388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:06:42,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b96ec9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:06:42,727 DEBUG [hconnection-0x7b2f474f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:06:42,728 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59830, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:06:42,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:06:42,736 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34012, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:06:42,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x25a26c4e to 127.0.0.1:57388 2023-07-23 05:06:42,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:06:42,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-23 05:06:42,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 05:06:42,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-23 05:06:42,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-23 05:06:42,790 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-23 05:06:42,793 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690089402793 2023-07-23 05:06:42,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-23 05:06:42,797 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-23 05:06:42,800 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-23 05:06:42,803 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 05:06:42,804 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 05:06:42,805 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-23 05:06:42,806 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 20 msec 2023-07-23 05:06:42,807 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-23 05:06:42,809 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690089402809 2023-07-23 05:06:42,854 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:42,854 INFO [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-23 05:06:42,854 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:06:42,855 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-23 05:06:42,855 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-23 05:06:42,856 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:42,856 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:42,861 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:06:42,861 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:06:42,861 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:06:42,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:06:42,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:06:42,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:06:42,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:06:42,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:06:42,862 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:42,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:06:42,862 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:42,863 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:42,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:42,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:42,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:42,863 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:42,863 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:42,864 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:42,863 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:42,863 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 05:06:42,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-23 05:06:42,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-23 05:06:42,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:42,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:42,866 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-23 05:06:42,867 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-23 05:06:42,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-23 05:06:42,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:42,867 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-23 05:06:42,870 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:42,870 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:42,870 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:42,870 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-23 05:06:42,870 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:06:42,870 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-23 05:06:42,871 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-23 05:06:42,870 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-23 05:06:42,871 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-23 05:06:42,871 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:06:42,872 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44949,1690088792720' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-23 05:06:42,872 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-23 05:06:42,873 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-23 05:06:42,872 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:06:42,873 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45437,1690088792660' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-23 05:06:42,874 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-23 05:06:42,874 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-23 05:06:42,874 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37855,1690088792757' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-23 05:06:42,876 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:42,876 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:42,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:42,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:06:42,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:06:42,877 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:42,877 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:42,878 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:42,878 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:06:42,878 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:42,878 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:06:42,879 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:42,879 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:42,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:06:42,879 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:06:42,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:06:42,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:42,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:06:42,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:42,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:42,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:06:42,882 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44949,1690088792720' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-23 05:06:42,882 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@215afab2[Count = 1] remaining members to acquire global barrier 2023-07-23 05:06:42,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:42,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:06:42,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:06:42,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:06:42,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:06:42,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:42,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:06:42,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:42,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:42,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:06:42,886 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45437,1690088792660' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-23 05:06:42,887 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@215afab2[Count = 0] remaining members to acquire global barrier 2023-07-23 05:06:42,887 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-23 05:06:42,887 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:42,890 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:42,890 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:42,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:42,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:42,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:42,890 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:42,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:42,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:42,890 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-23 05:06:42,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:42,890 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:42,891 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:42,891 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 05:06:42,894 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:06:42,894 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:06:42,894 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690088801460.5b2af58262bba3dea77b159a3c00206d. 2023-07-23 05:06:42,894 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-23 05:06:42,894 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-23 05:06:42,894 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690088801460.5b2af58262bba3dea77b159a3c00206d. started... 2023-07-23 05:06:42,895 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37855,1690088792757' in zk 2023-07-23 05:06:42,895 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-23 05:06:42,898 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:06:42,900 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:06:42,897 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5b2af58262bba3dea77b159a3c00206d: 2023-07-23 05:06:42,900 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-23 05:06:42,900 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:06:42,900 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-23 05:06:42,902 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690088801460.b119aeea37855bdcd969ef25a21dbe96. 2023-07-23 05:06:42,903 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690088801460.b119aeea37855bdcd969ef25a21dbe96. started... 2023-07-23 05:06:42,904 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:06:42,904 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690088801460.5b2af58262bba3dea77b159a3c00206d.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:42,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 05:06:42,911 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b119aeea37855bdcd969ef25a21dbe96: 2023-07-23 05:06:42,911 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690088801460.b119aeea37855bdcd969ef25a21dbe96.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:42,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:06:42,914 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 05:06:42,917 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:06:42,917 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:06:42,923 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 05:06:42,923 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 05:06:42,999 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690088801460.5b2af58262bba3dea77b159a3c00206d. completed. 2023-07-23 05:06:42,999 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690088801460.5b2af58262bba3dea77b159a3c00206d. 2023-07-23 05:06:43,000 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:06:43,000 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:06:43,000 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:43,000 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-23 05:06:43,000 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45437,1690088792660' in zk 2023-07-23 05:06:43,002 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690088801460.b119aeea37855bdcd969ef25a21dbe96. completed. 2023-07-23 05:06:43,002 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690088801460.b119aeea37855bdcd969ef25a21dbe96. 2023-07-23 05:06:43,002 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:06:43,002 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:06:43,002 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:43,002 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-23 05:06:43,002 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44949,1690088792720' in zk 2023-07-23 05:06:43,004 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-23 05:06:43,004 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:43,004 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:06:43,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:43,004 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-23 05:06:43,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:06:43,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:06:43,007 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-23 05:06:43,007 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:06:43,007 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-23 05:06:43,007 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:43,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:06:43,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:06:43,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:43,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:06:43,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:43,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:43,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:06:43,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:43,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:06:43,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:43,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:43,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45437,1690088792660': 2023-07-23 05:06:43,016 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45437,1690088792660' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-23 05:06:43,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:43,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:06:43,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:06:43,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:06:43,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:06:43,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:43,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:06:43,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:43,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:43,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:06:43,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:43,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:06:43,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:43,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:43,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,44949,1690088792720': 2023-07-23 05:06:43,023 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44949,1690088792720' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-23 05:06:43,023 INFO [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-23 05:06:43,023 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 05:06:43,023 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 05:06:43,023 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:43,023 INFO [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 05:06:43,027 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:43,027 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:06:43,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:43,027 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:43,027 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:43,027 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:06:43,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:43,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:43,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:43,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:43,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:43,027 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:06:43,028 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:43,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:43,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:06:43,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:06:43,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:06:43,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:06:43,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:06:43,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:06:43,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:06:43,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:06:43,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:06:43,029 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:06:43,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:43,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:43,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:43,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:06:43,031 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:43,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:43,033 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:43,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:06:43,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:43,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:43,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:43,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:06:43,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:43,038 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:06:43,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:06:43,038 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:43,039 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:43,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:43,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:43,058 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:06:43,058 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:06:43,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:06:43,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:06:43,059 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:06:43,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:06:43,059 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:06:43,058 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:43,059 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:43,059 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:06:43,059 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:06:43,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:06:43,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:06:43,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:06:43,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:06:43,059 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:06:43,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:06:43,059 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:43,059 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:43,061 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-23 05:06:43,061 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:06:43,061 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:43,061 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:43,061 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:43,061 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 05:06:43,061 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:43,061 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:43,061 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:06:43,061 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:43,061 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:43,062 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-23 05:06:43,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:06:43,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:06:43,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:06:43,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:06:43,101 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:43,105 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:43,115 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:06:43,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 05:06:43,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:06:43,118 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 05:06:43,198 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:43,255 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-23 05:06:43,255 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:43,256 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:43,256 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690088802797Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1690088803101 (+304 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1690088803101Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1690088803102 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1690088803126 (+24 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1690088803178 (+52 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690088803255 (+77 ms) 2023-07-23 05:06:43,258 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-23 05:06:43,260 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 457 msec 2023-07-23 05:06:43,418 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:06:43,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 05:06:43,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 05:06:43,439 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45437] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1690088801460.5b2af58262bba3dea77b159a3c00206d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 05:06:43,443 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44949] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1690088801460.b119aeea37855bdcd969ef25a21dbe96. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 05:06:43,448 DEBUG [Listener at jenkins-hbase4.apache.org/33827] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-23 05:06:43,449 DEBUG [Listener at jenkins-hbase4.apache.org/33827] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1690088801460.5b2af58262bba3dea77b159a3c00206d. 2023-07-23 05:06:43,449 INFO [Listener at jenkins-hbase4.apache.org/33827] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 05:06:43,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-23 05:06:43,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690088803469 (current time:1690088803469). 2023-07-23 05:06:43,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 05:06:43,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] zookeeper.ReadOnlyZKClient(139): Connect 0x4b880816 to 127.0.0.1:57388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:06:43,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@34dbf46f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:06:43,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:06:43,482 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59838, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:06:43,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b880816 to 127.0.0.1:57388 2023-07-23 05:06:43,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:06:43,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] zookeeper.ReadOnlyZKClient(139): Connect 0x0b9640d3 to 127.0.0.1:57388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:06:43,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@55210f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:06:43,491 DEBUG [hconnection-0x6bc6c5e6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:06:43,494 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59848, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:06:43,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:06:43,500 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34022, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:06:43,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b9640d3 to 127.0.0.1:57388 2023-07-23 05:06:43,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:06:43,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-23 05:06:43,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 05:06:43,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-23 05:06:43,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-23 05:06:43,509 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-23 05:06:43,512 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690089403512 2023-07-23 05:06:43,512 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-23 05:06:43,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-23 05:06:43,518 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 05:06:43,518 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 05:06:43,521 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-23 05:06:43,522 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-23 05:06:43,525 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 16 msec 2023-07-23 05:06:43,526 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-23 05:06:43,528 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690089403528 2023-07-23 05:06:43,553 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-23 05:06:43,554 INFO [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-23 05:06:43,554 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:06:43,555 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-23 05:06:43,555 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-23 05:06:43,556 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 05:06:43,556 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 05:06:43,557 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:06:43,557 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:06:43,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:06:43,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:06:43,557 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:06:43,557 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:43,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:06:43,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:06:43,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:06:43,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:06:43,558 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:43,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 05:06:43,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 05:06:43,558 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:43,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 05:06:43,559 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 05:06:43,559 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:43,559 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 05:06:43,559 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 05:06:43,559 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 05:06:43,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-23 05:06:43,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-23 05:06:43,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 05:06:43,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-23 05:06:43,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 05:06:43,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 05:06:43,560 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-23 05:06:43,560 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-23 05:06:43,560 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-23 05:06:43,560 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-23 05:06:43,560 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-23 05:06:43,560 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:06:43,561 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-23 05:06:43,561 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-23 05:06:43,562 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-23 05:06:43,562 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-23 05:06:43,562 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:06:43,562 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-23 05:06:43,564 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-23 05:06:43,562 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:06:43,564 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-23 05:06:43,564 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-23 05:06:43,565 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37855,1690088792757' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-23 05:06:43,565 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-23 05:06:43,565 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-23 05:06:43,565 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45437,1690088792660' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-23 05:06:43,565 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44949,1690088792720' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-23 05:06:43,568 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 05:06:43,569 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 05:06:43,569 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:43,569 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 05:06:43,569 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:43,569 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 05:06:43,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:43,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:06:43,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:06:43,569 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:06:43,569 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 05:06:43,569 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:06:43,570 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 05:06:43,570 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:06:43,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:06:43,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:06:43,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 05:06:43,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:06:43,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:43,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:43,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:06:43,573 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44949,1690088792720' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-23 05:06:43,573 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44699361[Count = 1] remaining members to acquire global barrier 2023-07-23 05:06:43,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:43,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:06:43,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:06:43,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:06:43,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:06:43,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 05:06:43,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:06:43,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:43,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:43,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:06:43,576 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45437,1690088792660' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-23 05:06:43,576 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44699361[Count = 0] remaining members to acquire global barrier 2023-07-23 05:06:43,576 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-23 05:06:43,576 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 05:06:43,583 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 05:06:43,583 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 05:06:43,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 05:06:43,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 05:06:43,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 05:06:43,583 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 05:06:43,584 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-23 05:06:43,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 05:06:43,584 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:43,584 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690088801460.b119aeea37855bdcd969ef25a21dbe96. 2023-07-23 05:06:43,584 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:06:43,584 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:06:43,584 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690088801460.b119aeea37855bdcd969ef25a21dbe96. started... 2023-07-23 05:06:43,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 05:06:43,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 05:06:43,584 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-23 05:06:43,584 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-23 05:06:43,585 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-23 05:06:43,584 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:43,585 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37855,1690088792757' in zk 2023-07-23 05:06:43,585 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 05:06:43,585 INFO [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b119aeea37855bdcd969ef25a21dbe96 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-23 05:06:43,585 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:06:43,585 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690088801460.5b2af58262bba3dea77b159a3c00206d. 2023-07-23 05:06:43,585 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:06:43,585 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690088801460.5b2af58262bba3dea77b159a3c00206d. started... 2023-07-23 05:06:43,585 INFO [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5b2af58262bba3dea77b159a3c00206d 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-23 05:06:43,589 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-23 05:06:43,589 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:06:43,589 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-23 05:06:43,618 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:06:43,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 05:06:43,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:06:43,621 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 05:06:43,821 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:06:43,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 05:06:43,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:06:43,823 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 05:06:43,829 INFO [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023072370fc15cee38f454fb4f800795d784bf9 to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023072370fc15cee38f454fb4f800795d784bf9 2023-07-23 05:06:43,829 INFO [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230723f7f124e511764b9abd13adf7d8615d9d to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230723f7f124e511764b9abd13adf7d8615d9d 2023-07-23 05:06:43,907 INFO [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportWithTargetName/b119aeea37855bdcd969ef25a21dbe96/.tmp/cf/a609e39fc15c4ce785750ab6a97760d7 2023-07-23 05:06:43,922 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportWithTargetName/b119aeea37855bdcd969ef25a21dbe96/.tmp/cf/a609e39fc15c4ce785750ab6a97760d7 as hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportWithTargetName/b119aeea37855bdcd969ef25a21dbe96/cf/a609e39fc15c4ce785750ab6a97760d7 2023-07-23 05:06:43,939 INFO [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportWithTargetName/5b2af58262bba3dea77b159a3c00206d/.tmp/cf/45e82adb56614db1b758f03686d902b0 2023-07-23 05:06:43,943 INFO [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportWithTargetName/b119aeea37855bdcd969ef25a21dbe96/cf/a609e39fc15c4ce785750ab6a97760d7, entries=46, sequenceid=6, filesize=12.6 K 2023-07-23 05:06:43,948 INFO [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for b119aeea37855bdcd969ef25a21dbe96 in 364ms, sequenceid=6, compaction requested=false 2023-07-23 05:06:43,948 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-23 05:06:43,949 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b119aeea37855bdcd969ef25a21dbe96: 2023-07-23 05:06:43,950 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690088801460.b119aeea37855bdcd969ef25a21dbe96.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-23 05:06:43,950 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:06:43,950 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportWithTargetName/b119aeea37855bdcd969ef25a21dbe96/cf/a609e39fc15c4ce785750ab6a97760d7] hfiles 2023-07-23 05:06:43,950 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportWithTargetName/b119aeea37855bdcd969ef25a21dbe96/cf/a609e39fc15c4ce785750ab6a97760d7 for snapshot=snaptb0-testExportWithTargetName 2023-07-23 05:06:43,952 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportWithTargetName/5b2af58262bba3dea77b159a3c00206d/.tmp/cf/45e82adb56614db1b758f03686d902b0 as hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportWithTargetName/5b2af58262bba3dea77b159a3c00206d/cf/45e82adb56614db1b758f03686d902b0 2023-07-23 05:06:43,964 INFO [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportWithTargetName/5b2af58262bba3dea77b159a3c00206d/cf/45e82adb56614db1b758f03686d902b0, entries=4, sequenceid=6, filesize=5.6 K 2023-07-23 05:06:43,969 INFO [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 5b2af58262bba3dea77b159a3c00206d in 384ms, sequenceid=6, compaction requested=false 2023-07-23 05:06:43,971 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5b2af58262bba3dea77b159a3c00206d: 2023-07-23 05:06:43,971 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690088801460.5b2af58262bba3dea77b159a3c00206d.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-23 05:06:43,971 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:06:43,971 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportWithTargetName/5b2af58262bba3dea77b159a3c00206d/cf/45e82adb56614db1b758f03686d902b0] hfiles 2023-07-23 05:06:43,971 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportWithTargetName/5b2af58262bba3dea77b159a3c00206d/cf/45e82adb56614db1b758f03686d902b0 for snapshot=snaptb0-testExportWithTargetName 2023-07-23 05:06:43,980 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690088801460.b119aeea37855bdcd969ef25a21dbe96. completed. 2023-07-23 05:06:43,981 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690088801460.b119aeea37855bdcd969ef25a21dbe96. 2023-07-23 05:06:43,981 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:06:43,981 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:06:43,981 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:43,981 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-23 05:06:43,981 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44949,1690088792720' in zk 2023-07-23 05:06:43,984 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:43,984 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-23 05:06:43,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:43,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:06:43,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:06:43,984 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:06:43,984 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-23 05:06:43,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:06:43,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:06:43,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 05:06:43,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:06:43,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:43,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:43,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:06:43,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 05:06:43,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:06:43,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:43,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,44949,1690088792720': 2023-07-23 05:06:43,988 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44949,1690088792720' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-23 05:06:43,999 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690088801460.5b2af58262bba3dea77b159a3c00206d. completed. 2023-07-23 05:06:43,999 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690088801460.5b2af58262bba3dea77b159a3c00206d. 2023-07-23 05:06:43,999 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:06:43,999 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:06:43,999 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:43,999 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-23 05:06:43,999 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45437,1690088792660' in zk 2023-07-23 05:06:44,000 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-23 05:06:44,000 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:44,001 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:06:44,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:44,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:06:44,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:06:44,001 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-23 05:06:44,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:06:44,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:06:44,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 05:06:44,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:06:44,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:44,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:44,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:06:44,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 05:06:44,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:06:44,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:44,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:44,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45437,1690088792660': 2023-07-23 05:06:44,006 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45437,1690088792660' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-23 05:06:44,006 INFO [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-23 05:06:44,006 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 05:06:44,006 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 05:06:44,006 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-23 05:06:44,006 INFO [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 05:06:44,014 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 05:06:44,014 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 05:06:44,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 05:06:44,014 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 05:06:44,014 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 05:06:44,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 05:06:44,014 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:06:44,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 05:06:44,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 05:06:44,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:06:44,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:06:44,014 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:06:44,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 05:06:44,015 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:06:44,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 05:06:44,014 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:06:44,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 05:06:44,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:06:44,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:06:44,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:06:44,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:06:44,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:06:44,015 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:44,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:06:44,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:06:44,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 05:06:44,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 05:06:44,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 05:06:44,016 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:44,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 05:06:44,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:06:44,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 05:06:44,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:06:44,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:44,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:44,018 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:06:44,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:06:44,019 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:44,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 05:06:44,019 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:44,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:06:44,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:44,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:44,030 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:44,030 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:06:44,030 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:06:44,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:06:44,030 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 05:06:44,030 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:06:44,030 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:44,030 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-23 05:06:44,030 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:06:44,030 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-23 05:06:44,030 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 05:06:44,030 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:06:44,030 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-23 05:06:44,030 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:44,030 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 05:06:44,030 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 05:06:44,030 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:06:44,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:06:44,030 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:06:44,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:06:44,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:06:44,030 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:44,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:06:44,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:06:44,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:06:44,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:06:44,030 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:06:44,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:06:44,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:06:44,032 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:06:44,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:06:44,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:06:44,032 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 05:06:44,032 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230723f7f124e511764b9abd13adf7d8615d9d, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023072370fc15cee38f454fb4f800795d784bf9] mob files 2023-07-23 05:06:44,032 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 05:06:44,033 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230723f7f124e511764b9abd13adf7d8615d9d 2023-07-23 05:06:44,033 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023072370fc15cee38f454fb4f800795d784bf9 2023-07-23 05:06:44,051 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-23 05:06:44,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-23 05:06:44,088 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-23 05:06:44,122 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-23 05:06:44,122 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-23 05:06:44,122 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-23 05:06:44,122 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690088803513Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1690088804051 (+538 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1690088804051Loading Region manifests for snaptb0-testExportWithTargetName at 1690088804052 (+1 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1690088804057 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1690088804077 (+20 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690088804122 (+45 ms) 2023-07-23 05:06:44,124 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:06:44,124 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-23 05:06:44,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 05:06:44,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 05:06:44,126 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088804126 2023-07-23 05:06:44,127 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38911, tgtDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088804126, rawTgtDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088804126, srcFsUri=hdfs://localhost:38911, srcDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd 2023-07-23 05:06:44,127 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 610 msec 2023-07-23 05:06:44,175 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38911, inputRoot=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd 2023-07-23 05:06:44,177 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1622913217_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088804126, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088804126/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-23 05:06:44,177 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38911, inputRoot=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd, snapshotDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-23 05:06:44,200 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088804126/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-23 05:06:44,270 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 05:06:44,271 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 05:06:44,272 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 05:06:44,272 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 05:06:44,273 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-23 05:06:44,273 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 05:06:44,274 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 05:06:44,360 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/hadoop-8364316180234759845.jar 2023-07-23 05:06:44,361 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 05:06:44,361 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 05:06:44,362 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 05:06:44,362 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 05:06:44,363 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 05:06:44,363 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 05:06:44,363 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 05:06:44,364 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 05:06:44,365 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 05:06:44,365 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 05:06:44,366 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 05:06:44,366 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 05:06:44,367 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 05:06:44,368 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 05:06:44,368 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 05:06:44,369 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 05:06:44,372 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:06:44,373 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:06:44,373 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 05:06:44,374 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:06:44,374 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:06:44,374 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 05:06:44,375 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 05:06:46,056 WARN [Listener at jenkins-hbase4.apache.org/33827] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 05:06:46,063 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-23 05:06:46,071 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-23 05:06:46,645 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 05:06:46,648 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 05:06:47,236 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088800324_0001_000001 (auth:SIMPLE) 2023-07-23 05:06:47,568 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 05:06:52,447 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088800324_0001_000001 (auth:SIMPLE) 2023-07-23 05:06:54,716 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088800324_0001_000001 (auth:SIMPLE) 2023-07-23 05:06:57,560 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088800324_0001_000001 (auth:SIMPLE) 2023-07-23 05:06:59,044 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 05:06:59,048 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 05:06:59,060 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-23 05:06:59,061 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 05:06:59,062 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 05:06:59,062 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-154173811_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-23 05:06:59,062 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(367): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-23 05:06:59,063 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(367): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-23 05:06:59,063 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-154173811_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088804126/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088804126/.hbase-snapshot/testExportWithTargetName 2023-07-23 05:06:59,063 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(367): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088804126/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-23 05:06:59,063 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(367): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088804126/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-23 05:06:59,079 INFO [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-23 05:06:59,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-23 05:06:59,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-23 05:06:59,101 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088819101"}]},"ts":"1690088819101"} 2023-07-23 05:06:59,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-23 05:06:59,103 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-23 05:06:59,105 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-23 05:06:59,107 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5b2af58262bba3dea77b159a3c00206d, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b119aeea37855bdcd969ef25a21dbe96, UNASSIGN}] 2023-07-23 05:06:59,110 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5b2af58262bba3dea77b159a3c00206d, UNASSIGN 2023-07-23 05:06:59,110 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b119aeea37855bdcd969ef25a21dbe96, UNASSIGN 2023-07-23 05:06:59,111 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=5b2af58262bba3dea77b159a3c00206d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:59,111 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=b119aeea37855bdcd969ef25a21dbe96, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:06:59,111 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690088801460.5b2af58262bba3dea77b159a3c00206d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690088819111"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088819111"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088819111"}]},"ts":"1690088819111"} 2023-07-23 05:06:59,111 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690088801460.b119aeea37855bdcd969ef25a21dbe96.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690088819111"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088819111"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088819111"}]},"ts":"1690088819111"} 2023-07-23 05:06:59,113 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 5b2af58262bba3dea77b159a3c00206d, server=jenkins-hbase4.apache.org,45437,1690088792660}] 2023-07-23 05:06:59,114 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure b119aeea37855bdcd969ef25a21dbe96, server=jenkins-hbase4.apache.org,44949,1690088792720}] 2023-07-23 05:06:59,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-23 05:06:59,277 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b119aeea37855bdcd969ef25a21dbe96 2023-07-23 05:06:59,277 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5b2af58262bba3dea77b159a3c00206d 2023-07-23 05:06:59,277 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b119aeea37855bdcd969ef25a21dbe96, disabling compactions & flushes 2023-07-23 05:06:59,277 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5b2af58262bba3dea77b159a3c00206d, disabling compactions & flushes 2023-07-23 05:06:59,277 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690088801460.b119aeea37855bdcd969ef25a21dbe96. 2023-07-23 05:06:59,277 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690088801460.5b2af58262bba3dea77b159a3c00206d. 2023-07-23 05:06:59,277 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690088801460.b119aeea37855bdcd969ef25a21dbe96. 2023-07-23 05:06:59,277 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690088801460.5b2af58262bba3dea77b159a3c00206d. 2023-07-23 05:06:59,277 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690088801460.b119aeea37855bdcd969ef25a21dbe96. after waiting 0 ms 2023-07-23 05:06:59,277 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690088801460.5b2af58262bba3dea77b159a3c00206d. after waiting 0 ms 2023-07-23 05:06:59,277 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690088801460.b119aeea37855bdcd969ef25a21dbe96. 2023-07-23 05:06:59,277 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690088801460.5b2af58262bba3dea77b159a3c00206d. 2023-07-23 05:06:59,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportWithTargetName/5b2af58262bba3dea77b159a3c00206d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 05:06:59,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportWithTargetName/b119aeea37855bdcd969ef25a21dbe96/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 05:06:59,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:06:59,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:06:59,305 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690088801460.5b2af58262bba3dea77b159a3c00206d. 2023-07-23 05:06:59,307 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690088801460.b119aeea37855bdcd969ef25a21dbe96. 2023-07-23 05:06:59,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5b2af58262bba3dea77b159a3c00206d: 2023-07-23 05:06:59,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b119aeea37855bdcd969ef25a21dbe96: 2023-07-23 05:06:59,310 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b119aeea37855bdcd969ef25a21dbe96 2023-07-23 05:06:59,312 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=b119aeea37855bdcd969ef25a21dbe96, regionState=CLOSED 2023-07-23 05:06:59,312 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690088801460.b119aeea37855bdcd969ef25a21dbe96.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690088819312"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088819312"}]},"ts":"1690088819312"} 2023-07-23 05:06:59,313 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5b2af58262bba3dea77b159a3c00206d 2023-07-23 05:06:59,313 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=5b2af58262bba3dea77b159a3c00206d, regionState=CLOSED 2023-07-23 05:06:59,314 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690088801460.5b2af58262bba3dea77b159a3c00206d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690088819313"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088819313"}]},"ts":"1690088819313"} 2023-07-23 05:06:59,320 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-23 05:06:59,320 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure b119aeea37855bdcd969ef25a21dbe96, server=jenkins-hbase4.apache.org,44949,1690088792720 in 202 msec 2023-07-23 05:06:59,321 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-23 05:06:59,321 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 5b2af58262bba3dea77b159a3c00206d, server=jenkins-hbase4.apache.org,45437,1690088792660 in 205 msec 2023-07-23 05:06:59,322 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b119aeea37855bdcd969ef25a21dbe96, UNASSIGN in 213 msec 2023-07-23 05:06:59,325 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-23 05:06:59,325 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5b2af58262bba3dea77b159a3c00206d, UNASSIGN in 214 msec 2023-07-23 05:06:59,327 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088819326"}]},"ts":"1690088819326"} 2023-07-23 05:06:59,328 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-23 05:06:59,330 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-23 05:06:59,334 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 242 msec 2023-07-23 05:06:59,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-23 05:06:59,405 INFO [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-23 05:06:59,410 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-23 05:06:59,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-23 05:06:59,420 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-23 05:06:59,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-23 05:06:59,422 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-23 05:06:59,425 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45437] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-23 05:06:59,428 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportWithTargetName/5b2af58262bba3dea77b159a3c00206d 2023-07-23 05:06:59,428 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportWithTargetName/b119aeea37855bdcd969ef25a21dbe96 2023-07-23 05:06:59,429 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 05:06:59,429 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 05:06:59,429 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 05:06:59,429 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 05:06:59,429 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-23 05:06:59,429 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-23 05:06:59,429 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-23 05:06:59,430 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-23 05:06:59,430 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 05:06:59,430 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 05:06:59,431 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:06:59,431 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 05:06:59,431 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:06:59,430 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 05:06:59,431 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:06:59,430 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:06:59,432 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportWithTargetName/b119aeea37855bdcd969ef25a21dbe96/cf, FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportWithTargetName/b119aeea37855bdcd969ef25a21dbe96/recovered.edits] 2023-07-23 05:06:59,432 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportWithTargetName/5b2af58262bba3dea77b159a3c00206d/cf, FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportWithTargetName/5b2af58262bba3dea77b159a3c00206d/recovered.edits] 2023-07-23 05:06:59,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-23 05:06:59,440 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportWithTargetName/5b2af58262bba3dea77b159a3c00206d/cf/45e82adb56614db1b758f03686d902b0 to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testExportWithTargetName/5b2af58262bba3dea77b159a3c00206d/cf/45e82adb56614db1b758f03686d902b0 2023-07-23 05:06:59,440 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportWithTargetName/b119aeea37855bdcd969ef25a21dbe96/cf/a609e39fc15c4ce785750ab6a97760d7 to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testExportWithTargetName/b119aeea37855bdcd969ef25a21dbe96/cf/a609e39fc15c4ce785750ab6a97760d7 2023-07-23 05:06:59,444 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportWithTargetName/b119aeea37855bdcd969ef25a21dbe96/recovered.edits/9.seqid to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testExportWithTargetName/b119aeea37855bdcd969ef25a21dbe96/recovered.edits/9.seqid 2023-07-23 05:06:59,444 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportWithTargetName/5b2af58262bba3dea77b159a3c00206d/recovered.edits/9.seqid to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testExportWithTargetName/5b2af58262bba3dea77b159a3c00206d/recovered.edits/9.seqid 2023-07-23 05:06:59,445 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportWithTargetName/b119aeea37855bdcd969ef25a21dbe96 2023-07-23 05:06:59,445 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportWithTargetName/5b2af58262bba3dea77b159a3c00206d 2023-07-23 05:06:59,445 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-23 05:06:59,446 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-23 05:06:59,447 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-23 05:06:59,451 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230723f7f124e511764b9abd13adf7d8615d9d to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230723f7f124e511764b9abd13adf7d8615d9d 2023-07-23 05:06:59,453 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023072370fc15cee38f454fb4f800795d784bf9 to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023072370fc15cee38f454fb4f800795d784bf9 2023-07-23 05:06:59,453 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-23 05:06:59,456 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-23 05:06:59,477 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-23 05:06:59,480 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-23 05:06:59,481 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-23 05:06:59,482 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-23 05:06:59,482 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1690088801460.5b2af58262bba3dea77b159a3c00206d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690088819482"}]},"ts":"9223372036854775807"} 2023-07-23 05:06:59,482 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1690088801460.b119aeea37855bdcd969ef25a21dbe96.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690088819482"}]},"ts":"9223372036854775807"} 2023-07-23 05:06:59,484 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-23 05:06:59,484 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5b2af58262bba3dea77b159a3c00206d, NAME => 'testtb-testExportWithTargetName,,1690088801460.5b2af58262bba3dea77b159a3c00206d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b119aeea37855bdcd969ef25a21dbe96, NAME => 'testtb-testExportWithTargetName,1,1690088801460.b119aeea37855bdcd969ef25a21dbe96.', STARTKEY => '1', ENDKEY => ''}] 2023-07-23 05:06:59,484 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-23 05:06:59,484 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690088819484"}]},"ts":"9223372036854775807"} 2023-07-23 05:06:59,486 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-23 05:06:59,488 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-23 05:06:59,490 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 77 msec 2023-07-23 05:06:59,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-23 05:06:59,536 INFO [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-23 05:06:59,554 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-23 05:06:59,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-23 05:06:59,559 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-23 05:06:59,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-23 05:06:59,590 INFO [Listener at jenkins-hbase4.apache.org/33827] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=750 (was 704) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-154173811_17 at /127.0.0.1:41858 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1315 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x76a1f2b0-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (583231684) connection to jenkins-hbase4.apache.org/172.31.14.131:42893 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/cluster_6208cc7e-f826-e9bd-232f-095b41f2684b/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/cluster_6208cc7e-f826-e9bd-232f-095b41f2684b/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/cluster_6208cc7e-f826-e9bd-232f-095b41f2684b/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/cluster_6208cc7e-f826-e9bd-232f-095b41f2684b/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (583231684) connection to jenkins-hbase4.apache.org/172.31.14.131:36563 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/cluster_6208cc7e-f826-e9bd-232f-095b41f2684b/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x76a1f2b0-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/cluster_6208cc7e-f826-e9bd-232f-095b41f2684b/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-154173811_17 at /127.0.0.1:48488 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-154173811_17 at /127.0.0.1:38134 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x76a1f2b0-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1424424191_1 at /127.0.0.1:41828 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: hconnection-0x76a1f2b0-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=920 (was 901) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=266 (was 112) - SystemLoadAverage LEAK? -, ProcessCount=178 (was 172) - ProcessCount LEAK? -, AvailableMemoryMB=6655 (was 8490) 2023-07-23 05:06:59,591 WARN [Listener at jenkins-hbase4.apache.org/33827] hbase.ResourceChecker(130): Thread=750 is superior to 500 2023-07-23 05:06:59,613 INFO [Listener at jenkins-hbase4.apache.org/33827] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=750, OpenFileDescriptor=920, MaxFileDescriptor=60000, SystemLoadAverage=266, ProcessCount=178, AvailableMemoryMB=6654 2023-07-23 05:06:59,614 WARN [Listener at jenkins-hbase4.apache.org/33827] hbase.ResourceChecker(130): Thread=750 is superior to 500 2023-07-23 05:06:59,616 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-23 05:06:59,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-23 05:06:59,621 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 05:06:59,622 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-23 05:06:59,623 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 05:06:59,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-23 05:06:59,628 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemState/b5ee9343c1ccccd224bd27771ca59390 2023-07-23 05:06:59,628 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemState/6ffcf0eaef211c5bd27f4d1045cc5e7b 2023-07-23 05:06:59,628 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemState/b5ee9343c1ccccd224bd27771ca59390 empty. 2023-07-23 05:06:59,629 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemState/6ffcf0eaef211c5bd27f4d1045cc5e7b empty. 2023-07-23 05:06:59,629 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemState/b5ee9343c1ccccd224bd27771ca59390 2023-07-23 05:06:59,629 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemState/6ffcf0eaef211c5bd27f4d1045cc5e7b 2023-07-23 05:06:59,629 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-23 05:06:59,648 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-23 05:06:59,650 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => b5ee9343c1ccccd224bd27771ca59390, NAME => 'testtb-testExportFileSystemState,,1690088819615.b5ee9343c1ccccd224bd27771ca59390.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp 2023-07-23 05:06:59,650 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6ffcf0eaef211c5bd27f4d1045cc5e7b, NAME => 'testtb-testExportFileSystemState,1,1690088819615.6ffcf0eaef211c5bd27f4d1045cc5e7b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp 2023-07-23 05:06:59,668 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690088819615.b5ee9343c1ccccd224bd27771ca59390.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:06:59,669 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing b5ee9343c1ccccd224bd27771ca59390, disabling compactions & flushes 2023-07-23 05:06:59,669 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690088819615.b5ee9343c1ccccd224bd27771ca59390. 2023-07-23 05:06:59,669 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690088819615.b5ee9343c1ccccd224bd27771ca59390. 2023-07-23 05:06:59,669 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690088819615.b5ee9343c1ccccd224bd27771ca59390. after waiting 0 ms 2023-07-23 05:06:59,669 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690088819615.6ffcf0eaef211c5bd27f4d1045cc5e7b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:06:59,669 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690088819615.b5ee9343c1ccccd224bd27771ca59390. 2023-07-23 05:06:59,670 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 6ffcf0eaef211c5bd27f4d1045cc5e7b, disabling compactions & flushes 2023-07-23 05:06:59,670 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690088819615.b5ee9343c1ccccd224bd27771ca59390. 2023-07-23 05:06:59,670 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for b5ee9343c1ccccd224bd27771ca59390: 2023-07-23 05:06:59,670 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690088819615.6ffcf0eaef211c5bd27f4d1045cc5e7b. 2023-07-23 05:06:59,670 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690088819615.6ffcf0eaef211c5bd27f4d1045cc5e7b. 2023-07-23 05:06:59,671 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690088819615.6ffcf0eaef211c5bd27f4d1045cc5e7b. after waiting 0 ms 2023-07-23 05:06:59,671 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690088819615.6ffcf0eaef211c5bd27f4d1045cc5e7b. 2023-07-23 05:06:59,671 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690088819615.6ffcf0eaef211c5bd27f4d1045cc5e7b. 2023-07-23 05:06:59,671 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 6ffcf0eaef211c5bd27f4d1045cc5e7b: 2023-07-23 05:06:59,673 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 05:06:59,674 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690088819615.b5ee9343c1ccccd224bd27771ca59390.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690088819674"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088819674"}]},"ts":"1690088819674"} 2023-07-23 05:06:59,675 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690088819615.6ffcf0eaef211c5bd27f4d1045cc5e7b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690088819674"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088819674"}]},"ts":"1690088819674"} 2023-07-23 05:06:59,677 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 05:06:59,678 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 05:06:59,678 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088819678"}]},"ts":"1690088819678"} 2023-07-23 05:06:59,680 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-23 05:06:59,684 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 05:06:59,685 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 05:06:59,685 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 05:06:59,685 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 05:06:59,685 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 05:06:59,685 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b5ee9343c1ccccd224bd27771ca59390, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6ffcf0eaef211c5bd27f4d1045cc5e7b, ASSIGN}] 2023-07-23 05:06:59,688 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6ffcf0eaef211c5bd27f4d1045cc5e7b, ASSIGN 2023-07-23 05:06:59,688 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b5ee9343c1ccccd224bd27771ca59390, ASSIGN 2023-07-23 05:06:59,689 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6ffcf0eaef211c5bd27f4d1045cc5e7b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37855,1690088792757; forceNewPlan=false, retain=false 2023-07-23 05:06:59,689 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b5ee9343c1ccccd224bd27771ca59390, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45437,1690088792660; forceNewPlan=false, retain=false 2023-07-23 05:06:59,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-23 05:06:59,839 INFO [jenkins-hbase4:32809] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 05:06:59,842 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=b5ee9343c1ccccd224bd27771ca59390, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:06:59,842 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=6ffcf0eaef211c5bd27f4d1045cc5e7b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:06:59,842 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690088819615.b5ee9343c1ccccd224bd27771ca59390.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690088819841"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088819841"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088819841"}]},"ts":"1690088819841"} 2023-07-23 05:06:59,842 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690088819615.6ffcf0eaef211c5bd27f4d1045cc5e7b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690088819841"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088819841"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088819841"}]},"ts":"1690088819841"} 2023-07-23 05:06:59,844 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure b5ee9343c1ccccd224bd27771ca59390, server=jenkins-hbase4.apache.org,45437,1690088792660}] 2023-07-23 05:06:59,845 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 6ffcf0eaef211c5bd27f4d1045cc5e7b, server=jenkins-hbase4.apache.org,37855,1690088792757}] 2023-07-23 05:06:59,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-23 05:06:59,999 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:06:59,999 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-23 05:07:00,003 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53228, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-23 05:07:00,004 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1690088819615.b5ee9343c1ccccd224bd27771ca59390. 2023-07-23 05:07:00,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b5ee9343c1ccccd224bd27771ca59390, NAME => 'testtb-testExportFileSystemState,,1690088819615.b5ee9343c1ccccd224bd27771ca59390.', STARTKEY => '', ENDKEY => '1'} 2023-07-23 05:07:00,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1690088819615.b5ee9343c1ccccd224bd27771ca59390. service=AccessControlService 2023-07-23 05:07:00,006 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:07:00,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState b5ee9343c1ccccd224bd27771ca59390 2023-07-23 05:07:00,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690088819615.b5ee9343c1ccccd224bd27771ca59390.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:07:00,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b5ee9343c1ccccd224bd27771ca59390 2023-07-23 05:07:00,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b5ee9343c1ccccd224bd27771ca59390 2023-07-23 05:07:00,010 INFO [StoreOpener-b5ee9343c1ccccd224bd27771ca59390-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b5ee9343c1ccccd224bd27771ca59390 2023-07-23 05:07:00,012 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1690088819615.6ffcf0eaef211c5bd27f4d1045cc5e7b. 2023-07-23 05:07:00,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6ffcf0eaef211c5bd27f4d1045cc5e7b, NAME => 'testtb-testExportFileSystemState,1,1690088819615.6ffcf0eaef211c5bd27f4d1045cc5e7b.', STARTKEY => '1', ENDKEY => ''} 2023-07-23 05:07:00,012 DEBUG [StoreOpener-b5ee9343c1ccccd224bd27771ca59390-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemState/b5ee9343c1ccccd224bd27771ca59390/cf 2023-07-23 05:07:00,012 DEBUG [StoreOpener-b5ee9343c1ccccd224bd27771ca59390-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemState/b5ee9343c1ccccd224bd27771ca59390/cf 2023-07-23 05:07:00,013 INFO [StoreOpener-b5ee9343c1ccccd224bd27771ca59390-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b5ee9343c1ccccd224bd27771ca59390 columnFamilyName cf 2023-07-23 05:07:00,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1690088819615.6ffcf0eaef211c5bd27f4d1045cc5e7b. service=AccessControlService 2023-07-23 05:07:00,013 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:07:00,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 6ffcf0eaef211c5bd27f4d1045cc5e7b 2023-07-23 05:07:00,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690088819615.6ffcf0eaef211c5bd27f4d1045cc5e7b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:07:00,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6ffcf0eaef211c5bd27f4d1045cc5e7b 2023-07-23 05:07:00,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6ffcf0eaef211c5bd27f4d1045cc5e7b 2023-07-23 05:07:00,015 INFO [StoreOpener-b5ee9343c1ccccd224bd27771ca59390-1] regionserver.HStore(310): Store=b5ee9343c1ccccd224bd27771ca59390/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:07:00,016 INFO [StoreOpener-6ffcf0eaef211c5bd27f4d1045cc5e7b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6ffcf0eaef211c5bd27f4d1045cc5e7b 2023-07-23 05:07:00,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemState/b5ee9343c1ccccd224bd27771ca59390 2023-07-23 05:07:00,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemState/b5ee9343c1ccccd224bd27771ca59390 2023-07-23 05:07:00,018 DEBUG [StoreOpener-6ffcf0eaef211c5bd27f4d1045cc5e7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemState/6ffcf0eaef211c5bd27f4d1045cc5e7b/cf 2023-07-23 05:07:00,018 DEBUG [StoreOpener-6ffcf0eaef211c5bd27f4d1045cc5e7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemState/6ffcf0eaef211c5bd27f4d1045cc5e7b/cf 2023-07-23 05:07:00,019 INFO [StoreOpener-6ffcf0eaef211c5bd27f4d1045cc5e7b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6ffcf0eaef211c5bd27f4d1045cc5e7b columnFamilyName cf 2023-07-23 05:07:00,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b5ee9343c1ccccd224bd27771ca59390 2023-07-23 05:07:00,021 INFO [StoreOpener-6ffcf0eaef211c5bd27f4d1045cc5e7b-1] regionserver.HStore(310): Store=6ffcf0eaef211c5bd27f4d1045cc5e7b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:07:00,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemState/6ffcf0eaef211c5bd27f4d1045cc5e7b 2023-07-23 05:07:00,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemState/6ffcf0eaef211c5bd27f4d1045cc5e7b 2023-07-23 05:07:00,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemState/b5ee9343c1ccccd224bd27771ca59390/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 05:07:00,027 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b5ee9343c1ccccd224bd27771ca59390; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58997165, jitterRate=-0.12087373435497284}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 05:07:00,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b5ee9343c1ccccd224bd27771ca59390: 2023-07-23 05:07:00,029 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1690088819615.b5ee9343c1ccccd224bd27771ca59390., pid=30, masterSystemTime=1690088819996 2023-07-23 05:07:00,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6ffcf0eaef211c5bd27f4d1045cc5e7b 2023-07-23 05:07:00,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1690088819615.b5ee9343c1ccccd224bd27771ca59390. 2023-07-23 05:07:00,031 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1690088819615.b5ee9343c1ccccd224bd27771ca59390. 2023-07-23 05:07:00,031 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=b5ee9343c1ccccd224bd27771ca59390, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:00,032 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1690088819615.b5ee9343c1ccccd224bd27771ca59390.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690088820031"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690088820031"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690088820031"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690088820031"}]},"ts":"1690088820031"} 2023-07-23 05:07:00,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemState/6ffcf0eaef211c5bd27f4d1045cc5e7b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 05:07:00,039 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6ffcf0eaef211c5bd27f4d1045cc5e7b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61169965, jitterRate=-0.08849649131298065}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 05:07:00,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6ffcf0eaef211c5bd27f4d1045cc5e7b: 2023-07-23 05:07:00,040 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1690088819615.6ffcf0eaef211c5bd27f4d1045cc5e7b., pid=31, masterSystemTime=1690088819999 2023-07-23 05:07:00,040 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-23 05:07:00,040 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure b5ee9343c1ccccd224bd27771ca59390, server=jenkins-hbase4.apache.org,45437,1690088792660 in 190 msec 2023-07-23 05:07:00,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1690088819615.6ffcf0eaef211c5bd27f4d1045cc5e7b. 2023-07-23 05:07:00,045 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b5ee9343c1ccccd224bd27771ca59390, ASSIGN in 355 msec 2023-07-23 05:07:00,046 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1690088819615.6ffcf0eaef211c5bd27f4d1045cc5e7b. 2023-07-23 05:07:00,046 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=6ffcf0eaef211c5bd27f4d1045cc5e7b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:00,046 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1690088819615.6ffcf0eaef211c5bd27f4d1045cc5e7b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690088820046"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690088820046"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690088820046"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690088820046"}]},"ts":"1690088820046"} 2023-07-23 05:07:00,050 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-23 05:07:00,050 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 6ffcf0eaef211c5bd27f4d1045cc5e7b, server=jenkins-hbase4.apache.org,37855,1690088792757 in 203 msec 2023-07-23 05:07:00,052 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-23 05:07:00,053 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6ffcf0eaef211c5bd27f4d1045cc5e7b, ASSIGN in 365 msec 2023-07-23 05:07:00,053 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 05:07:00,054 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088820053"}]},"ts":"1690088820053"} 2023-07-23 05:07:00,055 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-23 05:07:00,058 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 05:07:00,058 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-23 05:07:00,060 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45437] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-23 05:07:00,061 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:00,061 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:00,061 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:00,061 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:00,063 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 05:07:00,063 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 05:07:00,063 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 05:07:00,064 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 05:07:00,065 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 446 msec 2023-07-23 05:07:00,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-23 05:07:00,228 INFO [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-23 05:07:00,231 DEBUG [Listener at jenkins-hbase4.apache.org/33827] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-23 05:07:00,231 DEBUG [Listener at jenkins-hbase4.apache.org/33827] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1690088819615.b5ee9343c1ccccd224bd27771ca59390. 2023-07-23 05:07:00,233 INFO [Listener at jenkins-hbase4.apache.org/33827] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 05:07:00,243 DEBUG [hconnection-0x462f8946-shared-pool-11] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:00,248 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53244, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:00,253 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 05:07:00,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690088820253 (current time:1690088820253). 2023-07-23 05:07:00,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 05:07:00,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] zookeeper.ReadOnlyZKClient(139): Connect 0x1cc97ea6 to 127.0.0.1:57388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:07:00,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40c31000, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:07:00,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:00,261 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51184, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:00,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1cc97ea6 to 127.0.0.1:57388 2023-07-23 05:07:00,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:07:00,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] zookeeper.ReadOnlyZKClient(139): Connect 0x199cadc9 to 127.0.0.1:57388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:07:00,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ef7cc12, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:07:00,369 DEBUG [hconnection-0x166c86dc-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:00,373 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55390, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:00,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:00,379 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48482, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:00,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x199cadc9 to 127.0.0.1:57388 2023-07-23 05:07:00,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:07:00,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-23 05:07:00,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 05:07:00,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 05:07:00,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-23 05:07:00,386 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-23 05:07:00,387 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690089420387 2023-07-23 05:07:00,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 05:07:00,387 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-23 05:07:00,389 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 05:07:00,389 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 05:07:00,389 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-23 05:07:00,391 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-23 05:07:00,392 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-23 05:07:00,393 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-23 05:07:00,394 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690089420394 2023-07-23 05:07:00,422 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,422 INFO [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-23 05:07:00,422 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:00,423 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-23 05:07:00,423 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-23 05:07:00,424 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,424 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,427 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:00,427 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:00,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:00,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:00,427 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:00,427 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:00,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:00,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:00,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:00,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:00,428 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:00,428 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:00,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,428 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,428 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:00,428 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,428 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,428 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 05:07:00,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-23 05:07:00,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-23 05:07:00,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-23 05:07:00,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,429 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-23 05:07:00,429 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-23 05:07:00,429 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-23 05:07:00,429 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,429 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-23 05:07:00,429 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,429 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:00,429 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-23 05:07:00,430 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:00,432 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,432 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-23 05:07:00,432 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-23 05:07:00,432 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-23 05:07:00,432 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-23 05:07:00,432 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-23 05:07:00,432 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:00,432 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37855,1690088792757' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-23 05:07:00,433 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-23 05:07:00,432 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44949,1690088792720' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-23 05:07:00,434 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-23 05:07:00,434 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45437,1690088792660' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-23 05:07:00,440 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,440 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,440 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:00,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:00,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:00,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:00,440 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:00,441 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,441 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,441 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:07:00,441 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:00,441 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:07:00,441 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,441 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:07:00,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:00,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:00,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:00,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:00,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:00,444 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45437,1690088792660' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-23 05:07:00,445 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11781746[Count = 1] remaining members to acquire global barrier 2023-07-23 05:07:00,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:00,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:00,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:00,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:00,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:00,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:00,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:00,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:00,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:00,448 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37855,1690088792757' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-23 05:07:00,448 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11781746[Count = 0] remaining members to acquire global barrier 2023-07-23 05:07:00,448 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-23 05:07:00,448 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,449 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,449 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,449 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,450 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-23 05:07:00,450 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-23 05:07:00,450 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-23 05:07:00,450 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44949,1690088792720' in zk 2023-07-23 05:07:00,450 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-23 05:07:00,450 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:07:00,450 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:07:00,450 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690088819615.b5ee9343c1ccccd224bd27771ca59390. 2023-07-23 05:07:00,450 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:00,450 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690088819615.6ffcf0eaef211c5bd27f4d1045cc5e7b. 2023-07-23 05:07:00,450 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690088819615.b5ee9343c1ccccd224bd27771ca59390. started... 2023-07-23 05:07:00,450 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:07:00,451 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:07:00,450 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690088819615.6ffcf0eaef211c5bd27f4d1045cc5e7b. started... 2023-07-23 05:07:00,451 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:00,453 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b5ee9343c1ccccd224bd27771ca59390: 2023-07-23 05:07:00,453 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 05:07:00,453 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6ffcf0eaef211c5bd27f4d1045cc5e7b: 2023-07-23 05:07:00,453 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690088819615.b5ee9343c1ccccd224bd27771ca59390.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,453 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690088819615.6ffcf0eaef211c5bd27f4d1045cc5e7b.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,453 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:07:00,453 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:07:00,453 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 05:07:00,453 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 05:07:00,455 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-23 05:07:00,455 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:00,455 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-23 05:07:00,489 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:07:00,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 05:07:00,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:07:00,491 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 05:07:00,492 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690088819615.6ffcf0eaef211c5bd27f4d1045cc5e7b. completed. 2023-07-23 05:07:00,492 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690088819615.6ffcf0eaef211c5bd27f4d1045cc5e7b. 2023-07-23 05:07:00,492 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:07:00,492 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:07:00,492 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:00,492 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-23 05:07:00,492 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37855,1690088792757' in zk 2023-07-23 05:07:00,492 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690088819615.b5ee9343c1ccccd224bd27771ca59390. completed. 2023-07-23 05:07:00,492 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690088819615.b5ee9343c1ccccd224bd27771ca59390. 2023-07-23 05:07:00,493 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:07:00,493 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:07:00,493 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:00,493 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-23 05:07:00,493 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45437,1690088792660' in zk 2023-07-23 05:07:00,494 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:00,494 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-23 05:07:00,494 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:00,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:00,494 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-23 05:07:00,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:00,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:00,496 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:00,496 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-23 05:07:00,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:00,496 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:00,496 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-23 05:07:00,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:00,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:00,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:00,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:00,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:00,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:00,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:00,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:00,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37855,1690088792757': 2023-07-23 05:07:00,501 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37855,1690088792757' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-23 05:07:00,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:00,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:00,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:00,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:00,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:00,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:00,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:00,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:00,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:00,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:00,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:00,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:00,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45437,1690088792660': 2023-07-23 05:07:00,505 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45437,1690088792660' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-23 05:07:00,505 INFO [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-23 05:07:00,505 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 05:07:00,505 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 05:07:00,505 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,505 INFO [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 05:07:00,507 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,507 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,507 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,507 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,507 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:00,507 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:00,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:00,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:00,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,507 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:00,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:00,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:00,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:00,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:00,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:00,508 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:00,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:00,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:00,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,509 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:00,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:00,510 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:00,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:00,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:00,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:00,512 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:00,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:00,512 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:00,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,513 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:00,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:00,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:00,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:00,517 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:00,517 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:00,517 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:00,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:00,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:00,518 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:00,517 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:00,517 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:00,517 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:00,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:00,519 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:00,519 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:00,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:00,518 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,518 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:00,520 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-23 05:07:00,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:00,520 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,519 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:00,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:00,520 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:00,520 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:00,520 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:00,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:00,520 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 05:07:00,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:00,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:00,520 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:00,521 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:00,521 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,521 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,521 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-23 05:07:00,534 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,535 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,559 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,581 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-23 05:07:00,581 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,582 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:00,582 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690088820387Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1690088820534 (+147 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1690088820534Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1690088820534Writing data manifest for emptySnaptb0-testExportFileSystemState at 1690088820539 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1690088820552 (+13 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690088820581 (+29 ms) 2023-07-23 05:07:00,584 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-23 05:07:00,586 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 195 msec 2023-07-23 05:07:00,691 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:07:00,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 05:07:00,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 05:07:00,696 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45437] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1690088819615.b5ee9343c1ccccd224bd27771ca59390. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 05:07:00,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37855] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1690088819615.6ffcf0eaef211c5bd27f4d1045cc5e7b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 05:07:00,702 DEBUG [Listener at jenkins-hbase4.apache.org/33827] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-23 05:07:00,702 DEBUG [Listener at jenkins-hbase4.apache.org/33827] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1690088819615.b5ee9343c1ccccd224bd27771ca59390. 2023-07-23 05:07:00,703 INFO [Listener at jenkins-hbase4.apache.org/33827] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 05:07:00,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 05:07:00,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690088820716 (current time:1690088820716). 2023-07-23 05:07:00,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 05:07:00,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] zookeeper.ReadOnlyZKClient(139): Connect 0x0cf11b51 to 127.0.0.1:57388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:07:00,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@796a17ff, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:07:00,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:00,732 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55404, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:00,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0cf11b51 to 127.0.0.1:57388 2023-07-23 05:07:00,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:07:00,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] zookeeper.ReadOnlyZKClient(139): Connect 0x3717b9ce to 127.0.0.1:57388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:07:00,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a443b99, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:07:00,745 DEBUG [hconnection-0x5a764b91-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:00,746 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55418, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:00,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:00,752 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48496, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:00,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3717b9ce to 127.0.0.1:57388 2023-07-23 05:07:00,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:07:00,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-23 05:07:00,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 05:07:00,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 05:07:00,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-23 05:07:00,759 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-23 05:07:00,760 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690089420760 2023-07-23 05:07:00,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 05:07:00,760 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-23 05:07:00,761 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 05:07:00,762 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-23 05:07:00,762 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-23 05:07:00,762 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 05:07:00,764 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-23 05:07:00,765 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-23 05:07:00,766 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690089420766 2023-07-23 05:07:00,780 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-23 05:07:00,780 INFO [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-23 05:07:00,780 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:00,782 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-23 05:07:00,782 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-23 05:07:00,782 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,782 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,783 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:00,783 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:00,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:00,784 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:00,783 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:00,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:00,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:00,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:00,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:00,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:00,784 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:00,784 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:00,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,785 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,785 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:00,785 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 05:07:00,785 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,785 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-23 05:07:00,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-23 05:07:00,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-23 05:07:00,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,785 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-23 05:07:00,785 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-23 05:07:00,785 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-23 05:07:00,786 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-23 05:07:00,786 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-23 05:07:00,786 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-23 05:07:00,786 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-23 05:07:00,786 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:00,786 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:00,786 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-23 05:07:00,788 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-23 05:07:00,788 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-23 05:07:00,788 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:00,787 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-23 05:07:00,789 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-23 05:07:00,789 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-23 05:07:00,788 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-23 05:07:00,789 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45437,1690088792660' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-23 05:07:00,789 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44949,1690088792720' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-23 05:07:00,789 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-23 05:07:00,789 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37855,1690088792757' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-23 05:07:00,791 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,792 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,792 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,792 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:07:00,792 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,792 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:07:00,794 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:00,794 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:00,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:00,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:00,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:00,796 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:00,797 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,797 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:07:00,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:00,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 05:07:00,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:00,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:00,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:00,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:00,798 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45437,1690088792660' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-23 05:07:00,798 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19026c93[Count = 1] remaining members to acquire global barrier 2023-07-23 05:07:00,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:00,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:00,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:00,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:00,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:00,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 05:07:00,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:00,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:00,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:00,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:00,800 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37855,1690088792757' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-23 05:07:00,800 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19026c93[Count = 0] remaining members to acquire global barrier 2023-07-23 05:07:00,800 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-23 05:07:00,800 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,802 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,802 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,802 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,802 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:00,802 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-23 05:07:00,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,802 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-23 05:07:00,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,802 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:07:00,802 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-23 05:07:00,802 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690088819615.6ffcf0eaef211c5bd27f4d1045cc5e7b. 2023-07-23 05:07:00,802 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-23 05:07:00,803 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690088819615.6ffcf0eaef211c5bd27f4d1045cc5e7b. started... 2023-07-23 05:07:00,803 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:07:00,803 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:07:00,803 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690088819615.b5ee9343c1ccccd224bd27771ca59390. 2023-07-23 05:07:00,803 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:00,803 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690088819615.b5ee9343c1ccccd224bd27771ca59390. started... 2023-07-23 05:07:00,802 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:07:00,803 INFO [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b5ee9343c1ccccd224bd27771ca59390 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-23 05:07:00,803 INFO [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6ffcf0eaef211c5bd27f4d1045cc5e7b 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-23 05:07:00,803 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 05:07:00,803 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44949,1690088792720' in zk 2023-07-23 05:07:00,805 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-23 05:07:00,805 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:00,805 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-23 05:07:00,829 INFO [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023072301eb5e7c685d4bc08ddcefd561e9819d to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023072301eb5e7c685d4bc08ddcefd561e9819d 2023-07-23 05:07:00,830 INFO [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023072321488aae519c4722b2904b475524a80e to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023072321488aae519c4722b2904b475524a80e 2023-07-23 05:07:00,841 INFO [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemState/b5ee9343c1ccccd224bd27771ca59390/.tmp/cf/b9d75f8bb4694c0ea77883d998df11d3 2023-07-23 05:07:00,849 INFO [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemState/6ffcf0eaef211c5bd27f4d1045cc5e7b/.tmp/cf/1bc33fe9b5ef4ab7b7579b1f65ac65b1 2023-07-23 05:07:00,849 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemState/b5ee9343c1ccccd224bd27771ca59390/.tmp/cf/b9d75f8bb4694c0ea77883d998df11d3 as hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemState/b5ee9343c1ccccd224bd27771ca59390/cf/b9d75f8bb4694c0ea77883d998df11d3 2023-07-23 05:07:00,856 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemState/6ffcf0eaef211c5bd27f4d1045cc5e7b/.tmp/cf/1bc33fe9b5ef4ab7b7579b1f65ac65b1 as hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemState/6ffcf0eaef211c5bd27f4d1045cc5e7b/cf/1bc33fe9b5ef4ab7b7579b1f65ac65b1 2023-07-23 05:07:00,863 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:07:00,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 05:07:00,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:07:00,865 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 05:07:00,867 INFO [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemState/b5ee9343c1ccccd224bd27771ca59390/cf/b9d75f8bb4694c0ea77883d998df11d3, entries=2, sequenceid=6, filesize=5.2 K 2023-07-23 05:07:00,868 INFO [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for b5ee9343c1ccccd224bd27771ca59390 in 65ms, sequenceid=6, compaction requested=false 2023-07-23 05:07:00,869 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-23 05:07:00,869 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b5ee9343c1ccccd224bd27771ca59390: 2023-07-23 05:07:00,870 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690088819615.b5ee9343c1ccccd224bd27771ca59390.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-23 05:07:00,870 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:07:00,870 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemState/b5ee9343c1ccccd224bd27771ca59390/cf/b9d75f8bb4694c0ea77883d998df11d3] hfiles 2023-07-23 05:07:00,870 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemState/b5ee9343c1ccccd224bd27771ca59390/cf/b9d75f8bb4694c0ea77883d998df11d3 for snapshot=snaptb0-testExportFileSystemState 2023-07-23 05:07:00,871 INFO [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemState/6ffcf0eaef211c5bd27f4d1045cc5e7b/cf/1bc33fe9b5ef4ab7b7579b1f65ac65b1, entries=48, sequenceid=6, filesize=13.0 K 2023-07-23 05:07:00,872 INFO [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 6ffcf0eaef211c5bd27f4d1045cc5e7b in 69ms, sequenceid=6, compaction requested=false 2023-07-23 05:07:00,874 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6ffcf0eaef211c5bd27f4d1045cc5e7b: 2023-07-23 05:07:00,874 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690088819615.6ffcf0eaef211c5bd27f4d1045cc5e7b.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-23 05:07:00,875 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:07:00,875 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemState/6ffcf0eaef211c5bd27f4d1045cc5e7b/cf/1bc33fe9b5ef4ab7b7579b1f65ac65b1] hfiles 2023-07-23 05:07:00,875 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemState/6ffcf0eaef211c5bd27f4d1045cc5e7b/cf/1bc33fe9b5ef4ab7b7579b1f65ac65b1 for snapshot=snaptb0-testExportFileSystemState 2023-07-23 05:07:00,887 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690088819615.b5ee9343c1ccccd224bd27771ca59390. completed. 2023-07-23 05:07:00,887 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690088819615.b5ee9343c1ccccd224bd27771ca59390. 2023-07-23 05:07:00,887 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:07:00,887 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:07:00,887 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:00,887 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-23 05:07:00,887 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45437,1690088792660' in zk 2023-07-23 05:07:00,889 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690088819615.6ffcf0eaef211c5bd27f4d1045cc5e7b. completed. 2023-07-23 05:07:00,889 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690088819615.6ffcf0eaef211c5bd27f4d1045cc5e7b. 2023-07-23 05:07:00,889 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:07:00,889 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:07:00,889 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:00,890 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-23 05:07:00,890 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37855,1690088792757' in zk 2023-07-23 05:07:00,892 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-23 05:07:00,892 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:00,892 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:00,892 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-23 05:07:00,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:00,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:00,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:00,896 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:00,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:00,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:00,896 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-23 05:07:00,896 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:00,896 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-23 05:07:00,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 05:07:00,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:00,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:00,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:00,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:00,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 05:07:00,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:00,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:00,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:00,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45437,1690088792660': 2023-07-23 05:07:00,901 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45437,1690088792660' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-23 05:07:00,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:00,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:00,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:00,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:00,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:00,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 05:07:00,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:00,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:00,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:00,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:00,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 05:07:00,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:00,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:00,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:00,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37855,1690088792757': 2023-07-23 05:07:00,904 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37855,1690088792757' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-23 05:07:00,904 INFO [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-23 05:07:00,904 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 05:07:00,904 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 05:07:00,904 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-23 05:07:00,905 INFO [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 05:07:00,906 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,906 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,906 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,907 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,907 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:00,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:00,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:00,906 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:00,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,907 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:00,907 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:00,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:00,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:00,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:00,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:00,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:00,908 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:00,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 05:07:00,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:00,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:00,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,908 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:00,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:00,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 05:07:00,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:00,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:00,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:00,910 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:00,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:00,910 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:00,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 05:07:00,911 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:00,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:00,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:00,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:00,914 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:00,914 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,914 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:00,914 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:00,914 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:00,914 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:00,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:00,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:00,914 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:00,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:00,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:00,914 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,914 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:00,914 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:00,914 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-23 05:07:00,914 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:00,915 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-23 05:07:00,915 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:00,915 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-23 05:07:00,915 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:00,916 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 05:07:00,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:00,916 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:00,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:00,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:00,916 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,917 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:00,917 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:00,917 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:00,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:00,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:00,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:00,917 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023072321488aae519c4722b2904b475524a80e, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023072301eb5e7c685d4bc08ddcefd561e9819d] mob files 2023-07-23 05:07:00,918 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023072321488aae519c4722b2904b475524a80e 2023-07-23 05:07:00,918 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023072301eb5e7c685d4bc08ddcefd561e9819d 2023-07-23 05:07:00,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-23 05:07:00,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,952 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,995 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-23 05:07:00,995 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,996 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-23 05:07:00,996 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690088820760Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1690088820926 (+166 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1690088820926Loading Region manifests for snaptb0-testExportFileSystemState at 1690088820926Writing data manifest for snaptb0-testExportFileSystemState at 1690088820929 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1690088820943 (+14 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690088820995 (+52 ms) 2023-07-23 05:07:00,998 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-23 05:07:01,000 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 238 msec 2023-07-23 05:07:01,065 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:07:01,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 05:07:01,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 05:07:01,066 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088821066 2023-07-23 05:07:01,067 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38911, tgtDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088821066, rawTgtDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088821066, srcFsUri=hdfs://localhost:38911, srcDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd 2023-07-23 05:07:01,101 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38911, inputRoot=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd 2023-07-23 05:07:01,102 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_19848826_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088821066, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088821066/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-23 05:07:01,102 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38911, inputRoot=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd, snapshotDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-23 05:07:01,127 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088821066/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-23 05:07:01,171 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:01,171 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:01,172 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:01,173 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:01,173 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:01,174 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:01,174 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:01,252 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/hadoop-6046062113743944472.jar 2023-07-23 05:07:01,252 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:01,253 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:01,253 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:01,253 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:01,254 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:01,254 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:01,254 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 05:07:01,255 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 05:07:01,255 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 05:07:01,256 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 05:07:01,256 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 05:07:01,257 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 05:07:01,257 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 05:07:01,257 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 05:07:01,258 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 05:07:01,259 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 05:07:01,259 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:07:01,260 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:07:01,260 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 05:07:01,261 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:07:01,261 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:07:01,262 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 05:07:01,262 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 05:07:01,766 WARN [Listener at jenkins-hbase4.apache.org/33827] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 05:07:01,769 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-23 05:07:01,772 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-23 05:07:03,767 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 05:07:03,767 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 05:07:03,772 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088800324_0001_000001 (auth:SIMPLE) 2023-07-23 05:07:04,326 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088800324_0002_000001 (auth:SIMPLE) 2023-07-23 05:07:04,904 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 05:07:08,771 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088800324_0002_000001 (auth:SIMPLE) 2023-07-23 05:07:11,033 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088800324_0002_000001 (auth:SIMPLE) 2023-07-23 05:07:15,033 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 05:07:15,035 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 05:07:15,045 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-23 05:07:15,046 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 05:07:15,046 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 05:07:15,047 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-154173811_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-23 05:07:15,047 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(367): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-23 05:07:15,047 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(367): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-23 05:07:15,047 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-154173811_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088821066/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088821066/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-23 05:07:15,048 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(367): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088821066/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-23 05:07:15,048 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(367): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088821066/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-23 05:07:15,056 INFO [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-23 05:07:15,056 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-23 05:07:15,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-23 05:07:15,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-23 05:07:15,066 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088835066"}]},"ts":"1690088835066"} 2023-07-23 05:07:15,067 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-23 05:07:15,069 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-23 05:07:15,070 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b5ee9343c1ccccd224bd27771ca59390, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6ffcf0eaef211c5bd27f4d1045cc5e7b, UNASSIGN}] 2023-07-23 05:07:15,073 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b5ee9343c1ccccd224bd27771ca59390, UNASSIGN 2023-07-23 05:07:15,073 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6ffcf0eaef211c5bd27f4d1045cc5e7b, UNASSIGN 2023-07-23 05:07:15,074 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=b5ee9343c1ccccd224bd27771ca59390, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:15,074 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690088819615.b5ee9343c1ccccd224bd27771ca59390.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690088835074"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088835074"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088835074"}]},"ts":"1690088835074"} 2023-07-23 05:07:15,075 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=6ffcf0eaef211c5bd27f4d1045cc5e7b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:15,075 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690088819615.6ffcf0eaef211c5bd27f4d1045cc5e7b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690088835075"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088835075"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088835075"}]},"ts":"1690088835075"} 2023-07-23 05:07:15,076 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure b5ee9343c1ccccd224bd27771ca59390, server=jenkins-hbase4.apache.org,45437,1690088792660}] 2023-07-23 05:07:15,077 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 6ffcf0eaef211c5bd27f4d1045cc5e7b, server=jenkins-hbase4.apache.org,37855,1690088792757}] 2023-07-23 05:07:15,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-23 05:07:15,230 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b5ee9343c1ccccd224bd27771ca59390 2023-07-23 05:07:15,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b5ee9343c1ccccd224bd27771ca59390, disabling compactions & flushes 2023-07-23 05:07:15,230 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690088819615.b5ee9343c1ccccd224bd27771ca59390. 2023-07-23 05:07:15,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690088819615.b5ee9343c1ccccd224bd27771ca59390. 2023-07-23 05:07:15,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690088819615.b5ee9343c1ccccd224bd27771ca59390. after waiting 0 ms 2023-07-23 05:07:15,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690088819615.b5ee9343c1ccccd224bd27771ca59390. 2023-07-23 05:07:15,234 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6ffcf0eaef211c5bd27f4d1045cc5e7b 2023-07-23 05:07:15,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6ffcf0eaef211c5bd27f4d1045cc5e7b, disabling compactions & flushes 2023-07-23 05:07:15,235 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690088819615.6ffcf0eaef211c5bd27f4d1045cc5e7b. 2023-07-23 05:07:15,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690088819615.6ffcf0eaef211c5bd27f4d1045cc5e7b. 2023-07-23 05:07:15,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690088819615.6ffcf0eaef211c5bd27f4d1045cc5e7b. after waiting 0 ms 2023-07-23 05:07:15,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690088819615.6ffcf0eaef211c5bd27f4d1045cc5e7b. 2023-07-23 05:07:15,249 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemState/b5ee9343c1ccccd224bd27771ca59390/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 05:07:15,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:07:15,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemState/6ffcf0eaef211c5bd27f4d1045cc5e7b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 05:07:15,251 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690088819615.b5ee9343c1ccccd224bd27771ca59390. 2023-07-23 05:07:15,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b5ee9343c1ccccd224bd27771ca59390: 2023-07-23 05:07:15,254 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b5ee9343c1ccccd224bd27771ca59390 2023-07-23 05:07:15,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:07:15,255 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690088819615.6ffcf0eaef211c5bd27f4d1045cc5e7b. 2023-07-23 05:07:15,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6ffcf0eaef211c5bd27f4d1045cc5e7b: 2023-07-23 05:07:15,256 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=b5ee9343c1ccccd224bd27771ca59390, regionState=CLOSED 2023-07-23 05:07:15,256 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690088819615.b5ee9343c1ccccd224bd27771ca59390.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690088835256"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088835256"}]},"ts":"1690088835256"} 2023-07-23 05:07:15,258 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6ffcf0eaef211c5bd27f4d1045cc5e7b 2023-07-23 05:07:15,258 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=6ffcf0eaef211c5bd27f4d1045cc5e7b, regionState=CLOSED 2023-07-23 05:07:15,258 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690088819615.6ffcf0eaef211c5bd27f4d1045cc5e7b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690088835258"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088835258"}]},"ts":"1690088835258"} 2023-07-23 05:07:15,262 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-23 05:07:15,262 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure b5ee9343c1ccccd224bd27771ca59390, server=jenkins-hbase4.apache.org,45437,1690088792660 in 182 msec 2023-07-23 05:07:15,264 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-23 05:07:15,264 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b5ee9343c1ccccd224bd27771ca59390, UNASSIGN in 192 msec 2023-07-23 05:07:15,264 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 6ffcf0eaef211c5bd27f4d1045cc5e7b, server=jenkins-hbase4.apache.org,37855,1690088792757 in 183 msec 2023-07-23 05:07:15,268 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-23 05:07:15,268 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6ffcf0eaef211c5bd27f4d1045cc5e7b, UNASSIGN in 195 msec 2023-07-23 05:07:15,269 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088835269"}]},"ts":"1690088835269"} 2023-07-23 05:07:15,271 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-23 05:07:15,274 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-23 05:07:15,278 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 219 msec 2023-07-23 05:07:15,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-23 05:07:15,376 INFO [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-23 05:07:15,377 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-23 05:07:15,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-23 05:07:15,381 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-23 05:07:15,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-23 05:07:15,383 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-23 05:07:15,384 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45437] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-23 05:07:15,388 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 05:07:15,388 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 05:07:15,388 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 05:07:15,389 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 05:07:15,389 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-23 05:07:15,389 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-23 05:07:15,390 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-23 05:07:15,390 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-23 05:07:15,391 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemState/b5ee9343c1ccccd224bd27771ca59390 2023-07-23 05:07:15,391 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemState/6ffcf0eaef211c5bd27f4d1045cc5e7b 2023-07-23 05:07:15,391 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 05:07:15,391 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:15,392 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 05:07:15,392 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 05:07:15,392 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:15,392 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:15,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-23 05:07:15,395 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemState/6ffcf0eaef211c5bd27f4d1045cc5e7b/cf, FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemState/6ffcf0eaef211c5bd27f4d1045cc5e7b/recovered.edits] 2023-07-23 05:07:15,395 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 05:07:15,395 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:15,398 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemState/b5ee9343c1ccccd224bd27771ca59390/cf, FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemState/b5ee9343c1ccccd224bd27771ca59390/recovered.edits] 2023-07-23 05:07:15,405 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemState/6ffcf0eaef211c5bd27f4d1045cc5e7b/cf/1bc33fe9b5ef4ab7b7579b1f65ac65b1 to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testExportFileSystemState/6ffcf0eaef211c5bd27f4d1045cc5e7b/cf/1bc33fe9b5ef4ab7b7579b1f65ac65b1 2023-07-23 05:07:15,405 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemState/b5ee9343c1ccccd224bd27771ca59390/cf/b9d75f8bb4694c0ea77883d998df11d3 to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testExportFileSystemState/b5ee9343c1ccccd224bd27771ca59390/cf/b9d75f8bb4694c0ea77883d998df11d3 2023-07-23 05:07:15,409 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemState/b5ee9343c1ccccd224bd27771ca59390/recovered.edits/9.seqid to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testExportFileSystemState/b5ee9343c1ccccd224bd27771ca59390/recovered.edits/9.seqid 2023-07-23 05:07:15,410 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemState/6ffcf0eaef211c5bd27f4d1045cc5e7b/recovered.edits/9.seqid to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testExportFileSystemState/6ffcf0eaef211c5bd27f4d1045cc5e7b/recovered.edits/9.seqid 2023-07-23 05:07:15,411 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemState/b5ee9343c1ccccd224bd27771ca59390 2023-07-23 05:07:15,411 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemState/6ffcf0eaef211c5bd27f4d1045cc5e7b 2023-07-23 05:07:15,411 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-23 05:07:15,412 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-23 05:07:15,412 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-23 05:07:15,416 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023072321488aae519c4722b2904b475524a80e to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023072321488aae519c4722b2904b475524a80e 2023-07-23 05:07:15,418 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023072301eb5e7c685d4bc08ddcefd561e9819d to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023072301eb5e7c685d4bc08ddcefd561e9819d 2023-07-23 05:07:15,418 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-23 05:07:15,422 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-23 05:07:15,425 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-23 05:07:15,427 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-23 05:07:15,429 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-23 05:07:15,429 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-23 05:07:15,429 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1690088819615.b5ee9343c1ccccd224bd27771ca59390.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690088835429"}]},"ts":"9223372036854775807"} 2023-07-23 05:07:15,429 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1690088819615.6ffcf0eaef211c5bd27f4d1045cc5e7b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690088835429"}]},"ts":"9223372036854775807"} 2023-07-23 05:07:15,437 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-23 05:07:15,437 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b5ee9343c1ccccd224bd27771ca59390, NAME => 'testtb-testExportFileSystemState,,1690088819615.b5ee9343c1ccccd224bd27771ca59390.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 6ffcf0eaef211c5bd27f4d1045cc5e7b, NAME => 'testtb-testExportFileSystemState,1,1690088819615.6ffcf0eaef211c5bd27f4d1045cc5e7b.', STARTKEY => '1', ENDKEY => ''}] 2023-07-23 05:07:15,437 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-23 05:07:15,437 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690088835437"}]},"ts":"9223372036854775807"} 2023-07-23 05:07:15,439 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-23 05:07:15,443 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-23 05:07:15,444 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 66 msec 2023-07-23 05:07:15,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-23 05:07:15,495 INFO [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-23 05:07:15,507 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-23 05:07:15,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-23 05:07:15,511 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-23 05:07:15,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-23 05:07:15,546 INFO [Listener at jenkins-hbase4.apache.org/33827] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=765 (was 750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-154173811_17 at /127.0.0.1:39782 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x76a1f2b0-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x76a1f2b0-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-423959953_1 at /127.0.0.1:39754 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2027 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-154173811_17 at /127.0.0.1:59670 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-423959953_1 at /127.0.0.1:58920 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x76a1f2b0-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x76a1f2b0-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-154173811_17 at /127.0.0.1:58928 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (583231684) connection to jenkins-hbase4.apache.org/172.31.14.131:40529 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (583231684) connection to jenkins-hbase4.apache.org/172.31.14.131:33827 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=927 (was 920) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=314 (was 266) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 178) - ProcessCount LEAK? -, AvailableMemoryMB=5829 (was 6654) 2023-07-23 05:07:15,546 WARN [Listener at jenkins-hbase4.apache.org/33827] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-23 05:07:15,574 INFO [Listener at jenkins-hbase4.apache.org/33827] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=765, OpenFileDescriptor=927, MaxFileDescriptor=60000, SystemLoadAverage=314, ProcessCount=182, AvailableMemoryMB=5828 2023-07-23 05:07:15,574 WARN [Listener at jenkins-hbase4.apache.org/33827] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-23 05:07:15,577 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-23 05:07:15,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-23 05:07:15,590 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 05:07:15,591 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-23 05:07:15,592 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 05:07:15,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-23 05:07:15,595 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testConsecutiveExports/c33dea5ba38e39282c709e83d065e3a5 2023-07-23 05:07:15,596 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testConsecutiveExports/c33dea5ba38e39282c709e83d065e3a5 empty. 2023-07-23 05:07:15,597 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testConsecutiveExports/c33dea5ba38e39282c709e83d065e3a5 2023-07-23 05:07:15,606 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testConsecutiveExports/03e9a25a5c1eca652842f2df92f59baa 2023-07-23 05:07:15,607 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testConsecutiveExports/03e9a25a5c1eca652842f2df92f59baa empty. 2023-07-23 05:07:15,608 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testConsecutiveExports/03e9a25a5c1eca652842f2df92f59baa 2023-07-23 05:07:15,608 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-23 05:07:15,633 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-23 05:07:15,635 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 03e9a25a5c1eca652842f2df92f59baa, NAME => 'testtb-testConsecutiveExports,1,1690088835576.03e9a25a5c1eca652842f2df92f59baa.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp 2023-07-23 05:07:15,635 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => c33dea5ba38e39282c709e83d065e3a5, NAME => 'testtb-testConsecutiveExports,,1690088835576.c33dea5ba38e39282c709e83d065e3a5.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp 2023-07-23 05:07:15,647 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690088835576.c33dea5ba38e39282c709e83d065e3a5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:07:15,648 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing c33dea5ba38e39282c709e83d065e3a5, disabling compactions & flushes 2023-07-23 05:07:15,648 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690088835576.c33dea5ba38e39282c709e83d065e3a5. 2023-07-23 05:07:15,648 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690088835576.c33dea5ba38e39282c709e83d065e3a5. 2023-07-23 05:07:15,648 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690088835576.c33dea5ba38e39282c709e83d065e3a5. after waiting 0 ms 2023-07-23 05:07:15,648 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690088835576.c33dea5ba38e39282c709e83d065e3a5. 2023-07-23 05:07:15,648 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690088835576.c33dea5ba38e39282c709e83d065e3a5. 2023-07-23 05:07:15,648 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for c33dea5ba38e39282c709e83d065e3a5: 2023-07-23 05:07:15,649 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690088835576.03e9a25a5c1eca652842f2df92f59baa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:07:15,649 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 03e9a25a5c1eca652842f2df92f59baa, disabling compactions & flushes 2023-07-23 05:07:15,649 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690088835576.03e9a25a5c1eca652842f2df92f59baa. 2023-07-23 05:07:15,649 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690088835576.03e9a25a5c1eca652842f2df92f59baa. 2023-07-23 05:07:15,649 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690088835576.03e9a25a5c1eca652842f2df92f59baa. after waiting 0 ms 2023-07-23 05:07:15,649 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690088835576.03e9a25a5c1eca652842f2df92f59baa. 2023-07-23 05:07:15,649 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690088835576.03e9a25a5c1eca652842f2df92f59baa. 2023-07-23 05:07:15,649 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 03e9a25a5c1eca652842f2df92f59baa: 2023-07-23 05:07:15,652 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 05:07:15,654 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690088835576.c33dea5ba38e39282c709e83d065e3a5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690088835653"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088835653"}]},"ts":"1690088835653"} 2023-07-23 05:07:15,654 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690088835576.03e9a25a5c1eca652842f2df92f59baa.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690088835653"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088835653"}]},"ts":"1690088835653"} 2023-07-23 05:07:15,658 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 05:07:15,659 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 05:07:15,659 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088835659"}]},"ts":"1690088835659"} 2023-07-23 05:07:15,661 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-23 05:07:15,664 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 05:07:15,665 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 05:07:15,665 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 05:07:15,665 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 05:07:15,666 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 05:07:15,666 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c33dea5ba38e39282c709e83d065e3a5, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=03e9a25a5c1eca652842f2df92f59baa, ASSIGN}] 2023-07-23 05:07:15,669 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c33dea5ba38e39282c709e83d065e3a5, ASSIGN 2023-07-23 05:07:15,669 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=03e9a25a5c1eca652842f2df92f59baa, ASSIGN 2023-07-23 05:07:15,671 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c33dea5ba38e39282c709e83d065e3a5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44949,1690088792720; forceNewPlan=false, retain=false 2023-07-23 05:07:15,671 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=03e9a25a5c1eca652842f2df92f59baa, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45437,1690088792660; forceNewPlan=false, retain=false 2023-07-23 05:07:15,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-23 05:07:15,821 INFO [jenkins-hbase4:32809] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 05:07:15,824 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=03e9a25a5c1eca652842f2df92f59baa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:15,824 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=c33dea5ba38e39282c709e83d065e3a5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:15,824 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690088835576.03e9a25a5c1eca652842f2df92f59baa.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690088835823"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088835823"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088835823"}]},"ts":"1690088835823"} 2023-07-23 05:07:15,824 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690088835576.c33dea5ba38e39282c709e83d065e3a5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690088835823"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088835823"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088835823"}]},"ts":"1690088835823"} 2023-07-23 05:07:15,826 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 03e9a25a5c1eca652842f2df92f59baa, server=jenkins-hbase4.apache.org,45437,1690088792660}] 2023-07-23 05:07:15,827 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure c33dea5ba38e39282c709e83d065e3a5, server=jenkins-hbase4.apache.org,44949,1690088792720}] 2023-07-23 05:07:15,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-23 05:07:15,986 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1690088835576.03e9a25a5c1eca652842f2df92f59baa. 2023-07-23 05:07:15,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 03e9a25a5c1eca652842f2df92f59baa, NAME => 'testtb-testConsecutiveExports,1,1690088835576.03e9a25a5c1eca652842f2df92f59baa.', STARTKEY => '1', ENDKEY => ''} 2023-07-23 05:07:15,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1690088835576.03e9a25a5c1eca652842f2df92f59baa. service=AccessControlService 2023-07-23 05:07:15,987 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:07:15,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 03e9a25a5c1eca652842f2df92f59baa 2023-07-23 05:07:15,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690088835576.03e9a25a5c1eca652842f2df92f59baa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:07:15,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 03e9a25a5c1eca652842f2df92f59baa 2023-07-23 05:07:15,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 03e9a25a5c1eca652842f2df92f59baa 2023-07-23 05:07:15,988 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1690088835576.c33dea5ba38e39282c709e83d065e3a5. 2023-07-23 05:07:15,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c33dea5ba38e39282c709e83d065e3a5, NAME => 'testtb-testConsecutiveExports,,1690088835576.c33dea5ba38e39282c709e83d065e3a5.', STARTKEY => '', ENDKEY => '1'} 2023-07-23 05:07:15,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1690088835576.c33dea5ba38e39282c709e83d065e3a5. service=AccessControlService 2023-07-23 05:07:15,988 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:07:15,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports c33dea5ba38e39282c709e83d065e3a5 2023-07-23 05:07:15,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690088835576.c33dea5ba38e39282c709e83d065e3a5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:07:15,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c33dea5ba38e39282c709e83d065e3a5 2023-07-23 05:07:15,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c33dea5ba38e39282c709e83d065e3a5 2023-07-23 05:07:15,990 INFO [StoreOpener-03e9a25a5c1eca652842f2df92f59baa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 03e9a25a5c1eca652842f2df92f59baa 2023-07-23 05:07:15,991 INFO [StoreOpener-c33dea5ba38e39282c709e83d065e3a5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c33dea5ba38e39282c709e83d065e3a5 2023-07-23 05:07:15,992 DEBUG [StoreOpener-03e9a25a5c1eca652842f2df92f59baa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testConsecutiveExports/03e9a25a5c1eca652842f2df92f59baa/cf 2023-07-23 05:07:15,992 DEBUG [StoreOpener-03e9a25a5c1eca652842f2df92f59baa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testConsecutiveExports/03e9a25a5c1eca652842f2df92f59baa/cf 2023-07-23 05:07:15,992 INFO [StoreOpener-03e9a25a5c1eca652842f2df92f59baa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 03e9a25a5c1eca652842f2df92f59baa columnFamilyName cf 2023-07-23 05:07:15,992 DEBUG [StoreOpener-c33dea5ba38e39282c709e83d065e3a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testConsecutiveExports/c33dea5ba38e39282c709e83d065e3a5/cf 2023-07-23 05:07:15,992 DEBUG [StoreOpener-c33dea5ba38e39282c709e83d065e3a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testConsecutiveExports/c33dea5ba38e39282c709e83d065e3a5/cf 2023-07-23 05:07:15,993 INFO [StoreOpener-c33dea5ba38e39282c709e83d065e3a5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c33dea5ba38e39282c709e83d065e3a5 columnFamilyName cf 2023-07-23 05:07:15,993 INFO [StoreOpener-03e9a25a5c1eca652842f2df92f59baa-1] regionserver.HStore(310): Store=03e9a25a5c1eca652842f2df92f59baa/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:07:15,993 INFO [StoreOpener-c33dea5ba38e39282c709e83d065e3a5-1] regionserver.HStore(310): Store=c33dea5ba38e39282c709e83d065e3a5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:07:15,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testConsecutiveExports/03e9a25a5c1eca652842f2df92f59baa 2023-07-23 05:07:15,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testConsecutiveExports/c33dea5ba38e39282c709e83d065e3a5 2023-07-23 05:07:15,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testConsecutiveExports/03e9a25a5c1eca652842f2df92f59baa 2023-07-23 05:07:15,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testConsecutiveExports/c33dea5ba38e39282c709e83d065e3a5 2023-07-23 05:07:15,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 03e9a25a5c1eca652842f2df92f59baa 2023-07-23 05:07:15,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c33dea5ba38e39282c709e83d065e3a5 2023-07-23 05:07:16,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testConsecutiveExports/03e9a25a5c1eca652842f2df92f59baa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 05:07:16,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testConsecutiveExports/c33dea5ba38e39282c709e83d065e3a5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 05:07:16,000 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c33dea5ba38e39282c709e83d065e3a5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65694150, jitterRate=-0.021080881357192993}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 05:07:16,000 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 03e9a25a5c1eca652842f2df92f59baa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71805651, jitterRate=0.06998758018016815}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 05:07:16,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c33dea5ba38e39282c709e83d065e3a5: 2023-07-23 05:07:16,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 03e9a25a5c1eca652842f2df92f59baa: 2023-07-23 05:07:16,002 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1690088835576.03e9a25a5c1eca652842f2df92f59baa., pid=45, masterSystemTime=1690088835978 2023-07-23 05:07:16,002 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1690088835576.c33dea5ba38e39282c709e83d065e3a5., pid=46, masterSystemTime=1690088835979 2023-07-23 05:07:16,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1690088835576.03e9a25a5c1eca652842f2df92f59baa. 2023-07-23 05:07:16,004 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1690088835576.03e9a25a5c1eca652842f2df92f59baa. 2023-07-23 05:07:16,004 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=03e9a25a5c1eca652842f2df92f59baa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:16,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1690088835576.c33dea5ba38e39282c709e83d065e3a5. 2023-07-23 05:07:16,005 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1690088835576.c33dea5ba38e39282c709e83d065e3a5. 2023-07-23 05:07:16,005 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1690088835576.03e9a25a5c1eca652842f2df92f59baa.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690088836004"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690088836004"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690088836004"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690088836004"}]},"ts":"1690088836004"} 2023-07-23 05:07:16,005 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=c33dea5ba38e39282c709e83d065e3a5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:16,005 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1690088835576.c33dea5ba38e39282c709e83d065e3a5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690088836005"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690088836005"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690088836005"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690088836005"}]},"ts":"1690088836005"} 2023-07-23 05:07:16,008 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-23 05:07:16,008 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 03e9a25a5c1eca652842f2df92f59baa, server=jenkins-hbase4.apache.org,45437,1690088792660 in 180 msec 2023-07-23 05:07:16,009 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-23 05:07:16,009 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure c33dea5ba38e39282c709e83d065e3a5, server=jenkins-hbase4.apache.org,44949,1690088792720 in 180 msec 2023-07-23 05:07:16,010 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=03e9a25a5c1eca652842f2df92f59baa, ASSIGN in 342 msec 2023-07-23 05:07:16,011 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-23 05:07:16,011 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c33dea5ba38e39282c709e83d065e3a5, ASSIGN in 343 msec 2023-07-23 05:07:16,012 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 05:07:16,012 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088836012"}]},"ts":"1690088836012"} 2023-07-23 05:07:16,014 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-23 05:07:16,016 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 05:07:16,016 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-23 05:07:16,018 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45437] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-23 05:07:16,020 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:16,020 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:16,020 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:16,020 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:16,021 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-23 05:07:16,022 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-23 05:07:16,022 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-23 05:07:16,022 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-23 05:07:16,023 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 444 msec 2023-07-23 05:07:16,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-23 05:07:16,197 INFO [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-23 05:07:16,199 DEBUG [Listener at jenkins-hbase4.apache.org/33827] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-23 05:07:16,199 DEBUG [Listener at jenkins-hbase4.apache.org/33827] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1690088835576.c33dea5ba38e39282c709e83d065e3a5. 2023-07-23 05:07:16,202 INFO [Listener at jenkins-hbase4.apache.org/33827] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 05:07:16,214 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-23 05:07:16,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690088836214 (current time:1690088836214). 2023-07-23 05:07:16,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 05:07:16,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] zookeeper.ReadOnlyZKClient(139): Connect 0x5af137ac to 127.0.0.1:57388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:07:16,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17cbc22e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:07:16,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:16,225 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52658, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:16,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5af137ac to 127.0.0.1:57388 2023-07-23 05:07:16,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:07:16,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] zookeeper.ReadOnlyZKClient(139): Connect 0x1ca0eea0 to 127.0.0.1:57388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:07:16,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4fbfe6cf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:07:16,234 DEBUG [hconnection-0x6ac97a4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:16,237 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52662, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:16,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:16,243 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34708, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:16,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ca0eea0 to 127.0.0.1:57388 2023-07-23 05:07:16,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:07:16,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-23 05:07:16,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 05:07:16,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-23 05:07:16,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-23 05:07:16,248 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-23 05:07:16,249 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690089436249 2023-07-23 05:07:16,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-23 05:07:16,249 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-23 05:07:16,250 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 05:07:16,250 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 05:07:16,254 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-23 05:07:16,254 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-23 05:07:16,255 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-07-23 05:07:16,256 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-23 05:07:16,257 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690089436257 2023-07-23 05:07:16,269 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,269 INFO [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-23 05:07:16,269 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:16,270 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-23 05:07:16,270 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-23 05:07:16,270 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,271 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,272 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:16,272 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:16,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:16,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:16,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:16,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:16,272 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:16,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:16,272 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:16,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:16,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,273 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:16,273 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,273 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:16,273 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-23 05:07:16,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,273 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-23 05:07:16,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,273 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-23 05:07:16,273 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:16,273 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 05:07:16,273 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-23 05:07:16,274 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-23 05:07:16,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,274 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,274 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-23 05:07:16,274 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-23 05:07:16,274 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-23 05:07:16,274 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:16,274 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:16,274 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,275 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-23 05:07:16,276 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-23 05:07:16,276 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:16,276 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-23 05:07:16,276 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-23 05:07:16,279 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-23 05:07:16,279 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45437,1690088792660' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-23 05:07:16,279 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-23 05:07:16,279 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37855,1690088792757' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-23 05:07:16,279 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-23 05:07:16,279 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44949,1690088792720' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-23 05:07:16,280 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,280 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,280 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:16,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:16,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:16,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:16,283 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:16,283 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,283 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,283 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:07:16,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:16,283 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,283 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:07:16,283 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,283 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:07:16,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:16,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:16,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:16,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:16,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:16,285 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45437,1690088792660' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-23 05:07:16,285 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7821f1bf[Count = 1] remaining members to acquire global barrier 2023-07-23 05:07:16,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:16,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:16,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:16,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:16,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:16,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:16,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:16,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:16,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:16,287 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44949,1690088792720' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-23 05:07:16,287 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7821f1bf[Count = 0] remaining members to acquire global barrier 2023-07-23 05:07:16,287 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-23 05:07:16,287 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,289 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,289 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,289 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,289 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:16,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,289 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-23 05:07:16,289 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-23 05:07:16,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,289 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:16,289 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:07:16,289 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:07:16,289 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690088835576.03e9a25a5c1eca652842f2df92f59baa. 2023-07-23 05:07:16,289 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690088835576.c33dea5ba38e39282c709e83d065e3a5. 2023-07-23 05:07:16,289 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690088835576.03e9a25a5c1eca652842f2df92f59baa. started... 2023-07-23 05:07:16,289 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690088835576.c33dea5ba38e39282c709e83d065e3a5. started... 2023-07-23 05:07:16,289 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:07:16,289 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:07:16,289 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 05:07:16,290 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 03e9a25a5c1eca652842f2df92f59baa: 2023-07-23 05:07:16,289 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-23 05:07:16,290 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c33dea5ba38e39282c709e83d065e3a5: 2023-07-23 05:07:16,291 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-23 05:07:16,291 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690088835576.03e9a25a5c1eca652842f2df92f59baa.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,291 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37855,1690088792757' in zk 2023-07-23 05:07:16,291 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690088835576.c33dea5ba38e39282c709e83d065e3a5.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,291 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:07:16,291 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:07:16,291 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 05:07:16,292 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 05:07:16,302 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-23 05:07:16,302 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:16,302 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-23 05:07:16,307 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690088835576.03e9a25a5c1eca652842f2df92f59baa. completed. 2023-07-23 05:07:16,307 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690088835576.c33dea5ba38e39282c709e83d065e3a5. completed. 2023-07-23 05:07:16,307 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690088835576.03e9a25a5c1eca652842f2df92f59baa. 2023-07-23 05:07:16,307 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690088835576.c33dea5ba38e39282c709e83d065e3a5. 2023-07-23 05:07:16,307 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:07:16,308 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:07:16,308 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:16,308 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:07:16,308 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-23 05:07:16,308 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45437,1690088792660' in zk 2023-07-23 05:07:16,308 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:07:16,308 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:16,308 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-23 05:07:16,308 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44949,1690088792720' in zk 2023-07-23 05:07:16,311 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-23 05:07:16,311 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:16,311 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:16,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:16,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:16,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:16,311 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-23 05:07:16,312 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:16,312 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-23 05:07:16,312 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:16,312 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-23 05:07:16,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:16,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:16,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:16,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:16,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:16,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:16,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:16,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:16,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:16,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,44949,1690088792720': 2023-07-23 05:07:16,318 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44949,1690088792720' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-23 05:07:16,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:16,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:16,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:16,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:16,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:16,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:16,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:16,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:16,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:16,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:16,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:16,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:16,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,45437,1690088792660': 2023-07-23 05:07:16,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45437,1690088792660' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-23 05:07:16,323 INFO [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-23 05:07:16,323 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 05:07:16,323 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 05:07:16,324 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,324 INFO [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 05:07:16,325 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,325 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:16,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:16,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,325 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:16,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,325 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,325 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,326 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:16,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:16,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,326 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:16,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:16,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:16,326 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:16,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:16,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:16,327 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:16,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:16,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:16,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:16,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,327 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:16,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:16,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:16,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:16,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:16,331 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:16,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,331 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:16,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:16,331 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:16,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:16,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:16,334 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:16,334 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:16,334 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:16,334 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:16,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:16,334 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:16,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:16,334 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,335 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,335 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:16,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:16,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:16,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:16,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:16,334 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:16,334 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:16,335 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-23 05:07:16,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:16,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:16,335 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:16,336 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,336 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 05:07:16,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:16,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:16,336 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:16,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:16,337 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:16,337 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:16,337 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,337 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:16,337 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:16,337 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-23 05:07:16,337 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,337 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,345 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,345 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,351 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:07:16,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-23 05:07:16,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:07:16,352 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 05:07:16,361 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,379 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-23 05:07:16,379 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,379 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:16,379 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690088836249Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1690088836345 (+96 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1690088836345Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1690088836345Writing data manifest for emptySnaptb0-testConsecutiveExports at 1690088836349 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1690088836356 (+7 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690088836379 (+23 ms) 2023-07-23 05:07:16,382 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-23 05:07:16,383 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 132 msec 2023-07-23 05:07:16,552 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:07:16,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-23 05:07:16,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 05:07:16,556 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44949] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1690088835576.c33dea5ba38e39282c709e83d065e3a5. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 05:07:16,557 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45437] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1690088835576.03e9a25a5c1eca652842f2df92f59baa. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 05:07:16,560 DEBUG [Listener at jenkins-hbase4.apache.org/33827] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-23 05:07:16,561 DEBUG [Listener at jenkins-hbase4.apache.org/33827] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1690088835576.c33dea5ba38e39282c709e83d065e3a5. 2023-07-23 05:07:16,561 INFO [Listener at jenkins-hbase4.apache.org/33827] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 05:07:16,571 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-23 05:07:16,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690088836571 (current time:1690088836571). 2023-07-23 05:07:16,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 05:07:16,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] zookeeper.ReadOnlyZKClient(139): Connect 0x68a1c77c to 127.0.0.1:57388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:07:16,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5954ddf0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:07:16,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:16,590 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52668, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:16,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68a1c77c to 127.0.0.1:57388 2023-07-23 05:07:16,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:07:16,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] zookeeper.ReadOnlyZKClient(139): Connect 0x26b9526e to 127.0.0.1:57388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:07:16,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4045ebe2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:07:16,603 DEBUG [hconnection-0x3f810547-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:16,605 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52684, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:16,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:16,609 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34724, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:16,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x26b9526e to 127.0.0.1:57388 2023-07-23 05:07:16,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:07:16,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-23 05:07:16,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 05:07:16,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-23 05:07:16,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-23 05:07:16,618 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-23 05:07:16,619 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690089436619 2023-07-23 05:07:16,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-23 05:07:16,620 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-23 05:07:16,621 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 05:07:16,621 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 05:07:16,623 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-23 05:07:16,623 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-23 05:07:16,624 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-07-23 05:07:16,625 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-23 05:07:16,626 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690089436626 2023-07-23 05:07:16,645 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-23 05:07:16,645 INFO [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-23 05:07:16,645 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:16,647 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-23 05:07:16,647 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-23 05:07:16,647 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,647 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,649 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:16,649 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:16,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:16,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:16,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:16,649 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:16,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:16,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:16,649 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:16,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:16,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,650 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:16,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,650 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:16,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,650 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,651 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:16,651 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 05:07:16,651 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,651 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-23 05:07:16,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,651 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-23 05:07:16,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-23 05:07:16,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-23 05:07:16,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,651 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-23 05:07:16,651 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-23 05:07:16,651 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-23 05:07:16,652 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-23 05:07:16,652 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-23 05:07:16,652 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-23 05:07:16,652 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-23 05:07:16,652 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:16,652 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-23 05:07:16,653 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-23 05:07:16,653 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-23 05:07:16,652 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:16,653 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44949,1690088792720' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-23 05:07:16,653 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:16,655 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-23 05:07:16,655 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-23 05:07:16,655 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-23 05:07:16,655 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37855,1690088792757' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-23 05:07:16,655 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-23 05:07:16,656 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45437,1690088792660' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-23 05:07:16,657 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,657 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:16,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:16,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:16,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:16,657 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,658 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:16,658 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:16,658 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,658 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,658 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:07:16,658 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:07:16,659 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,659 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:07:16,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:16,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 05:07:16,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:16,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:16,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:16,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:16,660 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44949,1690088792720' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-23 05:07:16,660 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@10bb02cb[Count = 1] remaining members to acquire global barrier 2023-07-23 05:07:16,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:16,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:16,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:16,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:16,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:16,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 05:07:16,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:16,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:16,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:16,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:16,662 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45437,1690088792660' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-23 05:07:16,663 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@10bb02cb[Count = 0] remaining members to acquire global barrier 2023-07-23 05:07:16,663 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-23 05:07:16,663 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,665 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,665 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,665 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,665 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-23 05:07:16,665 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:16,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,665 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-23 05:07:16,665 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-23 05:07:16,665 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-23 05:07:16,665 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37855,1690088792757' in zk 2023-07-23 05:07:16,665 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:07:16,665 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:16,665 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 05:07:16,665 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:07:16,666 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:07:16,665 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:07:16,666 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690088835576.c33dea5ba38e39282c709e83d065e3a5. 2023-07-23 05:07:16,666 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690088835576.03e9a25a5c1eca652842f2df92f59baa. 2023-07-23 05:07:16,666 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690088835576.c33dea5ba38e39282c709e83d065e3a5. started... 2023-07-23 05:07:16,666 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690088835576.03e9a25a5c1eca652842f2df92f59baa. started... 2023-07-23 05:07:16,666 INFO [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c33dea5ba38e39282c709e83d065e3a5 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-23 05:07:16,666 INFO [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 03e9a25a5c1eca652842f2df92f59baa 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-23 05:07:16,667 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-23 05:07:16,667 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:16,667 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-23 05:07:16,701 INFO [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307233dc2d477d60d4c6fa19806de7bf6fa9a to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307233dc2d477d60d4c6fa19806de7bf6fa9a 2023-07-23 05:07:16,703 INFO [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307235929a4314d6a443c84b34b218af6a527 to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307235929a4314d6a443c84b34b218af6a527 2023-07-23 05:07:16,710 INFO [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testConsecutiveExports/c33dea5ba38e39282c709e83d065e3a5/.tmp/cf/19df95e9a2be454cb887ca6f8df29ba2 2023-07-23 05:07:16,711 INFO [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testConsecutiveExports/03e9a25a5c1eca652842f2df92f59baa/.tmp/cf/91eea19751324c4e9e8832e210b65fb9 2023-07-23 05:07:16,717 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testConsecutiveExports/c33dea5ba38e39282c709e83d065e3a5/.tmp/cf/19df95e9a2be454cb887ca6f8df29ba2 as hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testConsecutiveExports/c33dea5ba38e39282c709e83d065e3a5/cf/19df95e9a2be454cb887ca6f8df29ba2 2023-07-23 05:07:16,717 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testConsecutiveExports/03e9a25a5c1eca652842f2df92f59baa/.tmp/cf/91eea19751324c4e9e8832e210b65fb9 as hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testConsecutiveExports/03e9a25a5c1eca652842f2df92f59baa/cf/91eea19751324c4e9e8832e210b65fb9 2023-07-23 05:07:16,721 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:07:16,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-23 05:07:16,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:07:16,722 INFO [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testConsecutiveExports/c33dea5ba38e39282c709e83d065e3a5/cf/19df95e9a2be454cb887ca6f8df29ba2, entries=2, sequenceid=6, filesize=5.2 K 2023-07-23 05:07:16,722 INFO [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testConsecutiveExports/03e9a25a5c1eca652842f2df92f59baa/cf/91eea19751324c4e9e8832e210b65fb9, entries=48, sequenceid=6, filesize=12.9 K 2023-07-23 05:07:16,723 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 05:07:16,723 INFO [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for c33dea5ba38e39282c709e83d065e3a5 in 57ms, sequenceid=6, compaction requested=false 2023-07-23 05:07:16,723 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-23 05:07:16,723 INFO [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 03e9a25a5c1eca652842f2df92f59baa in 57ms, sequenceid=6, compaction requested=false 2023-07-23 05:07:16,724 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-23 05:07:16,725 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c33dea5ba38e39282c709e83d065e3a5: 2023-07-23 05:07:16,725 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 03e9a25a5c1eca652842f2df92f59baa: 2023-07-23 05:07:16,726 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690088835576.c33dea5ba38e39282c709e83d065e3a5.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-23 05:07:16,726 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690088835576.03e9a25a5c1eca652842f2df92f59baa.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-23 05:07:16,726 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:07:16,726 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:07:16,726 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testConsecutiveExports/c33dea5ba38e39282c709e83d065e3a5/cf/19df95e9a2be454cb887ca6f8df29ba2] hfiles 2023-07-23 05:07:16,726 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testConsecutiveExports/03e9a25a5c1eca652842f2df92f59baa/cf/91eea19751324c4e9e8832e210b65fb9] hfiles 2023-07-23 05:07:16,726 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testConsecutiveExports/c33dea5ba38e39282c709e83d065e3a5/cf/19df95e9a2be454cb887ca6f8df29ba2 for snapshot=snaptb0-testConsecutiveExports 2023-07-23 05:07:16,726 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testConsecutiveExports/03e9a25a5c1eca652842f2df92f59baa/cf/91eea19751324c4e9e8832e210b65fb9 for snapshot=snaptb0-testConsecutiveExports 2023-07-23 05:07:16,735 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690088835576.c33dea5ba38e39282c709e83d065e3a5. completed. 2023-07-23 05:07:16,735 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690088835576.c33dea5ba38e39282c709e83d065e3a5. 2023-07-23 05:07:16,735 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690088835576.03e9a25a5c1eca652842f2df92f59baa. completed. 2023-07-23 05:07:16,735 DEBUG [rs(jenkins-hbase4.apache.org,45437,1690088792660)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690088835576.03e9a25a5c1eca652842f2df92f59baa. 2023-07-23 05:07:16,735 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:07:16,735 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:07:16,735 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:07:16,735 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:07:16,735 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:16,735 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:16,735 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-23 05:07:16,736 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-23 05:07:16,736 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45437,1690088792660' in zk 2023-07-23 05:07:16,736 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44949,1690088792720' in zk 2023-07-23 05:07:16,737 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-23 05:07:16,737 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:16,737 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-23 05:07:16,737 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:16,739 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-23 05:07:16,739 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:16,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:16,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:16,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:16,739 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:16,740 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-23 05:07:16,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:16,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:16,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 05:07:16,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:16,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:16,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:16,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:16,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 05:07:16,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:16,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:16,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:16,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,44949,1690088792720': 2023-07-23 05:07:16,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44949,1690088792720' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-23 05:07:16,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:16,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:16,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:16,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:16,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:16,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 05:07:16,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:16,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:16,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:16,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:16,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 05:07:16,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:16,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:16,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:16,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,45437,1690088792660': 2023-07-23 05:07:16,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45437,1690088792660' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-23 05:07:16,751 INFO [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-23 05:07:16,751 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 05:07:16,751 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 05:07:16,751 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-23 05:07:16,751 INFO [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 05:07:16,753 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,753 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,753 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:16,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,753 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,753 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:16,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:16,753 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:16,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,754 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:16,754 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:16,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:16,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,754 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:16,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:16,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:16,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 05:07:16,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:16,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:16,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:16,755 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:16,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:16,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:16,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 05:07:16,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:16,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:16,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:16,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:16,758 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:16,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 05:07:16,758 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:16,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:16,759 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:16,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:16,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:16,766 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:16,766 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,766 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:16,766 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:16,766 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:16,766 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:16,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:16,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:16,766 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:16,766 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:16,766 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,766 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:16,766 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,767 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:16,767 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:16,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:16,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:16,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:16,767 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:16,767 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-23 05:07:16,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:16,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:16,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:16,767 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:16,767 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:16,767 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,769 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:16,767 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-23 05:07:16,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:16,770 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-23 05:07:16,770 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 05:07:16,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:16,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:16,771 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307235929a4314d6a443c84b34b218af6a527, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307233dc2d477d60d4c6fa19806de7bf6fa9a] mob files 2023-07-23 05:07:16,771 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307235929a4314d6a443c84b34b218af6a527 2023-07-23 05:07:16,771 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307233dc2d477d60d4c6fa19806de7bf6fa9a 2023-07-23 05:07:16,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-23 05:07:16,787 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,826 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,853 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-23 05:07:16,853 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,854 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,854 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690088836620Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1690088836786 (+166 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1690088836786Loading Region manifests for snaptb0-testConsecutiveExports at 1690088836786Writing data manifest for snaptb0-testConsecutiveExports at 1690088836798 (+12 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1690088836815 (+17 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690088836853 (+38 ms) 2023-07-23 05:07:16,857 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-23 05:07:16,859 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 236 msec 2023-07-23 05:07:16,923 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:07:16,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-23 05:07:16,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 05:07:16,925 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/local-export-1690088836925 2023-07-23 05:07:16,925 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/local-export-1690088836925, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/local-export-1690088836925, srcFsUri=hdfs://localhost:38911, srcDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd 2023-07-23 05:07:16,947 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38911, inputRoot=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd 2023-07-23 05:07:16,947 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@7a2d7aea, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/local-export-1690088836925, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/local-export-1690088836925/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,947 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38911, inputRoot=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd, snapshotDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-23 05:07:16,956 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/local-export-1690088836925/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 05:07:16,969 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:16,969 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:16,970 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:16,970 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:16,970 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:16,971 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:16,971 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:17,039 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/hadoop-1065182663630738927.jar 2023-07-23 05:07:17,040 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:17,040 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:17,041 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:17,041 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:17,041 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:17,042 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:17,042 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 05:07:17,043 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 05:07:17,043 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 05:07:17,044 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 05:07:17,044 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 05:07:17,045 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 05:07:17,045 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 05:07:17,045 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 05:07:17,046 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 05:07:17,047 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 05:07:17,047 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:07:17,047 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:07:17,048 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 05:07:17,048 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:07:17,048 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:07:17,049 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 05:07:17,049 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 05:07:17,410 WARN [Listener at jenkins-hbase4.apache.org/33827] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 05:07:17,412 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-23 05:07:17,414 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-23 05:07:20,077 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 05:07:20,078 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 05:07:20,081 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088800324_0002_000001 (auth:SIMPLE) 2023-07-23 05:07:20,779 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088800324_0003_000001 (auth:SIMPLE) 2023-07-23 05:07:20,829 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 05:07:24,927 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088800324_0003_000001 (auth:SIMPLE) 2023-07-23 05:07:27,185 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088800324_0003_000001 (auth:SIMPLE) 2023-07-23 05:07:30,244 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088800324_0003_000001 (auth:SIMPLE) 2023-07-23 05:07:31,614 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 05:07:31,614 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 05:07:31,619 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-23 05:07:31,619 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 05:07:31,620 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 05:07:31,620 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-154173811_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-23 05:07:31,621 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(367): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-23 05:07:31,621 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(367): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-23 05:07:31,621 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@794d006a in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/local-export-1690088836925/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/local-export-1690088836925/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-23 05:07:31,621 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/local-export-1690088836925/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-23 05:07:31,621 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/local-export-1690088836925/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-23 05:07:31,623 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/local-export-1690088836925, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/local-export-1690088836925, srcFsUri=hdfs://localhost:38911, srcDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd 2023-07-23 05:07:31,647 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38911, inputRoot=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd 2023-07-23 05:07:31,647 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@1ca8f4c2, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/local-export-1690088836925, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/local-export-1690088836925/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 05:07:31,647 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38911, inputRoot=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd, snapshotDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-23 05:07:31,667 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/local-export-1690088836925/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 05:07:31,683 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:31,683 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:31,684 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:31,684 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:31,684 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:31,685 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:31,685 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:31,763 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/hadoop-9021870560920556311.jar 2023-07-23 05:07:31,764 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:31,765 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:31,765 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:31,766 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:31,766 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:31,767 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:31,767 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 05:07:31,768 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 05:07:31,769 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 05:07:31,769 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 05:07:31,769 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 05:07:31,770 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 05:07:31,770 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 05:07:31,771 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 05:07:31,772 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 05:07:31,772 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 05:07:31,773 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:07:31,774 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:07:31,774 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 05:07:31,775 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:07:31,775 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:07:31,776 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 05:07:31,776 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 05:07:32,324 WARN [Listener at jenkins-hbase4.apache.org/33827] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 05:07:32,327 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-23 05:07:32,329 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-23 05:07:36,419 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 05:07:36,419 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 05:07:36,422 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088800324_0003_000001 (auth:SIMPLE) 2023-07-23 05:07:37,221 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088800324_0004_000001 (auth:SIMPLE) 2023-07-23 05:07:41,438 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088800324_0004_000001 (auth:SIMPLE) 2023-07-23 05:07:43,733 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088800324_0004_000001 (auth:SIMPLE) 2023-07-23 05:07:47,521 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088800324_0004_000001 (auth:SIMPLE) 2023-07-23 05:07:49,539 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 05:07:49,539 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 05:07:49,553 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-23 05:07:49,553 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 05:07:49,553 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 05:07:49,554 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-154173811_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-23 05:07:49,566 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(367): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-23 05:07:49,566 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(367): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-23 05:07:49,567 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@794d006a in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/local-export-1690088836925/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/local-export-1690088836925/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-23 05:07:49,567 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/local-export-1690088836925/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-23 05:07:49,567 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/local-export-1690088836925/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-23 05:07:49,593 INFO [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-23 05:07:49,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-23 05:07:49,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-23 05:07:49,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-23 05:07:49,619 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088869619"}]},"ts":"1690088869619"} 2023-07-23 05:07:49,621 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-23 05:07:49,623 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-23 05:07:49,624 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c33dea5ba38e39282c709e83d065e3a5, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=03e9a25a5c1eca652842f2df92f59baa, UNASSIGN}] 2023-07-23 05:07:49,626 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=03e9a25a5c1eca652842f2df92f59baa, UNASSIGN 2023-07-23 05:07:49,628 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c33dea5ba38e39282c709e83d065e3a5, UNASSIGN 2023-07-23 05:07:49,630 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=03e9a25a5c1eca652842f2df92f59baa, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:49,630 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690088835576.03e9a25a5c1eca652842f2df92f59baa.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690088869630"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088869630"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088869630"}]},"ts":"1690088869630"} 2023-07-23 05:07:49,630 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=c33dea5ba38e39282c709e83d065e3a5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:49,631 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690088835576.c33dea5ba38e39282c709e83d065e3a5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690088869630"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088869630"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088869630"}]},"ts":"1690088869630"} 2023-07-23 05:07:49,633 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 03e9a25a5c1eca652842f2df92f59baa, server=jenkins-hbase4.apache.org,45437,1690088792660}] 2023-07-23 05:07:49,634 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure c33dea5ba38e39282c709e83d065e3a5, server=jenkins-hbase4.apache.org,44949,1690088792720}] 2023-07-23 05:07:49,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-23 05:07:49,786 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c33dea5ba38e39282c709e83d065e3a5 2023-07-23 05:07:49,786 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 03e9a25a5c1eca652842f2df92f59baa 2023-07-23 05:07:49,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c33dea5ba38e39282c709e83d065e3a5, disabling compactions & flushes 2023-07-23 05:07:49,787 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690088835576.c33dea5ba38e39282c709e83d065e3a5. 2023-07-23 05:07:49,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690088835576.c33dea5ba38e39282c709e83d065e3a5. 2023-07-23 05:07:49,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690088835576.c33dea5ba38e39282c709e83d065e3a5. after waiting 0 ms 2023-07-23 05:07:49,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690088835576.c33dea5ba38e39282c709e83d065e3a5. 2023-07-23 05:07:49,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 03e9a25a5c1eca652842f2df92f59baa, disabling compactions & flushes 2023-07-23 05:07:49,787 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690088835576.03e9a25a5c1eca652842f2df92f59baa. 2023-07-23 05:07:49,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690088835576.03e9a25a5c1eca652842f2df92f59baa. 2023-07-23 05:07:49,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690088835576.03e9a25a5c1eca652842f2df92f59baa. after waiting 0 ms 2023-07-23 05:07:49,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690088835576.03e9a25a5c1eca652842f2df92f59baa. 2023-07-23 05:07:49,827 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testConsecutiveExports/c33dea5ba38e39282c709e83d065e3a5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 05:07:49,828 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:07:49,830 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690088835576.c33dea5ba38e39282c709e83d065e3a5. 2023-07-23 05:07:49,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c33dea5ba38e39282c709e83d065e3a5: 2023-07-23 05:07:49,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testConsecutiveExports/03e9a25a5c1eca652842f2df92f59baa/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 05:07:49,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:07:49,834 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690088835576.03e9a25a5c1eca652842f2df92f59baa. 2023-07-23 05:07:49,834 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 03e9a25a5c1eca652842f2df92f59baa: 2023-07-23 05:07:49,838 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 03e9a25a5c1eca652842f2df92f59baa 2023-07-23 05:07:49,839 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=03e9a25a5c1eca652842f2df92f59baa, regionState=CLOSED 2023-07-23 05:07:49,839 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690088835576.03e9a25a5c1eca652842f2df92f59baa.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690088869839"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088869839"}]},"ts":"1690088869839"} 2023-07-23 05:07:49,839 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c33dea5ba38e39282c709e83d065e3a5 2023-07-23 05:07:49,841 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=c33dea5ba38e39282c709e83d065e3a5, regionState=CLOSED 2023-07-23 05:07:49,841 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690088835576.c33dea5ba38e39282c709e83d065e3a5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690088869841"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088869841"}]},"ts":"1690088869841"} 2023-07-23 05:07:49,848 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-23 05:07:49,848 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 03e9a25a5c1eca652842f2df92f59baa, server=jenkins-hbase4.apache.org,45437,1690088792660 in 210 msec 2023-07-23 05:07:49,851 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-23 05:07:49,851 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure c33dea5ba38e39282c709e83d065e3a5, server=jenkins-hbase4.apache.org,44949,1690088792720 in 210 msec 2023-07-23 05:07:49,852 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=03e9a25a5c1eca652842f2df92f59baa, UNASSIGN in 224 msec 2023-07-23 05:07:49,855 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-23 05:07:49,855 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c33dea5ba38e39282c709e83d065e3a5, UNASSIGN in 227 msec 2023-07-23 05:07:49,859 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088869859"}]},"ts":"1690088869859"} 2023-07-23 05:07:49,861 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-23 05:07:49,863 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-23 05:07:49,865 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 269 msec 2023-07-23 05:07:49,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-23 05:07:49,911 INFO [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-23 05:07:49,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-23 05:07:49,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-23 05:07:49,917 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-23 05:07:49,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-23 05:07:49,919 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45437] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-23 05:07:49,920 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-23 05:07:49,926 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 05:07:49,926 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 05:07:49,926 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 05:07:49,926 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 05:07:49,926 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-23 05:07:49,926 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-23 05:07:49,933 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 05:07:49,933 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 05:07:49,934 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:49,934 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-23 05:07:49,934 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:49,934 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-23 05:07:49,934 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:49,934 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-23 05:07:49,934 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-23 05:07:49,934 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:49,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-23 05:07:49,935 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testConsecutiveExports/c33dea5ba38e39282c709e83d065e3a5 2023-07-23 05:07:49,935 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testConsecutiveExports/03e9a25a5c1eca652842f2df92f59baa 2023-07-23 05:07:49,940 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testConsecutiveExports/c33dea5ba38e39282c709e83d065e3a5/cf, FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testConsecutiveExports/c33dea5ba38e39282c709e83d065e3a5/recovered.edits] 2023-07-23 05:07:49,943 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testConsecutiveExports/03e9a25a5c1eca652842f2df92f59baa/cf, FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testConsecutiveExports/03e9a25a5c1eca652842f2df92f59baa/recovered.edits] 2023-07-23 05:07:49,953 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testConsecutiveExports/c33dea5ba38e39282c709e83d065e3a5/cf/19df95e9a2be454cb887ca6f8df29ba2 to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testConsecutiveExports/c33dea5ba38e39282c709e83d065e3a5/cf/19df95e9a2be454cb887ca6f8df29ba2 2023-07-23 05:07:49,957 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testConsecutiveExports/c33dea5ba38e39282c709e83d065e3a5/recovered.edits/9.seqid to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testConsecutiveExports/c33dea5ba38e39282c709e83d065e3a5/recovered.edits/9.seqid 2023-07-23 05:07:49,957 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testConsecutiveExports/c33dea5ba38e39282c709e83d065e3a5 2023-07-23 05:07:49,958 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testConsecutiveExports/03e9a25a5c1eca652842f2df92f59baa/cf/91eea19751324c4e9e8832e210b65fb9 to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testConsecutiveExports/03e9a25a5c1eca652842f2df92f59baa/cf/91eea19751324c4e9e8832e210b65fb9 2023-07-23 05:07:49,965 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testConsecutiveExports/03e9a25a5c1eca652842f2df92f59baa/recovered.edits/9.seqid to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testConsecutiveExports/03e9a25a5c1eca652842f2df92f59baa/recovered.edits/9.seqid 2023-07-23 05:07:49,966 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testConsecutiveExports/03e9a25a5c1eca652842f2df92f59baa 2023-07-23 05:07:49,966 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-23 05:07:49,967 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-23 05:07:49,968 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-23 05:07:49,984 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307235929a4314d6a443c84b34b218af6a527 to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307235929a4314d6a443c84b34b218af6a527 2023-07-23 05:07:49,986 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307233dc2d477d60d4c6fa19806de7bf6fa9a to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307233dc2d477d60d4c6fa19806de7bf6fa9a 2023-07-23 05:07:49,987 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-23 05:07:49,991 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-23 05:07:49,994 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-23 05:07:50,000 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-23 05:07:50,003 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-23 05:07:50,003 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-23 05:07:50,003 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1690088835576.c33dea5ba38e39282c709e83d065e3a5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690088870003"}]},"ts":"9223372036854775807"} 2023-07-23 05:07:50,003 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1690088835576.03e9a25a5c1eca652842f2df92f59baa.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690088870003"}]},"ts":"9223372036854775807"} 2023-07-23 05:07:50,014 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-23 05:07:50,014 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c33dea5ba38e39282c709e83d065e3a5, NAME => 'testtb-testConsecutiveExports,,1690088835576.c33dea5ba38e39282c709e83d065e3a5.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 03e9a25a5c1eca652842f2df92f59baa, NAME => 'testtb-testConsecutiveExports,1,1690088835576.03e9a25a5c1eca652842f2df92f59baa.', STARTKEY => '1', ENDKEY => ''}] 2023-07-23 05:07:50,014 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-23 05:07:50,015 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690088870015"}]},"ts":"9223372036854775807"} 2023-07-23 05:07:50,018 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-23 05:07:50,024 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-23 05:07:50,025 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 111 msec 2023-07-23 05:07:50,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-23 05:07:50,036 INFO [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-23 05:07:50,058 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-23 05:07:50,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-23 05:07:50,064 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-23 05:07:50,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-23 05:07:50,097 INFO [Listener at jenkins-hbase4.apache.org/33827] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=746 (was 765), OpenFileDescriptor=901 (was 927), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=399 (was 314) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 182), AvailableMemoryMB=6024 (was 5828) - AvailableMemoryMB LEAK? - 2023-07-23 05:07:50,097 WARN [Listener at jenkins-hbase4.apache.org/33827] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-07-23 05:07:50,125 INFO [Listener at jenkins-hbase4.apache.org/33827] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=746, OpenFileDescriptor=901, MaxFileDescriptor=60000, SystemLoadAverage=399, ProcessCount=181, AvailableMemoryMB=6021 2023-07-23 05:07:50,125 WARN [Listener at jenkins-hbase4.apache.org/33827] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-07-23 05:07:50,128 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-23 05:07:50,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:50,135 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 05:07:50,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-23 05:07:50,136 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 05:07:50,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-23 05:07:50,143 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d1a242a852741ea269fd8505c929a214 2023-07-23 05:07:50,143 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7c5e80d9bcf0d14aa2a3f9c86e41a22 2023-07-23 05:07:50,144 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7c5e80d9bcf0d14aa2a3f9c86e41a22 empty. 2023-07-23 05:07:50,144 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d1a242a852741ea269fd8505c929a214 empty. 2023-07-23 05:07:50,144 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d1a242a852741ea269fd8505c929a214 2023-07-23 05:07:50,146 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7c5e80d9bcf0d14aa2a3f9c86e41a22 2023-07-23 05:07:50,147 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-23 05:07:50,216 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-23 05:07:50,217 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => d1a242a852741ea269fd8505c929a214, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690088870128.d1a242a852741ea269fd8505c929a214.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp 2023-07-23 05:07:50,218 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => a7c5e80d9bcf0d14aa2a3f9c86e41a22, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690088870128.a7c5e80d9bcf0d14aa2a3f9c86e41a22.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp 2023-07-23 05:07:50,232 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690088870128.a7c5e80d9bcf0d14aa2a3f9c86e41a22.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:07:50,232 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing a7c5e80d9bcf0d14aa2a3f9c86e41a22, disabling compactions & flushes 2023-07-23 05:07:50,233 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690088870128.a7c5e80d9bcf0d14aa2a3f9c86e41a22. 2023-07-23 05:07:50,233 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690088870128.a7c5e80d9bcf0d14aa2a3f9c86e41a22. 2023-07-23 05:07:50,233 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690088870128.a7c5e80d9bcf0d14aa2a3f9c86e41a22. after waiting 0 ms 2023-07-23 05:07:50,233 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690088870128.a7c5e80d9bcf0d14aa2a3f9c86e41a22. 2023-07-23 05:07:50,233 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690088870128.a7c5e80d9bcf0d14aa2a3f9c86e41a22. 2023-07-23 05:07:50,233 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for a7c5e80d9bcf0d14aa2a3f9c86e41a22: 2023-07-23 05:07:50,235 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690088870128.d1a242a852741ea269fd8505c929a214.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:07:50,235 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing d1a242a852741ea269fd8505c929a214, disabling compactions & flushes 2023-07-23 05:07:50,235 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690088870128.d1a242a852741ea269fd8505c929a214. 2023-07-23 05:07:50,235 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690088870128.d1a242a852741ea269fd8505c929a214. 2023-07-23 05:07:50,235 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690088870128.d1a242a852741ea269fd8505c929a214. after waiting 0 ms 2023-07-23 05:07:50,235 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690088870128.d1a242a852741ea269fd8505c929a214. 2023-07-23 05:07:50,235 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690088870128.d1a242a852741ea269fd8505c929a214. 2023-07-23 05:07:50,235 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for d1a242a852741ea269fd8505c929a214: 2023-07-23 05:07:50,238 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 05:07:50,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-23 05:07:50,239 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690088870128.a7c5e80d9bcf0d14aa2a3f9c86e41a22.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690088870239"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088870239"}]},"ts":"1690088870239"} 2023-07-23 05:07:50,239 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690088870128.d1a242a852741ea269fd8505c929a214.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690088870239"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088870239"}]},"ts":"1690088870239"} 2023-07-23 05:07:50,246 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 05:07:50,247 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 05:07:50,247 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088870247"}]},"ts":"1690088870247"} 2023-07-23 05:07:50,248 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-23 05:07:50,381 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 05:07:50,383 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 05:07:50,383 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 05:07:50,383 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 05:07:50,383 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 05:07:50,383 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d1a242a852741ea269fd8505c929a214, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a7c5e80d9bcf0d14aa2a3f9c86e41a22, ASSIGN}] 2023-07-23 05:07:50,386 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d1a242a852741ea269fd8505c929a214, ASSIGN 2023-07-23 05:07:50,386 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a7c5e80d9bcf0d14aa2a3f9c86e41a22, ASSIGN 2023-07-23 05:07:50,387 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d1a242a852741ea269fd8505c929a214, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44949,1690088792720; forceNewPlan=false, retain=false 2023-07-23 05:07:50,387 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a7c5e80d9bcf0d14aa2a3f9c86e41a22, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37855,1690088792757; forceNewPlan=false, retain=false 2023-07-23 05:07:50,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-23 05:07:50,537 INFO [jenkins-hbase4:32809] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 05:07:50,540 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=d1a242a852741ea269fd8505c929a214, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:50,540 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=a7c5e80d9bcf0d14aa2a3f9c86e41a22, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:50,540 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690088870128.d1a242a852741ea269fd8505c929a214.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690088870540"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088870540"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088870540"}]},"ts":"1690088870540"} 2023-07-23 05:07:50,540 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690088870128.a7c5e80d9bcf0d14aa2a3f9c86e41a22.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690088870540"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088870540"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088870540"}]},"ts":"1690088870540"} 2023-07-23 05:07:50,542 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure d1a242a852741ea269fd8505c929a214, server=jenkins-hbase4.apache.org,44949,1690088792720}] 2023-07-23 05:07:50,543 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure a7c5e80d9bcf0d14aa2a3f9c86e41a22, server=jenkins-hbase4.apache.org,37855,1690088792757}] 2023-07-23 05:07:50,700 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1690088870128.d1a242a852741ea269fd8505c929a214. 2023-07-23 05:07:50,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d1a242a852741ea269fd8505c929a214, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690088870128.d1a242a852741ea269fd8505c929a214.', STARTKEY => '', ENDKEY => '1'} 2023-07-23 05:07:50,700 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1690088870128.a7c5e80d9bcf0d14aa2a3f9c86e41a22. 2023-07-23 05:07:50,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1690088870128.d1a242a852741ea269fd8505c929a214. service=AccessControlService 2023-07-23 05:07:50,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a7c5e80d9bcf0d14aa2a3f9c86e41a22, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690088870128.a7c5e80d9bcf0d14aa2a3f9c86e41a22.', STARTKEY => '1', ENDKEY => ''} 2023-07-23 05:07:50,700 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:07:50,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1690088870128.a7c5e80d9bcf0d14aa2a3f9c86e41a22. service=AccessControlService 2023-07-23 05:07:50,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion d1a242a852741ea269fd8505c929a214 2023-07-23 05:07:50,701 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:07:50,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690088870128.d1a242a852741ea269fd8505c929a214.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:07:50,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion a7c5e80d9bcf0d14aa2a3f9c86e41a22 2023-07-23 05:07:50,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d1a242a852741ea269fd8505c929a214 2023-07-23 05:07:50,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690088870128.a7c5e80d9bcf0d14aa2a3f9c86e41a22.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:07:50,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d1a242a852741ea269fd8505c929a214 2023-07-23 05:07:50,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a7c5e80d9bcf0d14aa2a3f9c86e41a22 2023-07-23 05:07:50,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a7c5e80d9bcf0d14aa2a3f9c86e41a22 2023-07-23 05:07:50,702 INFO [StoreOpener-d1a242a852741ea269fd8505c929a214-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d1a242a852741ea269fd8505c929a214 2023-07-23 05:07:50,702 INFO [StoreOpener-a7c5e80d9bcf0d14aa2a3f9c86e41a22-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a7c5e80d9bcf0d14aa2a3f9c86e41a22 2023-07-23 05:07:50,704 DEBUG [StoreOpener-a7c5e80d9bcf0d14aa2a3f9c86e41a22-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7c5e80d9bcf0d14aa2a3f9c86e41a22/cf 2023-07-23 05:07:50,704 DEBUG [StoreOpener-d1a242a852741ea269fd8505c929a214-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion/d1a242a852741ea269fd8505c929a214/cf 2023-07-23 05:07:50,704 DEBUG [StoreOpener-d1a242a852741ea269fd8505c929a214-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion/d1a242a852741ea269fd8505c929a214/cf 2023-07-23 05:07:50,704 DEBUG [StoreOpener-a7c5e80d9bcf0d14aa2a3f9c86e41a22-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7c5e80d9bcf0d14aa2a3f9c86e41a22/cf 2023-07-23 05:07:50,705 INFO [StoreOpener-d1a242a852741ea269fd8505c929a214-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d1a242a852741ea269fd8505c929a214 columnFamilyName cf 2023-07-23 05:07:50,705 INFO [StoreOpener-a7c5e80d9bcf0d14aa2a3f9c86e41a22-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a7c5e80d9bcf0d14aa2a3f9c86e41a22 columnFamilyName cf 2023-07-23 05:07:50,706 INFO [StoreOpener-d1a242a852741ea269fd8505c929a214-1] regionserver.HStore(310): Store=d1a242a852741ea269fd8505c929a214/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:07:50,707 INFO [StoreOpener-a7c5e80d9bcf0d14aa2a3f9c86e41a22-1] regionserver.HStore(310): Store=a7c5e80d9bcf0d14aa2a3f9c86e41a22/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:07:50,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion/d1a242a852741ea269fd8505c929a214 2023-07-23 05:07:50,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7c5e80d9bcf0d14aa2a3f9c86e41a22 2023-07-23 05:07:50,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion/d1a242a852741ea269fd8505c929a214 2023-07-23 05:07:50,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7c5e80d9bcf0d14aa2a3f9c86e41a22 2023-07-23 05:07:50,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d1a242a852741ea269fd8505c929a214 2023-07-23 05:07:50,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a7c5e80d9bcf0d14aa2a3f9c86e41a22 2023-07-23 05:07:50,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-23 05:07:50,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion/d1a242a852741ea269fd8505c929a214/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 05:07:50,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7c5e80d9bcf0d14aa2a3f9c86e41a22/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 05:07:50,749 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d1a242a852741ea269fd8505c929a214; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72493259, jitterRate=0.08023373782634735}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 05:07:50,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d1a242a852741ea269fd8505c929a214: 2023-07-23 05:07:50,750 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a7c5e80d9bcf0d14aa2a3f9c86e41a22; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73018540, jitterRate=0.08806103467941284}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 05:07:50,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a7c5e80d9bcf0d14aa2a3f9c86e41a22: 2023-07-23 05:07:50,753 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1690088870128.d1a242a852741ea269fd8505c929a214., pid=60, masterSystemTime=1690088870694 2023-07-23 05:07:50,753 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1690088870128.a7c5e80d9bcf0d14aa2a3f9c86e41a22., pid=61, masterSystemTime=1690088870694 2023-07-23 05:07:50,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1690088870128.d1a242a852741ea269fd8505c929a214. 2023-07-23 05:07:50,755 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1690088870128.d1a242a852741ea269fd8505c929a214. 2023-07-23 05:07:50,755 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=d1a242a852741ea269fd8505c929a214, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:50,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1690088870128.a7c5e80d9bcf0d14aa2a3f9c86e41a22. 2023-07-23 05:07:50,756 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1690088870128.a7c5e80d9bcf0d14aa2a3f9c86e41a22. 2023-07-23 05:07:50,756 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690088870128.d1a242a852741ea269fd8505c929a214.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690088870755"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690088870755"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690088870755"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690088870755"}]},"ts":"1690088870755"} 2023-07-23 05:07:50,756 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=a7c5e80d9bcf0d14aa2a3f9c86e41a22, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:50,757 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690088870128.a7c5e80d9bcf0d14aa2a3f9c86e41a22.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690088870756"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690088870756"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690088870756"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690088870756"}]},"ts":"1690088870756"} 2023-07-23 05:07:50,759 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-23 05:07:50,759 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure d1a242a852741ea269fd8505c929a214, server=jenkins-hbase4.apache.org,44949,1690088792720 in 215 msec 2023-07-23 05:07:50,761 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d1a242a852741ea269fd8505c929a214, ASSIGN in 376 msec 2023-07-23 05:07:50,761 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-23 05:07:50,761 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure a7c5e80d9bcf0d14aa2a3f9c86e41a22, server=jenkins-hbase4.apache.org,37855,1690088792757 in 215 msec 2023-07-23 05:07:50,763 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-23 05:07:50,763 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a7c5e80d9bcf0d14aa2a3f9c86e41a22, ASSIGN in 378 msec 2023-07-23 05:07:50,763 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 05:07:50,763 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088870763"}]},"ts":"1690088870763"} 2023-07-23 05:07:50,765 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-23 05:07:50,781 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 05:07:50,781 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-23 05:07:50,785 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45437] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-23 05:07:50,788 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:50,788 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:50,788 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:50,788 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:50,797 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 05:07:50,797 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 05:07:50,797 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 05:07:50,797 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 05:07:50,799 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 668 msec 2023-07-23 05:07:51,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-23 05:07:51,243 INFO [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-23 05:07:51,245 DEBUG [Listener at jenkins-hbase4.apache.org/33827] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,245 DEBUG [Listener at jenkins-hbase4.apache.org/33827] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1690088870128.d1a242a852741ea269fd8505c929a214. 2023-07-23 05:07:51,247 INFO [Listener at jenkins-hbase4.apache.org/33827] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 05:07:51,271 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-23 05:07:51,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690088871271 (current time:1690088871271). 2023-07-23 05:07:51,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 05:07:51,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] zookeeper.ReadOnlyZKClient(139): Connect 0x51e2cef7 to 127.0.0.1:57388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:07:51,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@375cf179, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:07:51,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:51,289 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47236, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:51,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x51e2cef7 to 127.0.0.1:57388 2023-07-23 05:07:51,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:07:51,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] zookeeper.ReadOnlyZKClient(139): Connect 0x3c7036ab to 127.0.0.1:57388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:07:51,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ba2d2a4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:07:51,307 DEBUG [hconnection-0x2ba53390-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:51,308 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47242, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:51,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:51,317 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54040, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:51,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c7036ab to 127.0.0.1:57388 2023-07-23 05:07:51,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:07:51,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-23 05:07:51,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 05:07:51,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-23 05:07:51,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-23 05:07:51,324 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-23 05:07:51,325 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690089471325 2023-07-23 05:07:51,326 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-23 05:07:51,327 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 05:07:51,328 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 05:07:51,332 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-23 05:07:51,333 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-23 05:07:51,335 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 12 msec 2023-07-23 05:07:51,336 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-23 05:07:51,337 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690089471337 2023-07-23 05:07:51,349 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,349 INFO [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-23 05:07:51,349 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:51,351 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-23 05:07:51,351 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-23 05:07:51,423 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,423 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,428 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:07:51,428 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:51,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:51,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:51,428 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:51,428 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:51,428 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:51,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:51,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:51,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:51,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:51,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,429 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:51,429 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:51,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,429 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-23 05:07:51,429 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:51,429 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 05:07:51,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:07:51,430 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,430 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,430 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 05:07:51,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-23 05:07:51,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-23 05:07:51,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,430 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-23 05:07:51,430 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-23 05:07:51,430 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,430 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-23 05:07:51,431 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-23 05:07:51,430 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-23 05:07:51,431 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:51,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,432 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-23 05:07:51,432 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-23 05:07:51,431 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:51,432 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-23 05:07:51,433 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-23 05:07:51,433 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-23 05:07:51,432 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45437,1690088792660' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-23 05:07:51,433 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44949,1690088792720' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-23 05:07:51,433 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,434 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-23 05:07:51,434 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:51,435 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-23 05:07:51,435 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-23 05:07:51,435 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37855,1690088792757' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-23 05:07:51,436 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,436 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,436 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:51,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:51,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:51,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:51,437 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,437 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,437 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:07:51,437 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:07:51,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:51,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:51,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:51,439 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:51,439 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:51,439 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,439 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:07:51,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:51,440 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44949,1690088792720' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-23 05:07:51,440 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4128e5bd[Count = 1] remaining members to acquire global barrier 2023-07-23 05:07:51,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:51,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:51,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:51,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:51,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:51,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:51,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:51,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:51,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:51,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37855,1690088792757' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-23 05:07:51,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4128e5bd[Count = 0] remaining members to acquire global barrier 2023-07-23 05:07:51,443 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-23 05:07:51,443 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,444 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,444 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,444 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,444 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:51,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,445 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-23 05:07:51,445 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-23 05:07:51,445 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:51,445 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 05:07:51,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,445 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:07:51,445 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:07:51,445 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-23 05:07:51,445 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-23 05:07:51,445 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45437,1690088792660' in zk 2023-07-23 05:07:51,445 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690088870128.a7c5e80d9bcf0d14aa2a3f9c86e41a22. 2023-07-23 05:07:51,445 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:07:51,445 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:07:51,445 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690088870128.d1a242a852741ea269fd8505c929a214. 2023-07-23 05:07:51,445 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690088870128.a7c5e80d9bcf0d14aa2a3f9c86e41a22. started... 2023-07-23 05:07:51,445 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690088870128.d1a242a852741ea269fd8505c929a214. started... 2023-07-23 05:07:51,447 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a7c5e80d9bcf0d14aa2a3f9c86e41a22: 2023-07-23 05:07:51,447 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d1a242a852741ea269fd8505c929a214: 2023-07-23 05:07:51,447 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690088870128.a7c5e80d9bcf0d14aa2a3f9c86e41a22.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,447 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690088870128.d1a242a852741ea269fd8505c929a214.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,447 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:07:51,447 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:07:51,447 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 05:07:51,448 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 05:07:51,456 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-23 05:07:51,456 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:51,456 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-23 05:07:51,468 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690088870128.d1a242a852741ea269fd8505c929a214. completed. 2023-07-23 05:07:51,468 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690088870128.d1a242a852741ea269fd8505c929a214. 2023-07-23 05:07:51,468 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:07:51,468 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:07:51,468 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:51,468 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-23 05:07:51,468 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44949,1690088792720' in zk 2023-07-23 05:07:51,470 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:51,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:51,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:51,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:51,470 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-23 05:07:51,470 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:51,471 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-23 05:07:51,472 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690088870128.a7c5e80d9bcf0d14aa2a3f9c86e41a22. completed. 2023-07-23 05:07:51,472 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690088870128.a7c5e80d9bcf0d14aa2a3f9c86e41a22. 2023-07-23 05:07:51,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:51,472 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:07:51,473 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:07:51,473 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:51,473 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-23 05:07:51,473 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37855,1690088792757' in zk 2023-07-23 05:07:51,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:51,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,480 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-23 05:07:51,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:51,480 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:51,480 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:51,480 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-23 05:07:51,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:51,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:51,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:51,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:51,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:51,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:51,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,44949,1690088792720': 2023-07-23 05:07:51,485 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44949,1690088792720' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-23 05:07:51,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:51,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:51,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:51,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:51,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:51,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:51,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:51,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:51,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:51,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:51,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:51,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:51,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37855,1690088792757': 2023-07-23 05:07:51,492 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37855,1690088792757' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-23 05:07:51,492 INFO [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-23 05:07:51,492 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 05:07:51,492 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 05:07:51,492 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,492 INFO [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 05:07:51,495 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,495 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:51,495 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,495 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,495 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:51,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:51,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,496 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:51,495 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:51,495 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:51,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:51,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:51,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:51,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:51,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:51,496 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:51,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:51,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:51,497 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:51,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:51,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:51,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:51,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:51,500 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:51,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:51,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:51,502 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:51,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:51,503 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:51,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:51,521 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:51,522 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:51,522 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:51,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:51,522 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:51,522 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:51,522 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:51,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:51,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:51,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:51,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:51,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:51,522 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:51,523 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,523 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:51,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:51,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:51,523 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:51,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:51,523 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:51,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:51,523 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,523 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:51,525 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:51,525 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,525 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,525 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 05:07:51,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:51,525 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,526 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:51,526 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:51,526 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,526 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,526 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-23 05:07:51,630 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:07:51,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-23 05:07:51,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:07:51,632 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 05:07:51,932 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:07:51,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-23 05:07:51,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:07:51,933 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-23 05:07:51,956 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,957 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:51,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,009 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-23 05:07:52,009 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,010 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,010 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690088871326Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1690088871956 (+630 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690088871956Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690088871956Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690088871960 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690088871972 (+12 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690088872009 (+37 ms) 2023-07-23 05:07:52,013 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-23 05:07:52,015 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 686 msec 2023-07-23 05:07:52,433 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:07:52,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-23 05:07:52,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 05:07:52,438 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44949] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1690088870128.d1a242a852741ea269fd8505c929a214. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 05:07:52,439 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37855] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1690088870128.a7c5e80d9bcf0d14aa2a3f9c86e41a22. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 05:07:52,444 DEBUG [Listener at jenkins-hbase4.apache.org/33827] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,444 DEBUG [Listener at jenkins-hbase4.apache.org/33827] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1690088870128.d1a242a852741ea269fd8505c929a214. 2023-07-23 05:07:52,444 INFO [Listener at jenkins-hbase4.apache.org/33827] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 05:07:52,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-23 05:07:52,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690088872457 (current time:1690088872457). 2023-07-23 05:07:52,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 05:07:52,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] zookeeper.ReadOnlyZKClient(139): Connect 0x1dc70c2c to 127.0.0.1:57388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:07:52,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2547bb54, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:07:52,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:52,476 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47254, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:52,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1dc70c2c to 127.0.0.1:57388 2023-07-23 05:07:52,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:07:52,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] zookeeper.ReadOnlyZKClient(139): Connect 0x1efeea1f to 127.0.0.1:57388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:07:52,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3bfd2380, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:07:52,488 DEBUG [hconnection-0x23f8b2b0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:52,492 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47264, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:52,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:52,506 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54042, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:52,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1efeea1f to 127.0.0.1:57388 2023-07-23 05:07:52,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:07:52,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-23 05:07:52,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 05:07:52,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-23 05:07:52,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-23 05:07:52,513 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-23 05:07:52,514 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690089472514 2023-07-23 05:07:52,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-23 05:07:52,514 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,516 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 05:07:52,516 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 05:07:52,519 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-23 05:07:52,520 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-23 05:07:52,521 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 9 msec 2023-07-23 05:07:52,522 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-23 05:07:52,522 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690089472522 2023-07-23 05:07:52,547 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,547 INFO [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-23 05:07:52,547 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:52,548 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-23 05:07:52,548 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-23 05:07:52,549 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,549 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,550 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:52,550 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:52,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:52,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:52,550 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:52,550 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:52,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:52,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:52,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:52,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:52,550 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:52,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,551 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:52,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,551 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,551 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:52,551 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 05:07:52,551 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,551 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-23 05:07:52,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-23 05:07:52,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,552 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-23 05:07:52,552 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-23 05:07:52,552 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,552 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-23 05:07:52,552 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:52,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-23 05:07:52,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,553 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-23 05:07:52,556 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,557 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,557 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-23 05:07:52,557 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-23 05:07:52,557 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-23 05:07:52,557 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:52,557 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-23 05:07:52,558 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:52,558 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-23 05:07:52,560 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-23 05:07:52,557 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44949,1690088792720' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-23 05:07:52,560 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45437,1690088792660' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-23 05:07:52,560 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-23 05:07:52,560 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-23 05:07:52,560 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37855,1690088792757' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-23 05:07:52,561 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,561 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,562 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:52,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:52,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:52,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:52,562 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,562 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,562 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:07:52,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:52,562 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:52,562 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,563 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:07:52,563 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,563 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:07:52,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:52,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:52,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:52,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:52,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:52,564 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44949,1690088792720' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-23 05:07:52,564 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b447fff[Count = 1] remaining members to acquire global barrier 2023-07-23 05:07:52,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:52,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:52,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:52,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:52,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:52,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:52,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:52,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:52,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:52,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37855,1690088792757' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-23 05:07:52,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b447fff[Count = 0] remaining members to acquire global barrier 2023-07-23 05:07:52,566 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-23 05:07:52,566 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,569 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,569 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,569 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,569 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:52,569 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-23 05:07:52,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,570 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-23 05:07:52,570 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-23 05:07:52,569 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-23 05:07:52,570 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:52,570 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 05:07:52,570 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:07:52,570 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:07:52,570 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:07:52,570 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:07:52,570 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690088870128.d1a242a852741ea269fd8505c929a214. 2023-07-23 05:07:52,570 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45437,1690088792660' in zk 2023-07-23 05:07:52,570 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690088870128.d1a242a852741ea269fd8505c929a214. started... 2023-07-23 05:07:52,570 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690088870128.a7c5e80d9bcf0d14aa2a3f9c86e41a22. 2023-07-23 05:07:52,570 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690088870128.a7c5e80d9bcf0d14aa2a3f9c86e41a22. started... 2023-07-23 05:07:52,570 INFO [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d1a242a852741ea269fd8505c929a214 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-23 05:07:52,570 INFO [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a7c5e80d9bcf0d14aa2a3f9c86e41a22 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-23 05:07:52,572 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-23 05:07:52,572 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:52,572 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-23 05:07:52,605 INFO [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230723812556a104d94e7ebd13a42d0c032f4a to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230723812556a104d94e7ebd13a42d0c032f4a 2023-07-23 05:07:52,606 INFO [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307235439e7aca34943d8bbe814f33db9cce7 to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307235439e7aca34943d8bbe814f33db9cce7 2023-07-23 05:07:52,616 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:07:52,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-23 05:07:52,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:07:52,618 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 05:07:52,630 INFO [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7c5e80d9bcf0d14aa2a3f9c86e41a22/.tmp/cf/191d14d8f1c74a9bb6c7b6d3fdd534cf 2023-07-23 05:07:52,631 INFO [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion/d1a242a852741ea269fd8505c929a214/.tmp/cf/56605ea2367e483f853cd267bf120d29 2023-07-23 05:07:52,637 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion/d1a242a852741ea269fd8505c929a214/.tmp/cf/56605ea2367e483f853cd267bf120d29 as hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion/d1a242a852741ea269fd8505c929a214/cf/56605ea2367e483f853cd267bf120d29 2023-07-23 05:07:52,637 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7c5e80d9bcf0d14aa2a3f9c86e41a22/.tmp/cf/191d14d8f1c74a9bb6c7b6d3fdd534cf as hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7c5e80d9bcf0d14aa2a3f9c86e41a22/cf/191d14d8f1c74a9bb6c7b6d3fdd534cf 2023-07-23 05:07:52,643 INFO [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7c5e80d9bcf0d14aa2a3f9c86e41a22/cf/191d14d8f1c74a9bb6c7b6d3fdd534cf, entries=46, sequenceid=6, filesize=13.3 K 2023-07-23 05:07:52,644 INFO [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion/d1a242a852741ea269fd8505c929a214/cf/56605ea2367e483f853cd267bf120d29, entries=4, sequenceid=6, filesize=5.6 K 2023-07-23 05:07:52,645 INFO [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for d1a242a852741ea269fd8505c929a214 in 75ms, sequenceid=6, compaction requested=false 2023-07-23 05:07:52,645 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-23 05:07:52,646 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d1a242a852741ea269fd8505c929a214: 2023-07-23 05:07:52,646 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690088870128.d1a242a852741ea269fd8505c929a214.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,646 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:07:52,646 INFO [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for a7c5e80d9bcf0d14aa2a3f9c86e41a22 in 76ms, sequenceid=6, compaction requested=false 2023-07-23 05:07:52,646 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion/d1a242a852741ea269fd8505c929a214/cf/56605ea2367e483f853cd267bf120d29] hfiles 2023-07-23 05:07:52,648 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a7c5e80d9bcf0d14aa2a3f9c86e41a22: 2023-07-23 05:07:52,648 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion/d1a242a852741ea269fd8505c929a214/cf/56605ea2367e483f853cd267bf120d29 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,648 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690088870128.a7c5e80d9bcf0d14aa2a3f9c86e41a22.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,648 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:07:52,648 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7c5e80d9bcf0d14aa2a3f9c86e41a22/cf/191d14d8f1c74a9bb6c7b6d3fdd534cf] hfiles 2023-07-23 05:07:52,648 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7c5e80d9bcf0d14aa2a3f9c86e41a22/cf/191d14d8f1c74a9bb6c7b6d3fdd534cf for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,681 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690088870128.a7c5e80d9bcf0d14aa2a3f9c86e41a22. completed. 2023-07-23 05:07:52,681 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690088870128.a7c5e80d9bcf0d14aa2a3f9c86e41a22. 2023-07-23 05:07:52,681 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:07:52,681 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:07:52,681 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:52,681 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-23 05:07:52,681 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37855,1690088792757' in zk 2023-07-23 05:07:52,683 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-23 05:07:52,683 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:52,683 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:52,683 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-23 05:07:52,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:52,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:52,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:52,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:52,688 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690088870128.d1a242a852741ea269fd8505c929a214. completed. 2023-07-23 05:07:52,688 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690088870128.d1a242a852741ea269fd8505c929a214. 2023-07-23 05:07:52,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:52,688 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:07:52,688 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:07:52,688 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:52,688 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-23 05:07:52,688 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44949,1690088792720' in zk 2023-07-23 05:07:52,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:52,690 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:52,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:52,690 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-23 05:07:52,690 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:52,690 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-23 05:07:52,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:52,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:52,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:52,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:52,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:52,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37855,1690088792757': 2023-07-23 05:07:52,694 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37855,1690088792757' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-23 05:07:52,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:52,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:52,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:52,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:52,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:52,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:52,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:52,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:52,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:52,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:52,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:52,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:52,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,44949,1690088792720': 2023-07-23 05:07:52,701 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44949,1690088792720' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-23 05:07:52,701 INFO [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-23 05:07:52,701 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 05:07:52,702 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 05:07:52,702 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,702 INFO [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 05:07:52,707 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,707 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,707 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:52,707 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:52,707 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,708 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:52,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,708 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:52,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:52,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:52,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:52,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:52,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:52,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:52,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:52,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:52,711 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:52,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,711 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:52,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:52,711 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:52,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:52,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:52,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:52,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:52,721 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:52,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,721 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:52,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:52,721 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:52,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:52,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:52,725 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:52,725 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:52,725 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:52,725 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,725 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:52,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:52,725 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:52,725 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:52,725 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:52,726 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,726 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,726 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 05:07:52,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:52,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:52,725 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:52,725 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:52,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:52,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:52,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:52,725 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:52,729 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:52,729 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,729 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307235439e7aca34943d8bbe814f33db9cce7, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230723812556a104d94e7ebd13a42d0c032f4a] mob files 2023-07-23 05:07:52,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:52,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:52,729 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307235439e7aca34943d8bbe814f33db9cce7 2023-07-23 05:07:52,729 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:52,729 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230723812556a104d94e7ebd13a42d0c032f4a 2023-07-23 05:07:52,729 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:52,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:52,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:52,729 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:52,730 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:52,730 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,730 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,744 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,744 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,785 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:52,818 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:07:52,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-23 05:07:52,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:07:52,822 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 05:07:53,123 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:07:53,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-23 05:07:53,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:07:53,124 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-23 05:07:53,241 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-23 05:07:53,241 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,241 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:07:53,242 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690088872514Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1690088872744 (+230 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690088872744Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1690088872744Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1690088872750 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690088872773 (+23 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690088873241 (+468 ms) 2023-07-23 05:07:53,244 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-23 05:07:53,246 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 728 msec 2023-07-23 05:07:53,625 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:07:53,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-23 05:07:53,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 05:07:53,659 DEBUG [Listener at jenkins-hbase4.apache.org/33827] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-23 05:07:53,663 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49476, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-23 05:07:53,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37855] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-23 05:07:53,665 DEBUG [Listener at jenkins-hbase4.apache.org/33827] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-23 05:07:53,668 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47280, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-23 05:07:53,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44949] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-23 05:07:53,668 DEBUG [Listener at jenkins-hbase4.apache.org/33827] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-23 05:07:53,671 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54052, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-23 05:07:53,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45437] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-23 05:07:53,673 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-23 05:07:53,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:53,677 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 05:07:53,677 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-23 05:07:53,677 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 05:07:53,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-23 05:07:53,680 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/124c022da5039f2ea11466e3efdb4b5a 2023-07-23 05:07:53,680 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/465ab444afff22e53048a7f8402ce66e 2023-07-23 05:07:53,681 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/124c022da5039f2ea11466e3efdb4b5a empty. 2023-07-23 05:07:53,681 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/465ab444afff22e53048a7f8402ce66e empty. 2023-07-23 05:07:53,681 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/124c022da5039f2ea11466e3efdb4b5a 2023-07-23 05:07:53,681 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/465ab444afff22e53048a7f8402ce66e 2023-07-23 05:07:53,681 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-23 05:07:53,699 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-23 05:07:53,700 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 124c022da5039f2ea11466e3efdb4b5a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873673.124c022da5039f2ea11466e3efdb4b5a.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp 2023-07-23 05:07:53,700 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 465ab444afff22e53048a7f8402ce66e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873673.465ab444afff22e53048a7f8402ce66e.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp 2023-07-23 05:07:53,721 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873673.124c022da5039f2ea11466e3efdb4b5a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:07:53,721 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 124c022da5039f2ea11466e3efdb4b5a, disabling compactions & flushes 2023-07-23 05:07:53,721 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873673.124c022da5039f2ea11466e3efdb4b5a. 2023-07-23 05:07:53,721 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873673.124c022da5039f2ea11466e3efdb4b5a. 2023-07-23 05:07:53,721 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873673.124c022da5039f2ea11466e3efdb4b5a. after waiting 0 ms 2023-07-23 05:07:53,721 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873673.124c022da5039f2ea11466e3efdb4b5a. 2023-07-23 05:07:53,721 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873673.124c022da5039f2ea11466e3efdb4b5a. 2023-07-23 05:07:53,721 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 124c022da5039f2ea11466e3efdb4b5a: 2023-07-23 05:07:53,724 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873673.465ab444afff22e53048a7f8402ce66e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:07:53,724 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 465ab444afff22e53048a7f8402ce66e, disabling compactions & flushes 2023-07-23 05:07:53,724 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873673.465ab444afff22e53048a7f8402ce66e. 2023-07-23 05:07:53,724 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873673.465ab444afff22e53048a7f8402ce66e. 2023-07-23 05:07:53,724 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873673.465ab444afff22e53048a7f8402ce66e. after waiting 0 ms 2023-07-23 05:07:53,724 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873673.465ab444afff22e53048a7f8402ce66e. 2023-07-23 05:07:53,724 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873673.465ab444afff22e53048a7f8402ce66e. 2023-07-23 05:07:53,724 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 465ab444afff22e53048a7f8402ce66e: 2023-07-23 05:07:53,726 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 05:07:53,727 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873673.124c022da5039f2ea11466e3efdb4b5a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690088873727"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088873727"}]},"ts":"1690088873727"} 2023-07-23 05:07:53,728 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873673.465ab444afff22e53048a7f8402ce66e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690088873727"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088873727"}]},"ts":"1690088873727"} 2023-07-23 05:07:53,730 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 05:07:53,731 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 05:07:53,731 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088873731"}]},"ts":"1690088873731"} 2023-07-23 05:07:53,733 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-23 05:07:53,737 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 05:07:53,738 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 05:07:53,738 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 05:07:53,738 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 05:07:53,738 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 05:07:53,738 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=124c022da5039f2ea11466e3efdb4b5a, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=465ab444afff22e53048a7f8402ce66e, ASSIGN}] 2023-07-23 05:07:53,742 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=465ab444afff22e53048a7f8402ce66e, ASSIGN 2023-07-23 05:07:53,742 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=124c022da5039f2ea11466e3efdb4b5a, ASSIGN 2023-07-23 05:07:53,743 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=124c022da5039f2ea11466e3efdb4b5a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37855,1690088792757; forceNewPlan=false, retain=false 2023-07-23 05:07:53,743 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=465ab444afff22e53048a7f8402ce66e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44949,1690088792720; forceNewPlan=false, retain=false 2023-07-23 05:07:53,771 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088800324_0004_000001 (auth:SIMPLE) 2023-07-23 05:07:53,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-23 05:07:53,894 INFO [jenkins-hbase4:32809] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 05:07:53,897 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=465ab444afff22e53048a7f8402ce66e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:53,897 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873673.465ab444afff22e53048a7f8402ce66e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690088873897"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088873897"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088873897"}]},"ts":"1690088873897"} 2023-07-23 05:07:53,897 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=124c022da5039f2ea11466e3efdb4b5a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:53,898 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873673.124c022da5039f2ea11466e3efdb4b5a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690088873897"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088873897"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088873897"}]},"ts":"1690088873897"} 2023-07-23 05:07:53,901 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 465ab444afff22e53048a7f8402ce66e, server=jenkins-hbase4.apache.org,44949,1690088792720}] 2023-07-23 05:07:53,902 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure 124c022da5039f2ea11466e3efdb4b5a, server=jenkins-hbase4.apache.org,37855,1690088792757}] 2023-07-23 05:07:53,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-23 05:07:54,057 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873673.465ab444afff22e53048a7f8402ce66e. 2023-07-23 05:07:54,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 465ab444afff22e53048a7f8402ce66e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873673.465ab444afff22e53048a7f8402ce66e.', STARTKEY => '2', ENDKEY => ''} 2023-07-23 05:07:54,058 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873673.124c022da5039f2ea11466e3efdb4b5a. 2023-07-23 05:07:54,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 124c022da5039f2ea11466e3efdb4b5a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873673.124c022da5039f2ea11466e3efdb4b5a.', STARTKEY => '', ENDKEY => '2'} 2023-07-23 05:07:54,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873673.465ab444afff22e53048a7f8402ce66e. service=AccessControlService 2023-07-23 05:07:54,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873673.124c022da5039f2ea11466e3efdb4b5a. service=AccessControlService 2023-07-23 05:07:54,059 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:07:54,059 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:07:54,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 124c022da5039f2ea11466e3efdb4b5a 2023-07-23 05:07:54,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873673.124c022da5039f2ea11466e3efdb4b5a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:07:54,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 465ab444afff22e53048a7f8402ce66e 2023-07-23 05:07:54,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 124c022da5039f2ea11466e3efdb4b5a 2023-07-23 05:07:54,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873673.465ab444afff22e53048a7f8402ce66e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:07:54,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 124c022da5039f2ea11466e3efdb4b5a 2023-07-23 05:07:54,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 465ab444afff22e53048a7f8402ce66e 2023-07-23 05:07:54,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 465ab444afff22e53048a7f8402ce66e 2023-07-23 05:07:54,067 INFO [StoreOpener-465ab444afff22e53048a7f8402ce66e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 465ab444afff22e53048a7f8402ce66e 2023-07-23 05:07:54,067 INFO [StoreOpener-124c022da5039f2ea11466e3efdb4b5a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 124c022da5039f2ea11466e3efdb4b5a 2023-07-23 05:07:54,069 DEBUG [StoreOpener-465ab444afff22e53048a7f8402ce66e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/465ab444afff22e53048a7f8402ce66e/cf 2023-07-23 05:07:54,069 DEBUG [StoreOpener-465ab444afff22e53048a7f8402ce66e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/465ab444afff22e53048a7f8402ce66e/cf 2023-07-23 05:07:54,069 DEBUG [StoreOpener-124c022da5039f2ea11466e3efdb4b5a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/124c022da5039f2ea11466e3efdb4b5a/cf 2023-07-23 05:07:54,069 DEBUG [StoreOpener-124c022da5039f2ea11466e3efdb4b5a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/124c022da5039f2ea11466e3efdb4b5a/cf 2023-07-23 05:07:54,070 INFO [StoreOpener-465ab444afff22e53048a7f8402ce66e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 465ab444afff22e53048a7f8402ce66e columnFamilyName cf 2023-07-23 05:07:54,070 INFO [StoreOpener-124c022da5039f2ea11466e3efdb4b5a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 124c022da5039f2ea11466e3efdb4b5a columnFamilyName cf 2023-07-23 05:07:54,070 INFO [StoreOpener-465ab444afff22e53048a7f8402ce66e-1] regionserver.HStore(310): Store=465ab444afff22e53048a7f8402ce66e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:07:54,071 INFO [StoreOpener-124c022da5039f2ea11466e3efdb4b5a-1] regionserver.HStore(310): Store=124c022da5039f2ea11466e3efdb4b5a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:07:54,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/465ab444afff22e53048a7f8402ce66e 2023-07-23 05:07:54,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/465ab444afff22e53048a7f8402ce66e 2023-07-23 05:07:54,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/124c022da5039f2ea11466e3efdb4b5a 2023-07-23 05:07:54,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/124c022da5039f2ea11466e3efdb4b5a 2023-07-23 05:07:54,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 465ab444afff22e53048a7f8402ce66e 2023-07-23 05:07:54,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 124c022da5039f2ea11466e3efdb4b5a 2023-07-23 05:07:54,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/465ab444afff22e53048a7f8402ce66e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 05:07:54,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/124c022da5039f2ea11466e3efdb4b5a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 05:07:54,078 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 465ab444afff22e53048a7f8402ce66e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75144633, jitterRate=0.11974228918552399}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 05:07:54,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 465ab444afff22e53048a7f8402ce66e: 2023-07-23 05:07:54,078 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 124c022da5039f2ea11466e3efdb4b5a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59647712, jitterRate=-0.11117982864379883}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 05:07:54,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 124c022da5039f2ea11466e3efdb4b5a: 2023-07-23 05:07:54,079 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873673.124c022da5039f2ea11466e3efdb4b5a., pid=70, masterSystemTime=1690088874055 2023-07-23 05:07:54,079 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873673.465ab444afff22e53048a7f8402ce66e., pid=69, masterSystemTime=1690088874054 2023-07-23 05:07:54,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873673.465ab444afff22e53048a7f8402ce66e. 2023-07-23 05:07:54,081 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873673.465ab444afff22e53048a7f8402ce66e. 2023-07-23 05:07:54,082 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=465ab444afff22e53048a7f8402ce66e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:54,082 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873673.465ab444afff22e53048a7f8402ce66e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690088874082"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690088874082"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690088874082"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690088874082"}]},"ts":"1690088874082"} 2023-07-23 05:07:54,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873673.124c022da5039f2ea11466e3efdb4b5a. 2023-07-23 05:07:54,082 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873673.124c022da5039f2ea11466e3efdb4b5a. 2023-07-23 05:07:54,083 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=124c022da5039f2ea11466e3efdb4b5a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:54,083 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873673.124c022da5039f2ea11466e3efdb4b5a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690088874083"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690088874083"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690088874083"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690088874083"}]},"ts":"1690088874083"} 2023-07-23 05:07:54,088 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-23 05:07:54,088 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 465ab444afff22e53048a7f8402ce66e, server=jenkins-hbase4.apache.org,44949,1690088792720 in 184 msec 2023-07-23 05:07:54,095 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-23 05:07:54,095 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure 124c022da5039f2ea11466e3efdb4b5a, server=jenkins-hbase4.apache.org,37855,1690088792757 in 183 msec 2023-07-23 05:07:54,096 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=465ab444afff22e53048a7f8402ce66e, ASSIGN in 350 msec 2023-07-23 05:07:54,098 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-23 05:07:54,099 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=124c022da5039f2ea11466e3efdb4b5a, ASSIGN in 357 msec 2023-07-23 05:07:54,099 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 05:07:54,100 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088874099"}]},"ts":"1690088874099"} 2023-07-23 05:07:54,101 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-23 05:07:54,105 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 05:07:54,106 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-23 05:07:54,109 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45437] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-23 05:07:54,112 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:54,112 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:54,112 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:54,112 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:07:54,114 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 05:07:54,114 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-23 05:07:54,114 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 05:07:54,114 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 05:07:54,115 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-23 05:07:54,115 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 05:07:54,115 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-23 05:07:54,115 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-23 05:07:54,117 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 441 msec 2023-07-23 05:07:54,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-23 05:07:54,282 INFO [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-23 05:07:54,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 124c022da5039f2ea11466e3efdb4b5a, 465ab444afff22e53048a7f8402ce66e 2023-07-23 05:07:54,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32809] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[124c022da5039f2ea11466e3efdb4b5a, 465ab444afff22e53048a7f8402ce66e], force=true 2023-07-23 05:07:54,323 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[124c022da5039f2ea11466e3efdb4b5a, 465ab444afff22e53048a7f8402ce66e], force=true 2023-07-23 05:07:54,323 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[124c022da5039f2ea11466e3efdb4b5a, 465ab444afff22e53048a7f8402ce66e], force=true 2023-07-23 05:07:54,323 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[124c022da5039f2ea11466e3efdb4b5a, 465ab444afff22e53048a7f8402ce66e], force=true 2023-07-23 05:07:54,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-23 05:07:54,354 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=124c022da5039f2ea11466e3efdb4b5a, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=465ab444afff22e53048a7f8402ce66e, UNASSIGN}] 2023-07-23 05:07:54,357 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=124c022da5039f2ea11466e3efdb4b5a, UNASSIGN 2023-07-23 05:07:54,357 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=465ab444afff22e53048a7f8402ce66e, UNASSIGN 2023-07-23 05:07:54,358 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=124c022da5039f2ea11466e3efdb4b5a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:54,358 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=465ab444afff22e53048a7f8402ce66e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:54,358 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873673.124c022da5039f2ea11466e3efdb4b5a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690088874358"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088874358"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088874358"}]},"ts":"1690088874358"} 2023-07-23 05:07:54,358 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873673.465ab444afff22e53048a7f8402ce66e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690088874358"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088874358"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088874358"}]},"ts":"1690088874358"} 2023-07-23 05:07:54,360 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 124c022da5039f2ea11466e3efdb4b5a, server=jenkins-hbase4.apache.org,37855,1690088792757}] 2023-07-23 05:07:54,361 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 465ab444afff22e53048a7f8402ce66e, server=jenkins-hbase4.apache.org,44949,1690088792720}] 2023-07-23 05:07:54,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-23 05:07:54,514 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 465ab444afff22e53048a7f8402ce66e 2023-07-23 05:07:54,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 465ab444afff22e53048a7f8402ce66e, disabling compactions & flushes 2023-07-23 05:07:54,516 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873673.465ab444afff22e53048a7f8402ce66e. 2023-07-23 05:07:54,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873673.465ab444afff22e53048a7f8402ce66e. 2023-07-23 05:07:54,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873673.465ab444afff22e53048a7f8402ce66e. after waiting 0 ms 2023-07-23 05:07:54,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873673.465ab444afff22e53048a7f8402ce66e. 2023-07-23 05:07:54,516 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 465ab444afff22e53048a7f8402ce66e 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-23 05:07:54,516 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 124c022da5039f2ea11466e3efdb4b5a 2023-07-23 05:07:54,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 124c022da5039f2ea11466e3efdb4b5a, disabling compactions & flushes 2023-07-23 05:07:54,518 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873673.124c022da5039f2ea11466e3efdb4b5a. 2023-07-23 05:07:54,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873673.124c022da5039f2ea11466e3efdb4b5a. 2023-07-23 05:07:54,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873673.124c022da5039f2ea11466e3efdb4b5a. after waiting 0 ms 2023-07-23 05:07:54,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873673.124c022da5039f2ea11466e3efdb4b5a. 2023-07-23 05:07:54,518 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 124c022da5039f2ea11466e3efdb4b5a 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-23 05:07:54,555 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/124c022da5039f2ea11466e3efdb4b5a/.tmp/cf/f6fdaf056f9d4244b9e8ac6323b32ca9 2023-07-23 05:07:54,558 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/465ab444afff22e53048a7f8402ce66e/.tmp/cf/9b2acc3a5bb84ed4bfcb2547eb79a5ae 2023-07-23 05:07:54,565 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/124c022da5039f2ea11466e3efdb4b5a/.tmp/cf/f6fdaf056f9d4244b9e8ac6323b32ca9 as hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/124c022da5039f2ea11466e3efdb4b5a/cf/f6fdaf056f9d4244b9e8ac6323b32ca9 2023-07-23 05:07:54,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/465ab444afff22e53048a7f8402ce66e/.tmp/cf/9b2acc3a5bb84ed4bfcb2547eb79a5ae as hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/465ab444afff22e53048a7f8402ce66e/cf/9b2acc3a5bb84ed4bfcb2547eb79a5ae 2023-07-23 05:07:54,576 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/124c022da5039f2ea11466e3efdb4b5a/cf/f6fdaf056f9d4244b9e8ac6323b32ca9, entries=1, sequenceid=5, filesize=4.7 K 2023-07-23 05:07:54,578 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 124c022da5039f2ea11466e3efdb4b5a in 60ms, sequenceid=5, compaction requested=false 2023-07-23 05:07:54,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-23 05:07:54,580 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/465ab444afff22e53048a7f8402ce66e/cf/9b2acc3a5bb84ed4bfcb2547eb79a5ae, entries=1, sequenceid=5, filesize=4.7 K 2023-07-23 05:07:54,581 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 465ab444afff22e53048a7f8402ce66e in 65ms, sequenceid=5, compaction requested=false 2023-07-23 05:07:54,615 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/124c022da5039f2ea11466e3efdb4b5a/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-23 05:07:54,615 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/465ab444afff22e53048a7f8402ce66e/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-23 05:07:54,616 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:07:54,616 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:07:54,616 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873673.124c022da5039f2ea11466e3efdb4b5a. 2023-07-23 05:07:54,616 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873673.465ab444afff22e53048a7f8402ce66e. 2023-07-23 05:07:54,616 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 465ab444afff22e53048a7f8402ce66e: 2023-07-23 05:07:54,616 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 124c022da5039f2ea11466e3efdb4b5a: 2023-07-23 05:07:54,618 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 465ab444afff22e53048a7f8402ce66e 2023-07-23 05:07:54,618 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=465ab444afff22e53048a7f8402ce66e, regionState=CLOSED 2023-07-23 05:07:54,619 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873673.465ab444afff22e53048a7f8402ce66e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690088874618"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088874618"}]},"ts":"1690088874618"} 2023-07-23 05:07:54,619 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 124c022da5039f2ea11466e3efdb4b5a 2023-07-23 05:07:54,619 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=124c022da5039f2ea11466e3efdb4b5a, regionState=CLOSED 2023-07-23 05:07:54,620 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873673.124c022da5039f2ea11466e3efdb4b5a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690088874619"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088874619"}]},"ts":"1690088874619"} 2023-07-23 05:07:54,622 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-23 05:07:54,622 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 465ab444afff22e53048a7f8402ce66e, server=jenkins-hbase4.apache.org,44949,1690088792720 in 259 msec 2023-07-23 05:07:54,623 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-23 05:07:54,623 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 124c022da5039f2ea11466e3efdb4b5a, server=jenkins-hbase4.apache.org,37855,1690088792757 in 261 msec 2023-07-23 05:07:54,624 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=465ab444afff22e53048a7f8402ce66e, UNASSIGN in 268 msec 2023-07-23 05:07:54,626 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-23 05:07:54,626 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=124c022da5039f2ea11466e3efdb4b5a, UNASSIGN in 273 msec 2023-07-23 05:07:54,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-23 05:07:54,710 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9103e34c7be7028ea8629492805e1bf3/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-23 05:07:54,716 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873673.124c022da5039f2ea11466e3efdb4b5a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-23 05:07:54,716 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690088873673.465ab444afff22e53048a7f8402ce66e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-23 05:07:54,717 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873674.9103e34c7be7028ea8629492805e1bf3.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-23 05:07:54,783 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9103e34c7be7028ea8629492805e1bf3, ASSIGN}] 2023-07-23 05:07:54,787 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9103e34c7be7028ea8629492805e1bf3, ASSIGN 2023-07-23 05:07:54,788 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9103e34c7be7028ea8629492805e1bf3, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,37855,1690088792757; forceNewPlan=false, retain=false 2023-07-23 05:07:54,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-23 05:07:54,938 INFO [jenkins-hbase4:32809] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-23 05:07:54,940 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=9103e34c7be7028ea8629492805e1bf3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:54,940 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873674.9103e34c7be7028ea8629492805e1bf3.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690088874940"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088874940"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088874940"}]},"ts":"1690088874940"} 2023-07-23 05:07:54,944 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 9103e34c7be7028ea8629492805e1bf3, server=jenkins-hbase4.apache.org,37855,1690088792757}] 2023-07-23 05:07:55,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873674.9103e34c7be7028ea8629492805e1bf3. 2023-07-23 05:07:55,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9103e34c7be7028ea8629492805e1bf3, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873674.9103e34c7be7028ea8629492805e1bf3.', STARTKEY => '', ENDKEY => ''} 2023-07-23 05:07:55,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873674.9103e34c7be7028ea8629492805e1bf3. service=AccessControlService 2023-07-23 05:07:55,100 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:07:55,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 9103e34c7be7028ea8629492805e1bf3 2023-07-23 05:07:55,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873674.9103e34c7be7028ea8629492805e1bf3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:07:55,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9103e34c7be7028ea8629492805e1bf3 2023-07-23 05:07:55,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9103e34c7be7028ea8629492805e1bf3 2023-07-23 05:07:55,102 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9103e34c7be7028ea8629492805e1bf3/.regioninfo 2023-07-23 05:07:55,125 INFO [StoreOpener-9103e34c7be7028ea8629492805e1bf3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9103e34c7be7028ea8629492805e1bf3 2023-07-23 05:07:55,126 DEBUG [StoreOpener-9103e34c7be7028ea8629492805e1bf3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9103e34c7be7028ea8629492805e1bf3/cf 2023-07-23 05:07:55,126 DEBUG [StoreOpener-9103e34c7be7028ea8629492805e1bf3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9103e34c7be7028ea8629492805e1bf3/cf 2023-07-23 05:07:55,127 INFO [StoreOpener-9103e34c7be7028ea8629492805e1bf3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9103e34c7be7028ea8629492805e1bf3 columnFamilyName cf 2023-07-23 05:07:55,167 DEBUG [StoreOpener-9103e34c7be7028ea8629492805e1bf3-1] regionserver.HStore(539): loaded hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9103e34c7be7028ea8629492805e1bf3/cf/9b2acc3a5bb84ed4bfcb2547eb79a5ae.465ab444afff22e53048a7f8402ce66e->hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/465ab444afff22e53048a7f8402ce66e/cf/9b2acc3a5bb84ed4bfcb2547eb79a5ae-top 2023-07-23 05:07:55,179 DEBUG [StoreOpener-9103e34c7be7028ea8629492805e1bf3-1] regionserver.HStore(539): loaded hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9103e34c7be7028ea8629492805e1bf3/cf/f6fdaf056f9d4244b9e8ac6323b32ca9.124c022da5039f2ea11466e3efdb4b5a->hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/124c022da5039f2ea11466e3efdb4b5a/cf/f6fdaf056f9d4244b9e8ac6323b32ca9-top 2023-07-23 05:07:55,179 INFO [StoreOpener-9103e34c7be7028ea8629492805e1bf3-1] regionserver.HStore(310): Store=9103e34c7be7028ea8629492805e1bf3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:07:55,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9103e34c7be7028ea8629492805e1bf3 2023-07-23 05:07:55,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9103e34c7be7028ea8629492805e1bf3 2023-07-23 05:07:55,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9103e34c7be7028ea8629492805e1bf3 2023-07-23 05:07:55,187 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9103e34c7be7028ea8629492805e1bf3; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63018175, jitterRate=-0.060956016182899475}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 05:07:55,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9103e34c7be7028ea8629492805e1bf3: 2023-07-23 05:07:55,188 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873674.9103e34c7be7028ea8629492805e1bf3., pid=77, masterSystemTime=1690088875096 2023-07-23 05:07:55,189 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873674.9103e34c7be7028ea8629492805e1bf3.,because compaction is disabled. 2023-07-23 05:07:55,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873674.9103e34c7be7028ea8629492805e1bf3. 2023-07-23 05:07:55,190 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873674.9103e34c7be7028ea8629492805e1bf3. 2023-07-23 05:07:55,191 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=9103e34c7be7028ea8629492805e1bf3, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:55,191 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873674.9103e34c7be7028ea8629492805e1bf3.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690088875191"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690088875191"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690088875191"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690088875191"}]},"ts":"1690088875191"} 2023-07-23 05:07:55,198 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-23 05:07:55,198 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 9103e34c7be7028ea8629492805e1bf3, server=jenkins-hbase4.apache.org,37855,1690088792757 in 251 msec 2023-07-23 05:07:55,200 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-23 05:07:55,200 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9103e34c7be7028ea8629492805e1bf3, ASSIGN in 415 msec 2023-07-23 05:07:55,202 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[124c022da5039f2ea11466e3efdb4b5a, 465ab444afff22e53048a7f8402ce66e], force=true in 887 msec 2023-07-23 05:07:55,431 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 05:07:55,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-23 05:07:55,439 INFO [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-23 05:07:55,440 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-23 05:07:55,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690088875440 (current time:1690088875440). 2023-07-23 05:07:55,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 05:07:55,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] zookeeper.ReadOnlyZKClient(139): Connect 0x11cfb327 to 127.0.0.1:57388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:07:55,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f084f6e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:07:55,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:55,480 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47286, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:55,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x11cfb327 to 127.0.0.1:57388 2023-07-23 05:07:55,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:07:55,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] zookeeper.ReadOnlyZKClient(139): Connect 0x5e354555 to 127.0.0.1:57388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:07:55,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@320f833f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:07:55,527 DEBUG [hconnection-0x6fa1d92f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:55,535 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47302, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:55,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:07:55,547 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54054, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:07:55,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5e354555 to 127.0.0.1:57388 2023-07-23 05:07:55,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:07:55,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-23 05:07:55,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 05:07:55,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-23 05:07:55,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-23 05:07:55,567 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-23 05:07:55,568 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1690089475568 2023-07-23 05:07:55,568 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-23 05:07:55,569 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 05:07:55,569 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 05:07:55,593 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-23 05:07:55,595 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-23 05:07:55,597 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 33 msec 2023-07-23 05:07:55,600 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-23 05:07:55,602 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1690089475602 2023-07-23 05:07:55,669 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:07:55,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-23 05:07:55,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:07:55,671 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 05:07:55,709 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,709 INFO [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-23 05:07:55,709 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:55,709 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-23 05:07:55,709 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-23 05:07:55,710 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,710 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,711 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:55,712 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:55,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:55,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:55,711 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:55,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:55,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:55,712 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:55,712 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 05:07:55,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,713 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:55,713 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:55,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:55,714 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-23 05:07:55,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,715 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-23 05:07:55,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-23 05:07:55,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,715 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,716 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-23 05:07:55,716 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-23 05:07:55,716 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:55,716 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-23 05:07:55,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,716 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-23 05:07:55,718 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,719 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-23 05:07:55,719 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:55,725 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,728 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-23 05:07:55,728 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-23 05:07:55,730 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-23 05:07:55,730 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44949,1690088792720' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-23 05:07:55,730 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-23 05:07:55,730 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-23 05:07:55,730 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:07:55,730 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37855,1690088792757' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-23 05:07:55,732 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-23 05:07:55,732 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-23 05:07:55,732 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45437,1690088792660' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-23 05:07:55,734 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,735 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:55,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:55,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:55,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:55,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:55,736 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,736 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,736 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:07:55,737 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:55,737 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,737 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:07:55,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,738 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,738 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:07:55,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:55,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:55,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:55,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:55,740 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37855,1690088792757' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-23 05:07:55,740 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c9fd321[Count = 0] remaining members to acquire global barrier 2023-07-23 05:07:55,740 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-23 05:07:55,740 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,741 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,741 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,741 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,741 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:55,741 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-23 05:07:55,742 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-23 05:07:55,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,742 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,45437,1690088792660' in zk 2023-07-23 05:07:55,742 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 05:07:55,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,742 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-23 05:07:55,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,742 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-23 05:07:55,742 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-23 05:07:55,742 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,44949,1690088792720' in zk 2023-07-23 05:07:55,742 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:07:55,742 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:07:55,742 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873674.9103e34c7be7028ea8629492805e1bf3. 2023-07-23 05:07:55,742 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873674.9103e34c7be7028ea8629492805e1bf3. started... 2023-07-23 05:07:55,744 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9103e34c7be7028ea8629492805e1bf3: 2023-07-23 05:07:55,744 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-23 05:07:55,744 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873674.9103e34c7be7028ea8629492805e1bf3.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,744 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:07:55,744 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:55,744 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-23 05:07:55,744 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9103e34c7be7028ea8629492805e1bf3/cf/9b2acc3a5bb84ed4bfcb2547eb79a5ae.465ab444afff22e53048a7f8402ce66e->hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/465ab444afff22e53048a7f8402ce66e/cf/9b2acc3a5bb84ed4bfcb2547eb79a5ae-top, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9103e34c7be7028ea8629492805e1bf3/cf/f6fdaf056f9d4244b9e8ac6323b32ca9.124c022da5039f2ea11466e3efdb4b5a->hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/124c022da5039f2ea11466e3efdb4b5a/cf/f6fdaf056f9d4244b9e8ac6323b32ca9-top] hfiles 2023-07-23 05:07:55,747 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-23 05:07:55,747 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:55,747 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9103e34c7be7028ea8629492805e1bf3/cf/9b2acc3a5bb84ed4bfcb2547eb79a5ae.465ab444afff22e53048a7f8402ce66e for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,747 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-23 05:07:55,752 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9103e34c7be7028ea8629492805e1bf3/cf/f6fdaf056f9d4244b9e8ac6323b32ca9.124c022da5039f2ea11466e3efdb4b5a for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,770 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873674.9103e34c7be7028ea8629492805e1bf3. completed. 2023-07-23 05:07:55,770 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873674.9103e34c7be7028ea8629492805e1bf3. 2023-07-23 05:07:55,770 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:07:55,771 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:07:55,771 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:55,771 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-23 05:07:55,771 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,37855,1690088792757' in zk 2023-07-23 05:07:55,776 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-23 05:07:55,776 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:55,776 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:55,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:55,776 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-23 05:07:55,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:55,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:55,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:55,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:55,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:55,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:55,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:55,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:55,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:55,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:55,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:55,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,37855,1690088792757': 2023-07-23 05:07:55,780 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37855,1690088792757' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-23 05:07:55,780 INFO [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-23 05:07:55,780 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 05:07:55,780 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 05:07:55,780 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,781 INFO [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 05:07:55,782 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,782 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,782 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,782 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:55,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:07:55,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:07:55,782 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:55,782 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:55,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:55,783 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:55,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:55,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:55,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:07:55,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,784 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:55,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:55,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:55,790 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:55,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:07:55,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,791 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:55,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:55,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:55,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:55,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:07:55,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,793 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:55,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:55,794 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:55,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:55,794 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:55,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:55,797 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:55,797 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:55,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:55,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:55,797 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:55,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:55,797 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:55,797 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:55,797 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,797 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:55,797 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:55,798 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,798 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:07:55,798 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,798 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:07:55,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:55,797 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:07:55,798 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:07:55,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:07:55,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:07:55,798 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,798 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,798 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:07:55,799 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:07:55,799 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,799 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:55,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:55,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:55,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:55,799 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:07:55,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:07:55,843 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,871 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:07:55,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-23 05:07:55,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:07:55,873 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 05:07:55,965 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-23 05:07:55,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,966 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:55,966 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1690088875568Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690088875798 (+230 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690088875798Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690088875803 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690088875824 (+21 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1690088875965 (+141 ms) 2023-07-23 05:07:55,970 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-23 05:07:55,972 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 378 msec 2023-07-23 05:07:56,173 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:07:56,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-23 05:07:56,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 05:07:56,175 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088876175 2023-07-23 05:07:56,175 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38911, tgtDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088876175, rawTgtDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088876175, srcFsUri=hdfs://localhost:38911, srcDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd 2023-07-23 05:07:56,208 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38911, inputRoot=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd 2023-07-23 05:07:56,208 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1669994456_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088876175, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088876175/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:56,208 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38911, inputRoot=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd, snapshotDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-23 05:07:56,238 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088876175/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:07:56,282 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:56,283 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:56,283 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:56,284 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:56,284 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:56,285 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:56,285 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:56,377 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/hadoop-2297780383923880475.jar 2023-07-23 05:07:56,378 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:56,378 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:56,379 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:56,379 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:56,380 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:56,380 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 05:07:56,381 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 05:07:56,381 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 05:07:56,382 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 05:07:56,382 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 05:07:56,383 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 05:07:56,383 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 05:07:56,384 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 05:07:56,384 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 05:07:56,385 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 05:07:56,385 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 05:07:56,386 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:07:56,386 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:07:56,387 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 05:07:56,387 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:07:56,387 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:07:56,388 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 05:07:56,388 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 05:07:57,324 WARN [Listener at jenkins-hbase4.apache.org/33827] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 05:07:57,331 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-23 05:07:57,334 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-23 05:07:57,868 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 05:07:57,870 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 05:07:58,437 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088800324_0005_000001 (auth:SIMPLE) 2023-07-23 05:08:00,605 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 05:08:04,305 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088800324_0005_000001 (auth:SIMPLE) 2023-07-23 05:08:06,702 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088800324_0005_000001 (auth:SIMPLE) 2023-07-23 05:08:12,046 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 05:08:12,049 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 05:08:12,057 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:12,057 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 05:08:12,058 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 05:08:12,058 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-154173811_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:12,059 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(367): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-23 05:08:12,059 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(367): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-23 05:08:12,059 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-154173811_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088876175/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088876175/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:12,060 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(367): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088876175/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-23 05:08:12,060 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(367): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088876175/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-23 05:08:12,069 INFO [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:12,069 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:12,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:12,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-23 05:08:12,074 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088892074"}]},"ts":"1690088892074"} 2023-07-23 05:08:12,076 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-23 05:08:12,078 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-23 05:08:12,078 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9103e34c7be7028ea8629492805e1bf3, UNASSIGN}] 2023-07-23 05:08:12,080 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9103e34c7be7028ea8629492805e1bf3, UNASSIGN 2023-07-23 05:08:12,081 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=9103e34c7be7028ea8629492805e1bf3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:12,082 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873674.9103e34c7be7028ea8629492805e1bf3.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690088892081"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088892081"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088892081"}]},"ts":"1690088892081"} 2023-07-23 05:08:12,083 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 9103e34c7be7028ea8629492805e1bf3, server=jenkins-hbase4.apache.org,37855,1690088792757}] 2023-07-23 05:08:12,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-23 05:08:12,240 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9103e34c7be7028ea8629492805e1bf3 2023-07-23 05:08:12,240 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9103e34c7be7028ea8629492805e1bf3, disabling compactions & flushes 2023-07-23 05:08:12,240 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873674.9103e34c7be7028ea8629492805e1bf3. 2023-07-23 05:08:12,240 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873674.9103e34c7be7028ea8629492805e1bf3. 2023-07-23 05:08:12,240 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873674.9103e34c7be7028ea8629492805e1bf3. after waiting 0 ms 2023-07-23 05:08:12,240 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873674.9103e34c7be7028ea8629492805e1bf3. 2023-07-23 05:08:12,249 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9103e34c7be7028ea8629492805e1bf3/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-23 05:08:12,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:08:12,251 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873674.9103e34c7be7028ea8629492805e1bf3. 2023-07-23 05:08:12,251 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9103e34c7be7028ea8629492805e1bf3: 2023-07-23 05:08:12,253 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9103e34c7be7028ea8629492805e1bf3 2023-07-23 05:08:12,255 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=9103e34c7be7028ea8629492805e1bf3, regionState=CLOSED 2023-07-23 05:08:12,255 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873674.9103e34c7be7028ea8629492805e1bf3.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690088892255"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088892255"}]},"ts":"1690088892255"} 2023-07-23 05:08:12,262 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-23 05:08:12,262 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 9103e34c7be7028ea8629492805e1bf3, server=jenkins-hbase4.apache.org,37855,1690088792757 in 177 msec 2023-07-23 05:08:12,264 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-23 05:08:12,264 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9103e34c7be7028ea8629492805e1bf3, UNASSIGN in 184 msec 2023-07-23 05:08:12,265 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088892264"}]},"ts":"1690088892264"} 2023-07-23 05:08:12,266 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-23 05:08:12,269 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-23 05:08:12,270 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 200 msec 2023-07-23 05:08:12,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-23 05:08:12,377 INFO [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-23 05:08:12,378 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:12,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:12,381 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:12,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:12,382 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:12,383 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45437] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:12,386 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:12,386 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:12,387 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:12,386 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:12,387 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-23 05:08:12,387 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-23 05:08:12,387 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-23 05:08:12,387 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-23 05:08:12,388 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9103e34c7be7028ea8629492805e1bf3 2023-07-23 05:08:12,388 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/465ab444afff22e53048a7f8402ce66e 2023-07-23 05:08:12,388 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/124c022da5039f2ea11466e3efdb4b5a 2023-07-23 05:08:12,388 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:12,388 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:12,388 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:12,388 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:12,388 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:12,388 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:12,388 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:12,388 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:12,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-23 05:08:12,389 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 05:08:12,389 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 05:08:12,390 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 05:08:12,390 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 05:08:12,391 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/465ab444afff22e53048a7f8402ce66e/cf, FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/465ab444afff22e53048a7f8402ce66e/recovered.edits] 2023-07-23 05:08:12,391 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/124c022da5039f2ea11466e3efdb4b5a/cf, FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/124c022da5039f2ea11466e3efdb4b5a/recovered.edits] 2023-07-23 05:08:12,393 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9103e34c7be7028ea8629492805e1bf3/cf, FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9103e34c7be7028ea8629492805e1bf3/recovered.edits] 2023-07-23 05:08:12,395 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/465ab444afff22e53048a7f8402ce66e/cf/9b2acc3a5bb84ed4bfcb2547eb79a5ae to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/465ab444afff22e53048a7f8402ce66e/cf/9b2acc3a5bb84ed4bfcb2547eb79a5ae 2023-07-23 05:08:12,396 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/124c022da5039f2ea11466e3efdb4b5a/cf/f6fdaf056f9d4244b9e8ac6323b32ca9 to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/124c022da5039f2ea11466e3efdb4b5a/cf/f6fdaf056f9d4244b9e8ac6323b32ca9 2023-07-23 05:08:12,399 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9103e34c7be7028ea8629492805e1bf3/cf/9b2acc3a5bb84ed4bfcb2547eb79a5ae.465ab444afff22e53048a7f8402ce66e to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9103e34c7be7028ea8629492805e1bf3/cf/9b2acc3a5bb84ed4bfcb2547eb79a5ae.465ab444afff22e53048a7f8402ce66e 2023-07-23 05:08:12,401 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/465ab444afff22e53048a7f8402ce66e/recovered.edits/8.seqid to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/465ab444afff22e53048a7f8402ce66e/recovered.edits/8.seqid 2023-07-23 05:08:12,401 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/124c022da5039f2ea11466e3efdb4b5a/recovered.edits/8.seqid to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/124c022da5039f2ea11466e3efdb4b5a/recovered.edits/8.seqid 2023-07-23 05:08:12,401 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9103e34c7be7028ea8629492805e1bf3/cf/f6fdaf056f9d4244b9e8ac6323b32ca9.124c022da5039f2ea11466e3efdb4b5a to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9103e34c7be7028ea8629492805e1bf3/cf/f6fdaf056f9d4244b9e8ac6323b32ca9.124c022da5039f2ea11466e3efdb4b5a 2023-07-23 05:08:12,402 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/465ab444afff22e53048a7f8402ce66e 2023-07-23 05:08:12,402 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/124c022da5039f2ea11466e3efdb4b5a 2023-07-23 05:08:12,405 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9103e34c7be7028ea8629492805e1bf3/recovered.edits/12.seqid to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9103e34c7be7028ea8629492805e1bf3/recovered.edits/12.seqid 2023-07-23 05:08:12,406 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9103e34c7be7028ea8629492805e1bf3 2023-07-23 05:08:12,406 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-23 05:08:12,408 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:12,416 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-23 05:08:12,418 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-23 05:08:12,421 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:12,421 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-23 05:08:12,421 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873674.9103e34c7be7028ea8629492805e1bf3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690088892421"}]},"ts":"9223372036854775807"} 2023-07-23 05:08:12,422 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-23 05:08:12,422 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9103e34c7be7028ea8629492805e1bf3, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690088873674.9103e34c7be7028ea8629492805e1bf3.', STARTKEY => '', ENDKEY => ''}] 2023-07-23 05:08:12,423 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-23 05:08:12,423 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690088892423"}]},"ts":"9223372036854775807"} 2023-07-23 05:08:12,426 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-23 05:08:12,428 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:12,432 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 50 msec 2023-07-23 05:08:12,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-23 05:08:12,492 INFO [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-23 05:08:12,492 INFO [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:12,493 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:12,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:12,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-23 05:08:12,502 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088892501"}]},"ts":"1690088892501"} 2023-07-23 05:08:12,503 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-23 05:08:12,505 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-23 05:08:12,506 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d1a242a852741ea269fd8505c929a214, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a7c5e80d9bcf0d14aa2a3f9c86e41a22, UNASSIGN}] 2023-07-23 05:08:12,508 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d1a242a852741ea269fd8505c929a214, UNASSIGN 2023-07-23 05:08:12,508 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a7c5e80d9bcf0d14aa2a3f9c86e41a22, UNASSIGN 2023-07-23 05:08:12,509 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=d1a242a852741ea269fd8505c929a214, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:12,509 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=a7c5e80d9bcf0d14aa2a3f9c86e41a22, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:12,509 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690088870128.d1a242a852741ea269fd8505c929a214.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690088892509"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088892509"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088892509"}]},"ts":"1690088892509"} 2023-07-23 05:08:12,509 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690088870128.a7c5e80d9bcf0d14aa2a3f9c86e41a22.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690088892509"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088892509"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088892509"}]},"ts":"1690088892509"} 2023-07-23 05:08:12,510 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure d1a242a852741ea269fd8505c929a214, server=jenkins-hbase4.apache.org,44949,1690088792720}] 2023-07-23 05:08:12,511 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure a7c5e80d9bcf0d14aa2a3f9c86e41a22, server=jenkins-hbase4.apache.org,37855,1690088792757}] 2023-07-23 05:08:12,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-23 05:08:12,663 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d1a242a852741ea269fd8505c929a214 2023-07-23 05:08:12,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d1a242a852741ea269fd8505c929a214, disabling compactions & flushes 2023-07-23 05:08:12,663 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690088870128.d1a242a852741ea269fd8505c929a214. 2023-07-23 05:08:12,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690088870128.d1a242a852741ea269fd8505c929a214. 2023-07-23 05:08:12,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690088870128.d1a242a852741ea269fd8505c929a214. after waiting 0 ms 2023-07-23 05:08:12,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690088870128.d1a242a852741ea269fd8505c929a214. 2023-07-23 05:08:12,665 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a7c5e80d9bcf0d14aa2a3f9c86e41a22 2023-07-23 05:08:12,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a7c5e80d9bcf0d14aa2a3f9c86e41a22, disabling compactions & flushes 2023-07-23 05:08:12,668 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690088870128.a7c5e80d9bcf0d14aa2a3f9c86e41a22. 2023-07-23 05:08:12,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690088870128.a7c5e80d9bcf0d14aa2a3f9c86e41a22. 2023-07-23 05:08:12,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690088870128.a7c5e80d9bcf0d14aa2a3f9c86e41a22. after waiting 0 ms 2023-07-23 05:08:12,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690088870128.a7c5e80d9bcf0d14aa2a3f9c86e41a22. 2023-07-23 05:08:12,675 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion/d1a242a852741ea269fd8505c929a214/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 05:08:12,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:08:12,677 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690088870128.d1a242a852741ea269fd8505c929a214. 2023-07-23 05:08:12,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d1a242a852741ea269fd8505c929a214: 2023-07-23 05:08:12,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7c5e80d9bcf0d14aa2a3f9c86e41a22/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 05:08:12,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:08:12,678 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690088870128.a7c5e80d9bcf0d14aa2a3f9c86e41a22. 2023-07-23 05:08:12,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a7c5e80d9bcf0d14aa2a3f9c86e41a22: 2023-07-23 05:08:12,679 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d1a242a852741ea269fd8505c929a214 2023-07-23 05:08:12,680 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=d1a242a852741ea269fd8505c929a214, regionState=CLOSED 2023-07-23 05:08:12,680 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a7c5e80d9bcf0d14aa2a3f9c86e41a22 2023-07-23 05:08:12,680 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690088870128.d1a242a852741ea269fd8505c929a214.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690088892680"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088892680"}]},"ts":"1690088892680"} 2023-07-23 05:08:12,680 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=a7c5e80d9bcf0d14aa2a3f9c86e41a22, regionState=CLOSED 2023-07-23 05:08:12,681 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690088870128.a7c5e80d9bcf0d14aa2a3f9c86e41a22.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690088892680"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088892680"}]},"ts":"1690088892680"} 2023-07-23 05:08:12,685 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-23 05:08:12,685 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-23 05:08:12,685 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure a7c5e80d9bcf0d14aa2a3f9c86e41a22, server=jenkins-hbase4.apache.org,37855,1690088792757 in 171 msec 2023-07-23 05:08:12,685 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure d1a242a852741ea269fd8505c929a214, server=jenkins-hbase4.apache.org,44949,1690088792720 in 171 msec 2023-07-23 05:08:12,686 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d1a242a852741ea269fd8505c929a214, UNASSIGN in 180 msec 2023-07-23 05:08:12,686 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-23 05:08:12,686 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a7c5e80d9bcf0d14aa2a3f9c86e41a22, UNASSIGN in 180 msec 2023-07-23 05:08:12,687 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088892687"}]},"ts":"1690088892687"} 2023-07-23 05:08:12,688 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-23 05:08:12,690 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-23 05:08:12,692 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 198 msec 2023-07-23 05:08:12,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-23 05:08:12,801 INFO [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-23 05:08:12,802 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:12,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:12,806 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:12,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:12,807 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:12,808 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45437] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:12,812 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:12,812 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:12,812 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:12,812 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:12,813 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d1a242a852741ea269fd8505c929a214 2023-07-23 05:08:12,813 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7c5e80d9bcf0d14aa2a3f9c86e41a22 2023-07-23 05:08:12,813 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-23 05:08:12,814 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-23 05:08:12,814 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-23 05:08:12,815 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:12,815 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:12,815 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:12,815 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:12,815 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:12,815 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:12,815 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:12,815 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:12,815 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-23 05:08:12,816 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7c5e80d9bcf0d14aa2a3f9c86e41a22/cf, FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7c5e80d9bcf0d14aa2a3f9c86e41a22/recovered.edits] 2023-07-23 05:08:12,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-23 05:08:12,818 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d1a242a852741ea269fd8505c929a214/cf, FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d1a242a852741ea269fd8505c929a214/recovered.edits] 2023-07-23 05:08:12,825 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7c5e80d9bcf0d14aa2a3f9c86e41a22/cf/191d14d8f1c74a9bb6c7b6d3fdd534cf to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7c5e80d9bcf0d14aa2a3f9c86e41a22/cf/191d14d8f1c74a9bb6c7b6d3fdd534cf 2023-07-23 05:08:12,826 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d1a242a852741ea269fd8505c929a214/cf/56605ea2367e483f853cd267bf120d29 to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/d1a242a852741ea269fd8505c929a214/cf/56605ea2367e483f853cd267bf120d29 2023-07-23 05:08:12,829 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7c5e80d9bcf0d14aa2a3f9c86e41a22/recovered.edits/9.seqid to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7c5e80d9bcf0d14aa2a3f9c86e41a22/recovered.edits/9.seqid 2023-07-23 05:08:12,830 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a7c5e80d9bcf0d14aa2a3f9c86e41a22 2023-07-23 05:08:12,830 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d1a242a852741ea269fd8505c929a214/recovered.edits/9.seqid to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/d1a242a852741ea269fd8505c929a214/recovered.edits/9.seqid 2023-07-23 05:08:12,831 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d1a242a852741ea269fd8505c929a214 2023-07-23 05:08:12,831 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-23 05:08:12,831 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-23 05:08:12,832 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-23 05:08:12,836 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307235439e7aca34943d8bbe814f33db9cce7 to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307235439e7aca34943d8bbe814f33db9cce7 2023-07-23 05:08:12,838 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230723812556a104d94e7ebd13a42d0c032f4a to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230723812556a104d94e7ebd13a42d0c032f4a 2023-07-23 05:08:12,838 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-23 05:08:12,841 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:12,843 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-23 05:08:12,845 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-23 05:08:12,846 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:12,846 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-23 05:08:12,846 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690088870128.d1a242a852741ea269fd8505c929a214.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690088892846"}]},"ts":"9223372036854775807"} 2023-07-23 05:08:12,847 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690088870128.a7c5e80d9bcf0d14aa2a3f9c86e41a22.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690088892846"}]},"ts":"9223372036854775807"} 2023-07-23 05:08:12,848 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-23 05:08:12,848 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d1a242a852741ea269fd8505c929a214, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690088870128.d1a242a852741ea269fd8505c929a214.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a7c5e80d9bcf0d14aa2a3f9c86e41a22, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690088870128.a7c5e80d9bcf0d14aa2a3f9c86e41a22.', STARTKEY => '1', ENDKEY => ''}] 2023-07-23 05:08:12,848 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-23 05:08:12,848 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690088892848"}]},"ts":"9223372036854775807"} 2023-07-23 05:08:12,850 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-23 05:08:12,852 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:12,853 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 50 msec 2023-07-23 05:08:12,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-23 05:08:12,919 INFO [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-23 05:08:12,930 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-23 05:08:12,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:12,934 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-23 05:08:12,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 05:08:12,939 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-23 05:08:12,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 05:08:12,971 INFO [Listener at jenkins-hbase4.apache.org/33827] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=758 (was 746) Potentially hanging thread: IPC Client (583231684) connection to jenkins-hbase4.apache.org/172.31.14.131:39443 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x76a1f2b0-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-154173811_17 at /127.0.0.1:49610 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x76a1f2b0-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4105 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x76a1f2b0-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1450894623_1 at /127.0.0.1:49884 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x76a1f2b0-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1450894623_1 at /127.0.0.1:49580 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-154173811_17 at /127.0.0.1:49910 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x76a1f2b0-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x76a1f2b0-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-154173811_17 at /127.0.0.1:47566 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=905 (was 901) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=583 (was 399) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 181), AvailableMemoryMB=5568 (was 6021) 2023-07-23 05:08:12,972 WARN [Listener at jenkins-hbase4.apache.org/33827] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-23 05:08:12,999 INFO [Listener at jenkins-hbase4.apache.org/33827] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=758, OpenFileDescriptor=905, MaxFileDescriptor=60000, SystemLoadAverage=583, ProcessCount=181, AvailableMemoryMB=5567 2023-07-23 05:08:12,999 WARN [Listener at jenkins-hbase4.apache.org/33827] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-23 05:08:13,002 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-23 05:08:13,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 05:08:13,009 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 05:08:13,009 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-23 05:08:13,010 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 05:08:13,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-23 05:08:13,012 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testEmptyExportFileSystemState/bbf2ee2b0d325ea8cc5db8a3247a75e9 2023-07-23 05:08:13,012 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testEmptyExportFileSystemState/d0af2a5cacfde8d9ed963bc319ce7910 2023-07-23 05:08:13,013 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testEmptyExportFileSystemState/bbf2ee2b0d325ea8cc5db8a3247a75e9 empty. 2023-07-23 05:08:13,013 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testEmptyExportFileSystemState/d0af2a5cacfde8d9ed963bc319ce7910 empty. 2023-07-23 05:08:13,014 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testEmptyExportFileSystemState/bbf2ee2b0d325ea8cc5db8a3247a75e9 2023-07-23 05:08:13,014 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testEmptyExportFileSystemState/d0af2a5cacfde8d9ed963bc319ce7910 2023-07-23 05:08:13,014 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-23 05:08:13,032 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-23 05:08:13,033 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => bbf2ee2b0d325ea8cc5db8a3247a75e9, NAME => 'testtb-testEmptyExportFileSystemState,,1690088893001.bbf2ee2b0d325ea8cc5db8a3247a75e9.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp 2023-07-23 05:08:13,034 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => d0af2a5cacfde8d9ed963bc319ce7910, NAME => 'testtb-testEmptyExportFileSystemState,1,1690088893001.d0af2a5cacfde8d9ed963bc319ce7910.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp 2023-07-23 05:08:13,076 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690088893001.d0af2a5cacfde8d9ed963bc319ce7910.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:08:13,077 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing d0af2a5cacfde8d9ed963bc319ce7910, disabling compactions & flushes 2023-07-23 05:08:13,077 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690088893001.d0af2a5cacfde8d9ed963bc319ce7910. 2023-07-23 05:08:13,077 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690088893001.d0af2a5cacfde8d9ed963bc319ce7910. 2023-07-23 05:08:13,077 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690088893001.d0af2a5cacfde8d9ed963bc319ce7910. after waiting 0 ms 2023-07-23 05:08:13,077 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690088893001.d0af2a5cacfde8d9ed963bc319ce7910. 2023-07-23 05:08:13,077 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690088893001.d0af2a5cacfde8d9ed963bc319ce7910. 2023-07-23 05:08:13,077 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for d0af2a5cacfde8d9ed963bc319ce7910: 2023-07-23 05:08:13,081 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690088893001.bbf2ee2b0d325ea8cc5db8a3247a75e9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:08:13,081 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing bbf2ee2b0d325ea8cc5db8a3247a75e9, disabling compactions & flushes 2023-07-23 05:08:13,081 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690088893001.bbf2ee2b0d325ea8cc5db8a3247a75e9. 2023-07-23 05:08:13,081 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690088893001.bbf2ee2b0d325ea8cc5db8a3247a75e9. 2023-07-23 05:08:13,081 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690088893001.bbf2ee2b0d325ea8cc5db8a3247a75e9. after waiting 0 ms 2023-07-23 05:08:13,081 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690088893001.bbf2ee2b0d325ea8cc5db8a3247a75e9. 2023-07-23 05:08:13,081 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690088893001.bbf2ee2b0d325ea8cc5db8a3247a75e9. 2023-07-23 05:08:13,081 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for bbf2ee2b0d325ea8cc5db8a3247a75e9: 2023-07-23 05:08:13,084 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 05:08:13,085 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690088893001.d0af2a5cacfde8d9ed963bc319ce7910.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690088893085"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088893085"}]},"ts":"1690088893085"} 2023-07-23 05:08:13,085 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690088893001.bbf2ee2b0d325ea8cc5db8a3247a75e9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690088893085"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088893085"}]},"ts":"1690088893085"} 2023-07-23 05:08:13,087 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 05:08:13,088 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 05:08:13,088 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088893088"}]},"ts":"1690088893088"} 2023-07-23 05:08:13,090 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-23 05:08:13,095 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 05:08:13,097 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 05:08:13,097 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 05:08:13,097 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 05:08:13,097 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 05:08:13,097 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=bbf2ee2b0d325ea8cc5db8a3247a75e9, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d0af2a5cacfde8d9ed963bc319ce7910, ASSIGN}] 2023-07-23 05:08:13,102 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d0af2a5cacfde8d9ed963bc319ce7910, ASSIGN 2023-07-23 05:08:13,102 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=bbf2ee2b0d325ea8cc5db8a3247a75e9, ASSIGN 2023-07-23 05:08:13,103 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d0af2a5cacfde8d9ed963bc319ce7910, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37855,1690088792757; forceNewPlan=false, retain=false 2023-07-23 05:08:13,103 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=bbf2ee2b0d325ea8cc5db8a3247a75e9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44949,1690088792720; forceNewPlan=false, retain=false 2023-07-23 05:08:13,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-23 05:08:13,253 INFO [jenkins-hbase4:32809] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 05:08:13,256 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=bbf2ee2b0d325ea8cc5db8a3247a75e9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:13,256 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=d0af2a5cacfde8d9ed963bc319ce7910, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:13,257 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690088893001.bbf2ee2b0d325ea8cc5db8a3247a75e9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690088893256"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088893256"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088893256"}]},"ts":"1690088893256"} 2023-07-23 05:08:13,257 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690088893001.d0af2a5cacfde8d9ed963bc319ce7910.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690088893256"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088893256"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088893256"}]},"ts":"1690088893256"} 2023-07-23 05:08:13,259 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure bbf2ee2b0d325ea8cc5db8a3247a75e9, server=jenkins-hbase4.apache.org,44949,1690088792720}] 2023-07-23 05:08:13,260 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure d0af2a5cacfde8d9ed963bc319ce7910, server=jenkins-hbase4.apache.org,37855,1690088792757}] 2023-07-23 05:08:13,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-23 05:08:13,417 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1690088893001.bbf2ee2b0d325ea8cc5db8a3247a75e9. 2023-07-23 05:08:13,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bbf2ee2b0d325ea8cc5db8a3247a75e9, NAME => 'testtb-testEmptyExportFileSystemState,,1690088893001.bbf2ee2b0d325ea8cc5db8a3247a75e9.', STARTKEY => '', ENDKEY => '1'} 2023-07-23 05:08:13,417 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1690088893001.d0af2a5cacfde8d9ed963bc319ce7910. 2023-07-23 05:08:13,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d0af2a5cacfde8d9ed963bc319ce7910, NAME => 'testtb-testEmptyExportFileSystemState,1,1690088893001.d0af2a5cacfde8d9ed963bc319ce7910.', STARTKEY => '1', ENDKEY => ''} 2023-07-23 05:08:13,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1690088893001.bbf2ee2b0d325ea8cc5db8a3247a75e9. service=AccessControlService 2023-07-23 05:08:13,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1690088893001.d0af2a5cacfde8d9ed963bc319ce7910. service=AccessControlService 2023-07-23 05:08:13,418 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:08:13,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState bbf2ee2b0d325ea8cc5db8a3247a75e9 2023-07-23 05:08:13,418 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:08:13,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690088893001.bbf2ee2b0d325ea8cc5db8a3247a75e9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:08:13,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bbf2ee2b0d325ea8cc5db8a3247a75e9 2023-07-23 05:08:13,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState d0af2a5cacfde8d9ed963bc319ce7910 2023-07-23 05:08:13,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bbf2ee2b0d325ea8cc5db8a3247a75e9 2023-07-23 05:08:13,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690088893001.d0af2a5cacfde8d9ed963bc319ce7910.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:08:13,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d0af2a5cacfde8d9ed963bc319ce7910 2023-07-23 05:08:13,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d0af2a5cacfde8d9ed963bc319ce7910 2023-07-23 05:08:13,427 INFO [StoreOpener-d0af2a5cacfde8d9ed963bc319ce7910-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d0af2a5cacfde8d9ed963bc319ce7910 2023-07-23 05:08:13,429 INFO [StoreOpener-bbf2ee2b0d325ea8cc5db8a3247a75e9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bbf2ee2b0d325ea8cc5db8a3247a75e9 2023-07-23 05:08:13,430 DEBUG [StoreOpener-d0af2a5cacfde8d9ed963bc319ce7910-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testEmptyExportFileSystemState/d0af2a5cacfde8d9ed963bc319ce7910/cf 2023-07-23 05:08:13,430 DEBUG [StoreOpener-d0af2a5cacfde8d9ed963bc319ce7910-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testEmptyExportFileSystemState/d0af2a5cacfde8d9ed963bc319ce7910/cf 2023-07-23 05:08:13,430 INFO [StoreOpener-d0af2a5cacfde8d9ed963bc319ce7910-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d0af2a5cacfde8d9ed963bc319ce7910 columnFamilyName cf 2023-07-23 05:08:13,430 DEBUG [StoreOpener-bbf2ee2b0d325ea8cc5db8a3247a75e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testEmptyExportFileSystemState/bbf2ee2b0d325ea8cc5db8a3247a75e9/cf 2023-07-23 05:08:13,431 DEBUG [StoreOpener-bbf2ee2b0d325ea8cc5db8a3247a75e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testEmptyExportFileSystemState/bbf2ee2b0d325ea8cc5db8a3247a75e9/cf 2023-07-23 05:08:13,431 INFO [StoreOpener-bbf2ee2b0d325ea8cc5db8a3247a75e9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bbf2ee2b0d325ea8cc5db8a3247a75e9 columnFamilyName cf 2023-07-23 05:08:13,432 INFO [StoreOpener-d0af2a5cacfde8d9ed963bc319ce7910-1] regionserver.HStore(310): Store=d0af2a5cacfde8d9ed963bc319ce7910/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:08:13,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testEmptyExportFileSystemState/d0af2a5cacfde8d9ed963bc319ce7910 2023-07-23 05:08:13,434 INFO [StoreOpener-bbf2ee2b0d325ea8cc5db8a3247a75e9-1] regionserver.HStore(310): Store=bbf2ee2b0d325ea8cc5db8a3247a75e9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:08:13,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testEmptyExportFileSystemState/bbf2ee2b0d325ea8cc5db8a3247a75e9 2023-07-23 05:08:13,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testEmptyExportFileSystemState/d0af2a5cacfde8d9ed963bc319ce7910 2023-07-23 05:08:13,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testEmptyExportFileSystemState/bbf2ee2b0d325ea8cc5db8a3247a75e9 2023-07-23 05:08:13,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d0af2a5cacfde8d9ed963bc319ce7910 2023-07-23 05:08:13,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bbf2ee2b0d325ea8cc5db8a3247a75e9 2023-07-23 05:08:13,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testEmptyExportFileSystemState/d0af2a5cacfde8d9ed963bc319ce7910/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 05:08:13,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testEmptyExportFileSystemState/bbf2ee2b0d325ea8cc5db8a3247a75e9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 05:08:13,441 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d0af2a5cacfde8d9ed963bc319ce7910; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70357821, jitterRate=0.0484132319688797}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 05:08:13,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d0af2a5cacfde8d9ed963bc319ce7910: 2023-07-23 05:08:13,441 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bbf2ee2b0d325ea8cc5db8a3247a75e9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65541162, jitterRate=-0.02336058020591736}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 05:08:13,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bbf2ee2b0d325ea8cc5db8a3247a75e9: 2023-07-23 05:08:13,442 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1690088893001.d0af2a5cacfde8d9ed963bc319ce7910., pid=94, masterSystemTime=1690088893414 2023-07-23 05:08:13,442 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1690088893001.bbf2ee2b0d325ea8cc5db8a3247a75e9., pid=93, masterSystemTime=1690088893414 2023-07-23 05:08:13,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1690088893001.d0af2a5cacfde8d9ed963bc319ce7910. 2023-07-23 05:08:13,444 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1690088893001.d0af2a5cacfde8d9ed963bc319ce7910. 2023-07-23 05:08:13,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1690088893001.bbf2ee2b0d325ea8cc5db8a3247a75e9. 2023-07-23 05:08:13,445 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1690088893001.bbf2ee2b0d325ea8cc5db8a3247a75e9. 2023-07-23 05:08:13,445 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=d0af2a5cacfde8d9ed963bc319ce7910, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:13,445 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=bbf2ee2b0d325ea8cc5db8a3247a75e9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:13,445 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1690088893001.d0af2a5cacfde8d9ed963bc319ce7910.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690088893445"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690088893445"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690088893445"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690088893445"}]},"ts":"1690088893445"} 2023-07-23 05:08:13,445 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1690088893001.bbf2ee2b0d325ea8cc5db8a3247a75e9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690088893445"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690088893445"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690088893445"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690088893445"}]},"ts":"1690088893445"} 2023-07-23 05:08:13,450 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-23 05:08:13,450 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure d0af2a5cacfde8d9ed963bc319ce7910, server=jenkins-hbase4.apache.org,37855,1690088792757 in 187 msec 2023-07-23 05:08:13,452 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-23 05:08:13,452 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure bbf2ee2b0d325ea8cc5db8a3247a75e9, server=jenkins-hbase4.apache.org,44949,1690088792720 in 189 msec 2023-07-23 05:08:13,452 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d0af2a5cacfde8d9ed963bc319ce7910, ASSIGN in 353 msec 2023-07-23 05:08:13,454 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-23 05:08:13,454 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=bbf2ee2b0d325ea8cc5db8a3247a75e9, ASSIGN in 355 msec 2023-07-23 05:08:13,454 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 05:08:13,454 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088893454"}]},"ts":"1690088893454"} 2023-07-23 05:08:13,456 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-23 05:08:13,459 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 05:08:13,459 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-23 05:08:13,461 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45437] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-23 05:08:13,463 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:13,463 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:13,463 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:13,463 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:13,464 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 05:08:13,464 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 05:08:13,465 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 05:08:13,465 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 05:08:13,466 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 463 msec 2023-07-23 05:08:13,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-23 05:08:13,616 INFO [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-23 05:08:13,618 DEBUG [Listener at jenkins-hbase4.apache.org/33827] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-23 05:08:13,618 DEBUG [Listener at jenkins-hbase4.apache.org/33827] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1690088893001.bbf2ee2b0d325ea8cc5db8a3247a75e9. 2023-07-23 05:08:13,620 INFO [Listener at jenkins-hbase4.apache.org/33827] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 05:08:13,646 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 05:08:13,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690088893646 (current time:1690088893646). 2023-07-23 05:08:13,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 05:08:13,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] zookeeper.ReadOnlyZKClient(139): Connect 0x1fc5e43a to 127.0.0.1:57388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:08:13,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17c8701d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:08:13,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:08:13,662 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37370, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:08:13,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1fc5e43a to 127.0.0.1:57388 2023-07-23 05:08:13,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:08:13,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] zookeeper.ReadOnlyZKClient(139): Connect 0x4cfa8e55 to 127.0.0.1:57388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:08:13,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7cae47c4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:08:13,679 DEBUG [hconnection-0x28b298d4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:08:13,682 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37384, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:08:13,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:08:13,695 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60366, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:08:13,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4cfa8e55 to 127.0.0.1:57388 2023-07-23 05:08:13,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:08:13,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-23 05:08:13,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 05:08:13,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 05:08:13,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-23 05:08:13,722 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-23 05:08:13,723 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690089493723 2023-07-23 05:08:13,723 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-23 05:08:13,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 05:08:13,725 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 05:08:13,725 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 05:08:13,727 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-23 05:08:13,728 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-23 05:08:13,729 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 15 msec 2023-07-23 05:08:13,733 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-23 05:08:13,734 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690089493734 2023-07-23 05:08:13,755 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:13,755 INFO [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-23 05:08:13,755 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:08:13,757 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-23 05:08:13,757 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-23 05:08:13,757 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:13,757 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:13,762 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:13,762 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:13,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:13,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:13,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:13,762 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:13,762 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:13,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:13,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:13,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:13,763 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:13,763 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:13,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:13,763 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:13,763 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 05:08:13,763 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:13,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-23 05:08:13,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:13,764 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-23 05:08:13,764 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:13,764 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-23 05:08:13,765 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:08:13,766 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-23 05:08:13,766 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-23 05:08:13,766 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44949,1690088792720' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-23 05:08:13,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:13,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:13,776 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:13,776 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:13,776 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:13,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-23 05:08:13,777 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:13,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-23 05:08:13,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:13,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:08:13,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:08:13,777 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:13,777 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:08:13,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:08:13,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:08:13,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:13,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:13,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:13,780 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-23 05:08:13,780 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-23 05:08:13,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:13,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:08:13,783 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44949,1690088792720' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-23 05:08:13,783 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74fa2323[Count = 1] remaining members to acquire global barrier 2023-07-23 05:08:13,784 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:13,784 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-23 05:08:13,785 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:08:13,790 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:13,792 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-23 05:08:13,792 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-23 05:08:13,793 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:08:13,792 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-23 05:08:13,794 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-23 05:08:13,794 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-23 05:08:13,794 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45437,1690088792660' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-23 05:08:13,794 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37855,1690088792757' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-23 05:08:13,796 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:13,796 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:13,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:13,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:08:13,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:08:13,797 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:13,797 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:08:13,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:08:13,797 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:13,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:08:13,797 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:13,798 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:08:13,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:13,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:13,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:13,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:13,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:08:13,810 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37855,1690088792757' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-23 05:08:13,810 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74fa2323[Count = 0] remaining members to acquire global barrier 2023-07-23 05:08:13,810 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-23 05:08:13,810 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:13,813 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:13,813 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:13,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:13,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:13,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:13,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:13,813 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-23 05:08:13,813 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-23 05:08:13,813 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-23 05:08:13,813 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45437,1690088792660' in zk 2023-07-23 05:08:13,814 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:13,814 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:13,814 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 05:08:13,815 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:08:13,815 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:08:13,815 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-23 05:08:13,815 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:08:13,815 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-23 05:08:13,815 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690088893001.d0af2a5cacfde8d9ed963bc319ce7910. 2023-07-23 05:08:13,817 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:13,817 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690088893001.d0af2a5cacfde8d9ed963bc319ce7910. started... 2023-07-23 05:08:13,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:13,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:13,817 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-23 05:08:13,819 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d0af2a5cacfde8d9ed963bc319ce7910: 2023-07-23 05:08:13,819 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690088893001.d0af2a5cacfde8d9ed963bc319ce7910.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:13,819 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:08:13,819 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:08:13,819 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:08:13,819 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690088893001.bbf2ee2b0d325ea8cc5db8a3247a75e9. 2023-07-23 05:08:13,819 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 05:08:13,819 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690088893001.bbf2ee2b0d325ea8cc5db8a3247a75e9. started... 2023-07-23 05:08:13,819 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bbf2ee2b0d325ea8cc5db8a3247a75e9: 2023-07-23 05:08:13,819 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690088893001.bbf2ee2b0d325ea8cc5db8a3247a75e9.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:13,819 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:08:13,820 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 05:08:13,826 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:08:13,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 05:08:13,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:08:13,827 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 05:08:13,911 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690088893001.bbf2ee2b0d325ea8cc5db8a3247a75e9. completed. 2023-07-23 05:08:13,911 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690088893001.bbf2ee2b0d325ea8cc5db8a3247a75e9. 2023-07-23 05:08:13,911 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:08:13,911 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:08:13,911 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:13,911 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-23 05:08:13,911 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44949,1690088792720' in zk 2023-07-23 05:08:13,913 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:13,913 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-23 05:08:13,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:13,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:08:13,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:08:13,913 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:08:13,913 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-23 05:08:13,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:08:13,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:08:13,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:13,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:13,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:13,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:13,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:08:13,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:13,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:13,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:13,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,44949,1690088792720': 2023-07-23 05:08:13,920 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44949,1690088792720' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-23 05:08:14,027 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:08:14,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 05:08:14,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:08:14,029 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 05:08:14,313 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690088893001.d0af2a5cacfde8d9ed963bc319ce7910. completed. 2023-07-23 05:08:14,313 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690088893001.d0af2a5cacfde8d9ed963bc319ce7910. 2023-07-23 05:08:14,313 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:08:14,313 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:08:14,313 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:14,314 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-23 05:08:14,314 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37855,1690088792757' in zk 2023-07-23 05:08:14,315 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:14,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:14,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:08:14,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:08:14,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:08:14,316 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-23 05:08:14,316 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:08:14,316 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-23 05:08:14,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:08:14,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:14,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:14,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:14,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:14,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:08:14,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:14,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:14,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:14,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:14,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37855,1690088792757': 2023-07-23 05:08:14,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37855,1690088792757' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-23 05:08:14,323 INFO [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-23 05:08:14,323 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 05:08:14,323 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 05:08:14,323 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:14,323 INFO [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 05:08:14,326 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:14,326 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:14,326 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:14,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:14,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:14,326 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:14,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:14,327 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:14,326 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:14,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:14,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:14,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:14,327 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:14,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:14,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:08:14,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:14,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:14,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:08:14,327 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:14,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:14,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:14,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:14,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:14,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:14,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:14,328 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:14,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:08:14,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:14,329 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:14,329 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:08:14,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:14,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:08:14,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 05:08:14,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:14,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:08:14,331 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-23 05:08:14,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:14,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:14,332 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:14,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:14,332 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:14,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:08:14,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:14,333 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:14,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:14,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:14,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:14,338 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:14,338 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:14,338 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:14,338 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:14,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:14,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:14,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:14,338 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:14,338 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:14,339 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:14,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:14,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:14,338 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:14,339 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-23 05:08:14,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:14,339 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:08:14,339 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:14,339 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:14,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:14,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:14,341 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:14,341 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 05:08:14,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:14,341 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:14,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:14,341 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:14,341 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:14,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:14,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:14,341 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:14,341 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:14,341 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:14,341 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:14,341 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:14,342 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-23 05:08:14,355 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:14,356 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:14,379 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:14,450 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-23 05:08:14,450 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:14,451 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:14,451 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690088893723Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1690088894355 (+632 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690088894355Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1690088894355Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1690088894360 (+5 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690088894369 (+9 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690088894450 (+81 ms) 2023-07-23 05:08:14,454 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-23 05:08:14,464 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 729 msec 2023-07-23 05:08:14,831 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:08:14,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 05:08:14,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 05:08:14,835 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44949] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1690088893001.bbf2ee2b0d325ea8cc5db8a3247a75e9. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 05:08:14,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37855] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1690088893001.d0af2a5cacfde8d9ed963bc319ce7910. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 05:08:14,840 DEBUG [Listener at jenkins-hbase4.apache.org/33827] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-23 05:08:14,841 DEBUG [Listener at jenkins-hbase4.apache.org/33827] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1690088893001.bbf2ee2b0d325ea8cc5db8a3247a75e9. 2023-07-23 05:08:14,841 INFO [Listener at jenkins-hbase4.apache.org/33827] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 05:08:14,854 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 05:08:14,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690088894854 (current time:1690088894854). 2023-07-23 05:08:14,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 05:08:14,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] zookeeper.ReadOnlyZKClient(139): Connect 0x72e5f0f2 to 127.0.0.1:57388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:08:14,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e2db242, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:08:14,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:08:14,866 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37388, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:08:14,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x72e5f0f2 to 127.0.0.1:57388 2023-07-23 05:08:14,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:08:14,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] zookeeper.ReadOnlyZKClient(139): Connect 0x5337e04e to 127.0.0.1:57388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:08:14,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e08e8ba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:08:14,981 DEBUG [hconnection-0x2d14f49b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:08:14,982 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37400, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:08:14,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:08:14,989 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60372, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:08:14,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5337e04e to 127.0.0.1:57388 2023-07-23 05:08:14,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:08:14,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-23 05:08:14,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 05:08:14,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 05:08:14,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-23 05:08:14,995 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-23 05:08:14,996 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690089494996 2023-07-23 05:08:14,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 05:08:14,997 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-23 05:08:14,999 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-23 05:08:15,005 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-23 05:08:15,006 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 05:08:15,006 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 05:08:15,007 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 12 msec 2023-07-23 05:08:15,008 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-23 05:08:15,009 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690089495009 2023-07-23 05:08:15,032 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,032 INFO [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-23 05:08:15,032 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:08:15,034 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-23 05:08:15,034 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-23 05:08:15,035 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,035 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,036 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:15,036 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:15,036 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:15,036 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:15,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:15,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:15,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:15,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:15,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:15,036 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:15,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:15,036 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:15,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,037 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:15,037 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 05:08:15,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,037 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,037 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,037 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-23 05:08:15,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-23 05:08:15,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,037 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-23 05:08:15,038 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-23 05:08:15,038 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,038 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-23 05:08:15,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-23 05:08:15,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,038 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:08:15,038 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-23 05:08:15,038 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,038 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-23 05:08:15,040 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:08:15,040 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-23 05:08:15,041 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-23 05:08:15,038 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,041 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44949,1690088792720' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-23 05:08:15,041 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-23 05:08:15,041 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:08:15,041 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-23 05:08:15,042 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-23 05:08:15,042 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37855,1690088792757' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-23 05:08:15,046 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-23 05:08:15,046 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-23 05:08:15,046 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45437,1690088792660' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-23 05:08:15,047 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:15,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:15,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:08:15,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:08:15,047 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,049 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,049 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:08:15,049 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:08:15,049 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:15,049 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,049 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,049 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:08:15,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:08:15,049 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,049 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:08:15,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:15,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:15,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:15,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:08:15,052 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44949,1690088792720' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-23 05:08:15,052 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@72f9350c[Count = 1] remaining members to acquire global barrier 2023-07-23 05:08:15,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:15,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:08:15,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:08:15,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:08:15,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:08:15,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:15,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:15,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:15,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:08:15,056 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37855,1690088792757' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-23 05:08:15,056 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@72f9350c[Count = 0] remaining members to acquire global barrier 2023-07-23 05:08:15,056 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-23 05:08:15,057 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,061 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,061 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,062 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-23 05:08:15,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,062 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:08:15,062 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-23 05:08:15,062 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:08:15,062 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690088893001.d0af2a5cacfde8d9ed963bc319ce7910. 2023-07-23 05:08:15,062 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690088893001.d0af2a5cacfde8d9ed963bc319ce7910. started... 2023-07-23 05:08:15,062 INFO [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d0af2a5cacfde8d9ed963bc319ce7910 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-23 05:08:15,063 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,064 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-23 05:08:15,064 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-23 05:08:15,064 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45437,1690088792660' in zk 2023-07-23 05:08:15,064 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:15,064 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:15,065 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 05:08:15,067 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-23 05:08:15,067 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:08:15,067 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-23 05:08:15,069 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:08:15,069 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:08:15,069 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690088893001.bbf2ee2b0d325ea8cc5db8a3247a75e9. 2023-07-23 05:08:15,069 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690088893001.bbf2ee2b0d325ea8cc5db8a3247a75e9. started... 2023-07-23 05:08:15,070 INFO [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] regionserver.HRegion(2745): Flushing bbf2ee2b0d325ea8cc5db8a3247a75e9 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-23 05:08:15,128 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:08:15,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 05:08:15,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:08:15,129 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 05:08:15,139 INFO [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230723264fb77e53d44cfaa00cadac0a055509 to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230723264fb77e53d44cfaa00cadac0a055509 2023-07-23 05:08:15,155 INFO [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230723c512c84e70284d7ebc41d601fbf072b5 to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230723c512c84e70284d7ebc41d601fbf072b5 2023-07-23 05:08:15,159 INFO [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testEmptyExportFileSystemState/d0af2a5cacfde8d9ed963bc319ce7910/.tmp/cf/057492096bb84117908cf8834de8677b 2023-07-23 05:08:15,168 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testEmptyExportFileSystemState/d0af2a5cacfde8d9ed963bc319ce7910/.tmp/cf/057492096bb84117908cf8834de8677b as hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testEmptyExportFileSystemState/d0af2a5cacfde8d9ed963bc319ce7910/cf/057492096bb84117908cf8834de8677b 2023-07-23 05:08:15,168 INFO [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testEmptyExportFileSystemState/bbf2ee2b0d325ea8cc5db8a3247a75e9/.tmp/cf/46d7c368ce844321b4f43cdd4bb361bf 2023-07-23 05:08:15,173 INFO [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testEmptyExportFileSystemState/d0af2a5cacfde8d9ed963bc319ce7910/cf/057492096bb84117908cf8834de8677b, entries=48, sequenceid=6, filesize=13.2 K 2023-07-23 05:08:15,175 INFO [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for d0af2a5cacfde8d9ed963bc319ce7910 in 113ms, sequenceid=6, compaction requested=false 2023-07-23 05:08:15,175 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-23 05:08:15,176 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d0af2a5cacfde8d9ed963bc319ce7910: 2023-07-23 05:08:15,176 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690088893001.d0af2a5cacfde8d9ed963bc319ce7910.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,176 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:08:15,176 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testEmptyExportFileSystemState/d0af2a5cacfde8d9ed963bc319ce7910/cf/057492096bb84117908cf8834de8677b] hfiles 2023-07-23 05:08:15,176 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testEmptyExportFileSystemState/d0af2a5cacfde8d9ed963bc319ce7910/cf/057492096bb84117908cf8834de8677b for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,186 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testEmptyExportFileSystemState/bbf2ee2b0d325ea8cc5db8a3247a75e9/.tmp/cf/46d7c368ce844321b4f43cdd4bb361bf as hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testEmptyExportFileSystemState/bbf2ee2b0d325ea8cc5db8a3247a75e9/cf/46d7c368ce844321b4f43cdd4bb361bf 2023-07-23 05:08:15,193 INFO [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testEmptyExportFileSystemState/bbf2ee2b0d325ea8cc5db8a3247a75e9/cf/46d7c368ce844321b4f43cdd4bb361bf, entries=2, sequenceid=6, filesize=5.2 K 2023-07-23 05:08:15,194 INFO [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for bbf2ee2b0d325ea8cc5db8a3247a75e9 in 124ms, sequenceid=6, compaction requested=false 2023-07-23 05:08:15,196 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bbf2ee2b0d325ea8cc5db8a3247a75e9: 2023-07-23 05:08:15,196 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690088893001.bbf2ee2b0d325ea8cc5db8a3247a75e9.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,196 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:08:15,196 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testEmptyExportFileSystemState/bbf2ee2b0d325ea8cc5db8a3247a75e9/cf/46d7c368ce844321b4f43cdd4bb361bf] hfiles 2023-07-23 05:08:15,197 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testEmptyExportFileSystemState/bbf2ee2b0d325ea8cc5db8a3247a75e9/cf/46d7c368ce844321b4f43cdd4bb361bf for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,200 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690088893001.d0af2a5cacfde8d9ed963bc319ce7910. completed. 2023-07-23 05:08:15,200 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690088893001.d0af2a5cacfde8d9ed963bc319ce7910. 2023-07-23 05:08:15,200 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:08:15,200 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:08:15,200 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:15,200 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-23 05:08:15,200 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37855,1690088792757' in zk 2023-07-23 05:08:15,202 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-23 05:08:15,202 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:15,202 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:08:15,202 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-23 05:08:15,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:15,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:08:15,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:08:15,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:08:15,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:08:15,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:15,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:15,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:15,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:08:15,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:15,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:15,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37855,1690088792757': 2023-07-23 05:08:15,209 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37855,1690088792757' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-23 05:08:15,220 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690088893001.bbf2ee2b0d325ea8cc5db8a3247a75e9. completed. 2023-07-23 05:08:15,220 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690088893001.bbf2ee2b0d325ea8cc5db8a3247a75e9. 2023-07-23 05:08:15,221 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:08:15,221 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:08:15,221 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:15,221 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-23 05:08:15,221 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44949,1690088792720' in zk 2023-07-23 05:08:15,223 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-23 05:08:15,223 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:08:15,223 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:15,223 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-23 05:08:15,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:15,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:08:15,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:08:15,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:08:15,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:08:15,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:15,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:15,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:15,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:08:15,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:15,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:15,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:15,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,44949,1690088792720': 2023-07-23 05:08:15,232 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44949,1690088792720' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-23 05:08:15,232 INFO [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-23 05:08:15,232 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 05:08:15,233 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 05:08:15,233 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,233 INFO [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 05:08:15,235 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,235 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:15,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,235 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,235 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,235 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:15,235 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:15,235 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:08:15,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:08:15,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:08:15,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:15,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:15,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:15,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:15,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:15,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:15,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,237 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:15,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:08:15,238 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:15,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,239 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:15,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:15,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:15,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:15,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:08:15,242 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:15,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,243 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:15,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:15,243 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:15,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:15,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:15,246 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:15,247 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:15,247 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:15,247 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:15,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:15,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:15,247 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:15,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:15,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:15,247 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:15,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:15,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:15,247 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:15,247 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,247 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:15,247 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:15,247 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:08:15,247 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,247 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:15,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:15,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:15,249 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:15,247 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-23 05:08:15,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:15,249 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,249 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:15,249 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:15,249 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:15,250 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,250 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,249 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 05:08:15,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:15,251 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230723264fb77e53d44cfaa00cadac0a055509, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230723c512c84e70284d7ebc41d601fbf072b5] mob files 2023-07-23 05:08:15,251 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230723264fb77e53d44cfaa00cadac0a055509 2023-07-23 05:08:15,251 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230723c512c84e70284d7ebc41d601fbf072b5 2023-07-23 05:08:15,267 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,268 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,325 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,330 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:08:15,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 05:08:15,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:08:15,332 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 05:08:15,385 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-23 05:08:15,385 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,386 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,386 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690088894997Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1690088895267 (+270 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1690088895267Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1690088895267Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1690088895274 (+7 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1690088895314 (+40 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690088895385 (+71 ms) 2023-07-23 05:08:15,388 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-23 05:08:15,390 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 391 msec 2023-07-23 05:08:15,632 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:08:15,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 05:08:15,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 05:08:15,634 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088895634 2023-07-23 05:08:15,634 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38911, tgtDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088895634, rawTgtDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088895634, srcFsUri=hdfs://localhost:38911, srcDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd 2023-07-23 05:08:15,661 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38911, inputRoot=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd 2023-07-23 05:08:15,662 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_927507569_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088895634, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088895634/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,662 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38911, inputRoot=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd, snapshotDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-23 05:08:15,668 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088895634/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:15,720 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:15,720 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:15,721 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:15,721 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:15,721 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:15,722 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:15,722 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:15,809 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/hadoop-2636266246143356221.jar 2023-07-23 05:08:15,810 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:15,811 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:15,811 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:15,812 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:15,812 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:15,812 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:15,813 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 05:08:15,813 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 05:08:15,813 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 05:08:15,814 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 05:08:15,814 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 05:08:15,815 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 05:08:15,815 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 05:08:15,816 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 05:08:15,816 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 05:08:15,817 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 05:08:15,818 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:08:15,818 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:08:15,819 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 05:08:15,819 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:08:15,819 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:08:15,820 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 05:08:15,820 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 05:08:16,704 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088800324_0005_000001 (auth:SIMPLE) 2023-07-23 05:08:17,638 WARN [Listener at jenkins-hbase4.apache.org/33827] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 05:08:17,640 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-23 05:08:17,798 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 05:08:17,799 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 05:08:17,937 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 05:08:18,708 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088800324_0006_000001 (auth:SIMPLE) 2023-07-23 05:08:24,635 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088800324_0006_000001 (auth:SIMPLE) 2023-07-23 05:08:27,120 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 05:08:27,121 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 05:08:27,128 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:27,128 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 05:08:27,129 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 05:08:27,129 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-154173811_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:27,130 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(367): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-23 05:08:27,130 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(367): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-23 05:08:27,130 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-154173811_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088895634/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088895634/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:27,130 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(367): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088895634/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-23 05:08:27,131 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(367): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088895634/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-23 05:08:27,136 INFO [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-23 05:08:27,136 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-23 05:08:27,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 05:08:27,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-23 05:08:27,141 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088907141"}]},"ts":"1690088907141"} 2023-07-23 05:08:27,142 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-23 05:08:27,144 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-23 05:08:27,145 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=bbf2ee2b0d325ea8cc5db8a3247a75e9, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d0af2a5cacfde8d9ed963bc319ce7910, UNASSIGN}] 2023-07-23 05:08:27,150 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=bbf2ee2b0d325ea8cc5db8a3247a75e9, UNASSIGN 2023-07-23 05:08:27,150 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d0af2a5cacfde8d9ed963bc319ce7910, UNASSIGN 2023-07-23 05:08:27,151 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=d0af2a5cacfde8d9ed963bc319ce7910, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:27,151 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=bbf2ee2b0d325ea8cc5db8a3247a75e9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:27,151 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690088893001.d0af2a5cacfde8d9ed963bc319ce7910.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690088907151"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088907151"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088907151"}]},"ts":"1690088907151"} 2023-07-23 05:08:27,151 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690088893001.bbf2ee2b0d325ea8cc5db8a3247a75e9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690088907151"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088907151"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088907151"}]},"ts":"1690088907151"} 2023-07-23 05:08:27,153 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure d0af2a5cacfde8d9ed963bc319ce7910, server=jenkins-hbase4.apache.org,37855,1690088792757}] 2023-07-23 05:08:27,156 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure bbf2ee2b0d325ea8cc5db8a3247a75e9, server=jenkins-hbase4.apache.org,44949,1690088792720}] 2023-07-23 05:08:27,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-23 05:08:27,308 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d0af2a5cacfde8d9ed963bc319ce7910 2023-07-23 05:08:27,308 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close bbf2ee2b0d325ea8cc5db8a3247a75e9 2023-07-23 05:08:27,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d0af2a5cacfde8d9ed963bc319ce7910, disabling compactions & flushes 2023-07-23 05:08:27,308 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690088893001.d0af2a5cacfde8d9ed963bc319ce7910. 2023-07-23 05:08:27,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bbf2ee2b0d325ea8cc5db8a3247a75e9, disabling compactions & flushes 2023-07-23 05:08:27,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690088893001.d0af2a5cacfde8d9ed963bc319ce7910. 2023-07-23 05:08:27,308 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690088893001.bbf2ee2b0d325ea8cc5db8a3247a75e9. 2023-07-23 05:08:27,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690088893001.bbf2ee2b0d325ea8cc5db8a3247a75e9. 2023-07-23 05:08:27,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690088893001.bbf2ee2b0d325ea8cc5db8a3247a75e9. after waiting 0 ms 2023-07-23 05:08:27,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690088893001.d0af2a5cacfde8d9ed963bc319ce7910. after waiting 0 ms 2023-07-23 05:08:27,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690088893001.bbf2ee2b0d325ea8cc5db8a3247a75e9. 2023-07-23 05:08:27,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690088893001.d0af2a5cacfde8d9ed963bc319ce7910. 2023-07-23 05:08:27,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testEmptyExportFileSystemState/d0af2a5cacfde8d9ed963bc319ce7910/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 05:08:27,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:08:27,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testEmptyExportFileSystemState/bbf2ee2b0d325ea8cc5db8a3247a75e9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 05:08:27,325 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690088893001.d0af2a5cacfde8d9ed963bc319ce7910. 2023-07-23 05:08:27,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d0af2a5cacfde8d9ed963bc319ce7910: 2023-07-23 05:08:27,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:08:27,327 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690088893001.bbf2ee2b0d325ea8cc5db8a3247a75e9. 2023-07-23 05:08:27,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bbf2ee2b0d325ea8cc5db8a3247a75e9: 2023-07-23 05:08:27,328 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d0af2a5cacfde8d9ed963bc319ce7910 2023-07-23 05:08:27,330 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=d0af2a5cacfde8d9ed963bc319ce7910, regionState=CLOSED 2023-07-23 05:08:27,330 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690088893001.d0af2a5cacfde8d9ed963bc319ce7910.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690088907330"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088907330"}]},"ts":"1690088907330"} 2023-07-23 05:08:27,330 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed bbf2ee2b0d325ea8cc5db8a3247a75e9 2023-07-23 05:08:27,331 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=bbf2ee2b0d325ea8cc5db8a3247a75e9, regionState=CLOSED 2023-07-23 05:08:27,331 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690088893001.bbf2ee2b0d325ea8cc5db8a3247a75e9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690088907331"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088907331"}]},"ts":"1690088907331"} 2023-07-23 05:08:27,344 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-23 05:08:27,344 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure d0af2a5cacfde8d9ed963bc319ce7910, server=jenkins-hbase4.apache.org,37855,1690088792757 in 189 msec 2023-07-23 05:08:27,345 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-23 05:08:27,345 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure bbf2ee2b0d325ea8cc5db8a3247a75e9, server=jenkins-hbase4.apache.org,44949,1690088792720 in 189 msec 2023-07-23 05:08:27,351 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=d0af2a5cacfde8d9ed963bc319ce7910, UNASSIGN in 199 msec 2023-07-23 05:08:27,351 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-23 05:08:27,351 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=bbf2ee2b0d325ea8cc5db8a3247a75e9, UNASSIGN in 200 msec 2023-07-23 05:08:27,352 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088907352"}]},"ts":"1690088907352"} 2023-07-23 05:08:27,355 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-23 05:08:27,357 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-23 05:08:27,359 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 222 msec 2023-07-23 05:08:27,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-23 05:08:27,443 INFO [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-23 05:08:27,445 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-23 05:08:27,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 05:08:27,448 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 05:08:27,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-23 05:08:27,449 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 05:08:27,451 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45437] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-23 05:08:27,454 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testEmptyExportFileSystemState/d0af2a5cacfde8d9ed963bc319ce7910 2023-07-23 05:08:27,454 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testEmptyExportFileSystemState/bbf2ee2b0d325ea8cc5db8a3247a75e9 2023-07-23 05:08:27,454 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 05:08:27,454 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 05:08:27,454 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 05:08:27,455 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-23 05:08:27,456 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 05:08:27,456 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:27,456 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:27,456 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-23 05:08:27,456 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-23 05:08:27,457 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testEmptyExportFileSystemState/d0af2a5cacfde8d9ed963bc319ce7910/cf, FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testEmptyExportFileSystemState/d0af2a5cacfde8d9ed963bc319ce7910/recovered.edits] 2023-07-23 05:08:27,457 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:27,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-23 05:08:27,459 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testEmptyExportFileSystemState/bbf2ee2b0d325ea8cc5db8a3247a75e9/cf, FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testEmptyExportFileSystemState/bbf2ee2b0d325ea8cc5db8a3247a75e9/recovered.edits] 2023-07-23 05:08:27,460 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 05:08:27,460 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:27,460 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-23 05:08:27,460 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-23 05:08:27,461 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-23 05:08:27,461 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-23 05:08:27,464 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testEmptyExportFileSystemState/d0af2a5cacfde8d9ed963bc319ce7910/cf/057492096bb84117908cf8834de8677b to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testEmptyExportFileSystemState/d0af2a5cacfde8d9ed963bc319ce7910/cf/057492096bb84117908cf8834de8677b 2023-07-23 05:08:27,465 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testEmptyExportFileSystemState/bbf2ee2b0d325ea8cc5db8a3247a75e9/cf/46d7c368ce844321b4f43cdd4bb361bf to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testEmptyExportFileSystemState/bbf2ee2b0d325ea8cc5db8a3247a75e9/cf/46d7c368ce844321b4f43cdd4bb361bf 2023-07-23 05:08:27,468 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testEmptyExportFileSystemState/d0af2a5cacfde8d9ed963bc319ce7910/recovered.edits/9.seqid to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testEmptyExportFileSystemState/d0af2a5cacfde8d9ed963bc319ce7910/recovered.edits/9.seqid 2023-07-23 05:08:27,469 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testEmptyExportFileSystemState/d0af2a5cacfde8d9ed963bc319ce7910 2023-07-23 05:08:27,470 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testEmptyExportFileSystemState/bbf2ee2b0d325ea8cc5db8a3247a75e9/recovered.edits/9.seqid to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testEmptyExportFileSystemState/bbf2ee2b0d325ea8cc5db8a3247a75e9/recovered.edits/9.seqid 2023-07-23 05:08:27,470 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testEmptyExportFileSystemState/bbf2ee2b0d325ea8cc5db8a3247a75e9 2023-07-23 05:08:27,470 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-23 05:08:27,471 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-23 05:08:27,471 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-23 05:08:27,475 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230723264fb77e53d44cfaa00cadac0a055509 to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230723264fb77e53d44cfaa00cadac0a055509 2023-07-23 05:08:27,476 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230723c512c84e70284d7ebc41d601fbf072b5 to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230723c512c84e70284d7ebc41d601fbf072b5 2023-07-23 05:08:27,477 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-23 05:08:27,479 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 05:08:27,488 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-23 05:08:27,491 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-23 05:08:27,492 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 05:08:27,492 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-23 05:08:27,492 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1690088893001.bbf2ee2b0d325ea8cc5db8a3247a75e9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690088907492"}]},"ts":"9223372036854775807"} 2023-07-23 05:08:27,492 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1690088893001.d0af2a5cacfde8d9ed963bc319ce7910.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690088907492"}]},"ts":"9223372036854775807"} 2023-07-23 05:08:27,494 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-23 05:08:27,494 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => bbf2ee2b0d325ea8cc5db8a3247a75e9, NAME => 'testtb-testEmptyExportFileSystemState,,1690088893001.bbf2ee2b0d325ea8cc5db8a3247a75e9.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => d0af2a5cacfde8d9ed963bc319ce7910, NAME => 'testtb-testEmptyExportFileSystemState,1,1690088893001.d0af2a5cacfde8d9ed963bc319ce7910.', STARTKEY => '1', ENDKEY => ''}] 2023-07-23 05:08:27,494 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-23 05:08:27,494 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690088907494"}]},"ts":"9223372036854775807"} 2023-07-23 05:08:27,496 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-23 05:08:27,498 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 05:08:27,499 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 53 msec 2023-07-23 05:08:27,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-23 05:08:27,559 INFO [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-23 05:08:27,567 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-23 05:08:27,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:27,570 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-23 05:08:27,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-23 05:08:27,606 INFO [Listener at jenkins-hbase4.apache.org/33827] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=760 (was 758) Potentially hanging thread: hconnection-0x76a1f2b0-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (583231684) connection to jenkins-hbase4.apache.org/172.31.14.131:44837 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1417000490_1 at /127.0.0.1:49162 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x76a1f2b0-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4792 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-154173811_17 at /127.0.0.1:60200 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (583231684) connection to jenkins-hbase4.apache.org/172.31.14.131:34107 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (583231684) connection to jenkins-hbase4.apache.org/172.31.14.131:37133 from appattempt_1690088800324_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x76a1f2b0-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1417000490_1 at /127.0.0.1:55702 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x76a1f2b0-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-154173811_17 at /127.0.0.1:49172 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=924 (was 905) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=615 (was 583) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 181), AvailableMemoryMB=4911 (was 5567) 2023-07-23 05:08:27,607 WARN [Listener at jenkins-hbase4.apache.org/33827] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-23 05:08:27,635 INFO [Listener at jenkins-hbase4.apache.org/33827] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=760, OpenFileDescriptor=924, MaxFileDescriptor=60000, SystemLoadAverage=615, ProcessCount=181, AvailableMemoryMB=4910 2023-07-23 05:08:27,635 WARN [Listener at jenkins-hbase4.apache.org/33827] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-23 05:08:27,637 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-23 05:08:27,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:27,641 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 05:08:27,642 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-23 05:08:27,642 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 05:08:27,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-23 05:08:27,645 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c18424f320d916b35a3195fc83fa4924 2023-07-23 05:08:27,645 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/43ceed078730e1f8d5444075da555c0d 2023-07-23 05:08:27,646 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c18424f320d916b35a3195fc83fa4924 empty. 2023-07-23 05:08:27,646 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/43ceed078730e1f8d5444075da555c0d empty. 2023-07-23 05:08:27,647 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c18424f320d916b35a3195fc83fa4924 2023-07-23 05:08:27,647 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/43ceed078730e1f8d5444075da555c0d 2023-07-23 05:08:27,647 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-23 05:08:27,675 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-23 05:08:27,677 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 43ceed078730e1f8d5444075da555c0d, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690088907636.43ceed078730e1f8d5444075da555c0d.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp 2023-07-23 05:08:27,677 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => c18424f320d916b35a3195fc83fa4924, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690088907636.c18424f320d916b35a3195fc83fa4924.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp 2023-07-23 05:08:27,692 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690088907636.c18424f320d916b35a3195fc83fa4924.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:08:27,692 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing c18424f320d916b35a3195fc83fa4924, disabling compactions & flushes 2023-07-23 05:08:27,692 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690088907636.c18424f320d916b35a3195fc83fa4924. 2023-07-23 05:08:27,692 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690088907636.c18424f320d916b35a3195fc83fa4924. 2023-07-23 05:08:27,692 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690088907636.c18424f320d916b35a3195fc83fa4924. after waiting 0 ms 2023-07-23 05:08:27,692 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690088907636.c18424f320d916b35a3195fc83fa4924. 2023-07-23 05:08:27,692 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690088907636.c18424f320d916b35a3195fc83fa4924. 2023-07-23 05:08:27,692 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for c18424f320d916b35a3195fc83fa4924: 2023-07-23 05:08:27,695 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690088907636.43ceed078730e1f8d5444075da555c0d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:08:27,695 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 43ceed078730e1f8d5444075da555c0d, disabling compactions & flushes 2023-07-23 05:08:27,695 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690088907636.43ceed078730e1f8d5444075da555c0d. 2023-07-23 05:08:27,695 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690088907636.43ceed078730e1f8d5444075da555c0d. 2023-07-23 05:08:27,696 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690088907636.43ceed078730e1f8d5444075da555c0d. after waiting 0 ms 2023-07-23 05:08:27,696 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690088907636.43ceed078730e1f8d5444075da555c0d. 2023-07-23 05:08:27,696 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690088907636.43ceed078730e1f8d5444075da555c0d. 2023-07-23 05:08:27,696 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 43ceed078730e1f8d5444075da555c0d: 2023-07-23 05:08:27,698 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 05:08:27,699 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690088907636.c18424f320d916b35a3195fc83fa4924.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690088907699"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088907699"}]},"ts":"1690088907699"} 2023-07-23 05:08:27,699 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690088907636.43ceed078730e1f8d5444075da555c0d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690088907699"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088907699"}]},"ts":"1690088907699"} 2023-07-23 05:08:27,702 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 05:08:27,703 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 05:08:27,703 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088907703"}]},"ts":"1690088907703"} 2023-07-23 05:08:27,704 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-23 05:08:27,708 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 05:08:27,710 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 05:08:27,710 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 05:08:27,710 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 05:08:27,710 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 05:08:27,710 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c18424f320d916b35a3195fc83fa4924, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=43ceed078730e1f8d5444075da555c0d, ASSIGN}] 2023-07-23 05:08:27,713 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c18424f320d916b35a3195fc83fa4924, ASSIGN 2023-07-23 05:08:27,713 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=43ceed078730e1f8d5444075da555c0d, ASSIGN 2023-07-23 05:08:27,714 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c18424f320d916b35a3195fc83fa4924, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37855,1690088792757; forceNewPlan=false, retain=false 2023-07-23 05:08:27,714 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=43ceed078730e1f8d5444075da555c0d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44949,1690088792720; forceNewPlan=false, retain=false 2023-07-23 05:08:27,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-23 05:08:27,864 INFO [jenkins-hbase4:32809] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 05:08:27,867 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=43ceed078730e1f8d5444075da555c0d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:27,867 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=c18424f320d916b35a3195fc83fa4924, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:27,867 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690088907636.43ceed078730e1f8d5444075da555c0d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690088907867"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088907867"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088907867"}]},"ts":"1690088907867"} 2023-07-23 05:08:27,867 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690088907636.c18424f320d916b35a3195fc83fa4924.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690088907867"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088907867"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088907867"}]},"ts":"1690088907867"} 2023-07-23 05:08:27,873 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 43ceed078730e1f8d5444075da555c0d, server=jenkins-hbase4.apache.org,44949,1690088792720}] 2023-07-23 05:08:27,874 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure c18424f320d916b35a3195fc83fa4924, server=jenkins-hbase4.apache.org,37855,1690088792757}] 2023-07-23 05:08:27,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-23 05:08:28,028 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1690088907636.c18424f320d916b35a3195fc83fa4924. 2023-07-23 05:08:28,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c18424f320d916b35a3195fc83fa4924, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690088907636.c18424f320d916b35a3195fc83fa4924.', STARTKEY => '', ENDKEY => '1'} 2023-07-23 05:08:28,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1690088907636.c18424f320d916b35a3195fc83fa4924. service=AccessControlService 2023-07-23 05:08:28,029 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:08:28,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp c18424f320d916b35a3195fc83fa4924 2023-07-23 05:08:28,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690088907636.c18424f320d916b35a3195fc83fa4924.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:08:28,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c18424f320d916b35a3195fc83fa4924 2023-07-23 05:08:28,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c18424f320d916b35a3195fc83fa4924 2023-07-23 05:08:28,036 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1690088907636.43ceed078730e1f8d5444075da555c0d. 2023-07-23 05:08:28,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 43ceed078730e1f8d5444075da555c0d, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690088907636.43ceed078730e1f8d5444075da555c0d.', STARTKEY => '1', ENDKEY => ''} 2023-07-23 05:08:28,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1690088907636.43ceed078730e1f8d5444075da555c0d. service=AccessControlService 2023-07-23 05:08:28,036 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 05:08:28,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 43ceed078730e1f8d5444075da555c0d 2023-07-23 05:08:28,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690088907636.43ceed078730e1f8d5444075da555c0d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 05:08:28,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 43ceed078730e1f8d5444075da555c0d 2023-07-23 05:08:28,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 43ceed078730e1f8d5444075da555c0d 2023-07-23 05:08:28,039 INFO [StoreOpener-c18424f320d916b35a3195fc83fa4924-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c18424f320d916b35a3195fc83fa4924 2023-07-23 05:08:28,039 INFO [StoreOpener-43ceed078730e1f8d5444075da555c0d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 43ceed078730e1f8d5444075da555c0d 2023-07-23 05:08:28,040 DEBUG [StoreOpener-c18424f320d916b35a3195fc83fa4924-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithSkipTmp/c18424f320d916b35a3195fc83fa4924/cf 2023-07-23 05:08:28,040 DEBUG [StoreOpener-c18424f320d916b35a3195fc83fa4924-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithSkipTmp/c18424f320d916b35a3195fc83fa4924/cf 2023-07-23 05:08:28,040 DEBUG [StoreOpener-43ceed078730e1f8d5444075da555c0d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithSkipTmp/43ceed078730e1f8d5444075da555c0d/cf 2023-07-23 05:08:28,040 DEBUG [StoreOpener-43ceed078730e1f8d5444075da555c0d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithSkipTmp/43ceed078730e1f8d5444075da555c0d/cf 2023-07-23 05:08:28,041 INFO [StoreOpener-43ceed078730e1f8d5444075da555c0d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 43ceed078730e1f8d5444075da555c0d columnFamilyName cf 2023-07-23 05:08:28,041 INFO [StoreOpener-c18424f320d916b35a3195fc83fa4924-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c18424f320d916b35a3195fc83fa4924 columnFamilyName cf 2023-07-23 05:08:28,042 INFO [StoreOpener-43ceed078730e1f8d5444075da555c0d-1] regionserver.HStore(310): Store=43ceed078730e1f8d5444075da555c0d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:08:28,042 INFO [StoreOpener-c18424f320d916b35a3195fc83fa4924-1] regionserver.HStore(310): Store=c18424f320d916b35a3195fc83fa4924/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 05:08:28,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithSkipTmp/43ceed078730e1f8d5444075da555c0d 2023-07-23 05:08:28,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithSkipTmp/43ceed078730e1f8d5444075da555c0d 2023-07-23 05:08:28,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithSkipTmp/c18424f320d916b35a3195fc83fa4924 2023-07-23 05:08:28,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithSkipTmp/c18424f320d916b35a3195fc83fa4924 2023-07-23 05:08:28,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 43ceed078730e1f8d5444075da555c0d 2023-07-23 05:08:28,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c18424f320d916b35a3195fc83fa4924 2023-07-23 05:08:28,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithSkipTmp/43ceed078730e1f8d5444075da555c0d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 05:08:28,050 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 43ceed078730e1f8d5444075da555c0d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63038430, jitterRate=-0.06065419316291809}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 05:08:28,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 43ceed078730e1f8d5444075da555c0d: 2023-07-23 05:08:28,051 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1690088907636.43ceed078730e1f8d5444075da555c0d., pid=108, masterSystemTime=1690088908025 2023-07-23 05:08:28,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1690088907636.43ceed078730e1f8d5444075da555c0d. 2023-07-23 05:08:28,055 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1690088907636.43ceed078730e1f8d5444075da555c0d. 2023-07-23 05:08:28,056 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=43ceed078730e1f8d5444075da555c0d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:28,057 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690088907636.43ceed078730e1f8d5444075da555c0d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690088908056"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690088908056"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690088908056"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690088908056"}]},"ts":"1690088908056"} 2023-07-23 05:08:28,062 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-23 05:08:28,062 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 43ceed078730e1f8d5444075da555c0d, server=jenkins-hbase4.apache.org,44949,1690088792720 in 186 msec 2023-07-23 05:08:28,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithSkipTmp/c18424f320d916b35a3195fc83fa4924/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 05:08:28,064 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=43ceed078730e1f8d5444075da555c0d, ASSIGN in 352 msec 2023-07-23 05:08:28,065 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c18424f320d916b35a3195fc83fa4924; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73972878, jitterRate=0.10228177905082703}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 05:08:28,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c18424f320d916b35a3195fc83fa4924: 2023-07-23 05:08:28,066 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1690088907636.c18424f320d916b35a3195fc83fa4924., pid=109, masterSystemTime=1690088908025 2023-07-23 05:08:28,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1690088907636.c18424f320d916b35a3195fc83fa4924. 2023-07-23 05:08:28,069 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1690088907636.c18424f320d916b35a3195fc83fa4924. 2023-07-23 05:08:28,069 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=c18424f320d916b35a3195fc83fa4924, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:28,069 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690088907636.c18424f320d916b35a3195fc83fa4924.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690088908069"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690088908069"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690088908069"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690088908069"}]},"ts":"1690088908069"} 2023-07-23 05:08:28,072 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-23 05:08:28,072 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure c18424f320d916b35a3195fc83fa4924, server=jenkins-hbase4.apache.org,37855,1690088792757 in 196 msec 2023-07-23 05:08:28,075 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-23 05:08:28,075 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c18424f320d916b35a3195fc83fa4924, ASSIGN in 362 msec 2023-07-23 05:08:28,076 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 05:08:28,076 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088908076"}]},"ts":"1690088908076"} 2023-07-23 05:08:28,082 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-23 05:08:28,085 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 05:08:28,086 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-23 05:08:28,088 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45437] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-23 05:08:28,089 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:28,089 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:28,089 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:28,089 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:28,091 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-23 05:08:28,091 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-23 05:08:28,091 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-23 05:08:28,092 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-23 05:08:28,094 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 455 msec 2023-07-23 05:08:28,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-23 05:08:28,247 INFO [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-23 05:08:28,249 DEBUG [Listener at jenkins-hbase4.apache.org/33827] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,249 DEBUG [Listener at jenkins-hbase4.apache.org/33827] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1690088907636.c18424f320d916b35a3195fc83fa4924. 2023-07-23 05:08:28,252 INFO [Listener at jenkins-hbase4.apache.org/33827] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 05:08:28,261 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-23 05:08:28,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690088908261 (current time:1690088908261). 2023-07-23 05:08:28,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 05:08:28,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] zookeeper.ReadOnlyZKClient(139): Connect 0x680e9222 to 127.0.0.1:57388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:08:28,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5cd80667, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:08:28,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:08:28,276 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45078, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:08:28,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x680e9222 to 127.0.0.1:57388 2023-07-23 05:08:28,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:08:28,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] zookeeper.ReadOnlyZKClient(139): Connect 0x7ba47434 to 127.0.0.1:57388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:08:28,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@672776e0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:08:28,285 DEBUG [hconnection-0x7bd0bf5d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:08:28,288 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45084, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:08:28,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:08:28,293 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60236, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:08:28,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ba47434 to 127.0.0.1:57388 2023-07-23 05:08:28,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:08:28,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-23 05:08:28,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 05:08:28,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-23 05:08:28,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-23 05:08:28,298 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-23 05:08:28,299 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690089508299 2023-07-23 05:08:28,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-23 05:08:28,299 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,300 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 05:08:28,300 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 05:08:28,301 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-23 05:08:28,301 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-23 05:08:28,302 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-07-23 05:08:28,303 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-23 05:08:28,303 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690089508303 2023-07-23 05:08:28,312 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,312 INFO [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-23 05:08:28,312 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:08:28,313 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-23 05:08:28,313 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-23 05:08:28,314 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,314 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,316 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:28,316 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:28,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:28,316 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:28,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:28,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:28,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:28,316 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:28,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:28,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:28,316 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:28,316 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:28,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,317 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:28,317 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 05:08:28,317 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,320 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,320 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-23 05:08:28,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,320 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-23 05:08:28,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-23 05:08:28,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-23 05:08:28,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,320 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-23 05:08:28,321 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-23 05:08:28,321 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,321 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,321 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-23 05:08:28,321 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,321 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-23 05:08:28,321 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:08:28,321 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:08:28,322 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-23 05:08:28,322 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-23 05:08:28,321 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-23 05:08:28,323 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37855,1690088792757' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-23 05:08:28,323 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-23 05:08:28,323 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-23 05:08:28,323 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45437,1690088792660' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-23 05:08:28,323 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:08:28,324 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-23 05:08:28,324 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-23 05:08:28,324 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44949,1690088792720' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-23 05:08:28,330 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:28,330 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:28,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:08:28,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:08:28,330 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,330 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,330 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:28,331 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:08:28,330 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,331 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:08:28,331 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:08:28,331 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,331 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:08:28,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:08:28,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:28,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:28,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:28,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:08:28,333 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37855,1690088792757' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-23 05:08:28,333 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a2a172b[Count = 1] remaining members to acquire global barrier 2023-07-23 05:08:28,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:28,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:08:28,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:08:28,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:08:28,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:08:28,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:28,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:28,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:28,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:08:28,336 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44949,1690088792720' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-23 05:08:28,336 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a2a172b[Count = 0] remaining members to acquire global barrier 2023-07-23 05:08:28,336 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-23 05:08:28,336 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,337 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,338 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,337 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,338 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-23 05:08:28,338 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-23 05:08:28,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,338 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-23 05:08:28,338 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-23 05:08:28,338 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45437,1690088792660' in zk 2023-07-23 05:08:28,339 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:28,341 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:28,341 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 05:08:28,342 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:08:28,342 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:08:28,342 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:08:28,342 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:08:28,342 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690088907636.c18424f320d916b35a3195fc83fa4924. 2023-07-23 05:08:28,342 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690088907636.43ceed078730e1f8d5444075da555c0d. 2023-07-23 05:08:28,342 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690088907636.43ceed078730e1f8d5444075da555c0d. started... 2023-07-23 05:08:28,342 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-23 05:08:28,342 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690088907636.c18424f320d916b35a3195fc83fa4924. started... 2023-07-23 05:08:28,344 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:08:28,344 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-23 05:08:28,344 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c18424f320d916b35a3195fc83fa4924: 2023-07-23 05:08:28,345 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690088907636.c18424f320d916b35a3195fc83fa4924.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,345 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:08:28,345 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 05:08:28,348 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 43ceed078730e1f8d5444075da555c0d: 2023-07-23 05:08:28,349 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690088907636.43ceed078730e1f8d5444075da555c0d.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,349 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:08:28,349 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 05:08:28,358 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690088907636.c18424f320d916b35a3195fc83fa4924. completed. 2023-07-23 05:08:28,358 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690088907636.c18424f320d916b35a3195fc83fa4924. 2023-07-23 05:08:28,358 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:08:28,359 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:08:28,359 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:28,359 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-23 05:08:28,359 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37855,1690088792757' in zk 2023-07-23 05:08:28,360 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690088907636.43ceed078730e1f8d5444075da555c0d. completed. 2023-07-23 05:08:28,360 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690088907636.43ceed078730e1f8d5444075da555c0d. 2023-07-23 05:08:28,361 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:08:28,361 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:08:28,361 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:28,361 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-23 05:08:28,361 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44949,1690088792720' in zk 2023-07-23 05:08:28,361 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-23 05:08:28,361 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:08:28,361 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:28,361 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-23 05:08:28,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:28,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:08:28,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:08:28,364 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:28,364 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-23 05:08:28,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:08:28,364 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:08:28,364 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-23 05:08:28,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:08:28,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:28,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:28,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:28,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:08:28,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:28,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:28,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:28,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,37855,1690088792757': 2023-07-23 05:08:28,369 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37855,1690088792757' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-23 05:08:28,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:28,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:08:28,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:08:28,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:08:28,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:08:28,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:28,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:28,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:28,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:08:28,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:28,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:28,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:28,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,44949,1690088792720': 2023-07-23 05:08:28,374 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44949,1690088792720' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-23 05:08:28,374 INFO [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-23 05:08:28,375 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 05:08:28,375 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 05:08:28,375 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,375 INFO [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 05:08:28,376 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,376 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:08:28,376 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:28,376 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,376 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,377 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:28,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,377 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:28,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:08:28,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,377 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:28,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:08:28,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:28,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:28,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:28,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:28,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:28,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:28,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,379 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:28,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:08:28,381 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:28,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:28,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:28,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:28,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:08:28,383 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:28,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,383 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:28,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:28,383 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:28,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:28,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:28,388 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:28,388 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:28,388 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:28,388 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:28,388 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:28,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:28,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:28,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:28,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:28,389 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:28,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:28,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:28,391 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:28,392 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,392 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:28,392 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:28,392 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,392 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:28,392 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,392 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:28,392 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:28,392 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,392 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,392 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:08:28,392 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,392 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,392 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,392 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 05:08:28,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:28,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:28,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:28,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:28,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:28,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:28,393 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-23 05:08:28,400 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:08:28,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-23 05:08:28,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:08:28,401 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 05:08:28,443 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,444 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,511 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,528 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-23 05:08:28,528 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,529 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,529 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690088908299Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1690088908443 (+144 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690088908443Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690088908443Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690088908451 (+8 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690088908506 (+55 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690088908528 (+22 ms) 2023-07-23 05:08:28,531 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-23 05:08:28,533 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 231 msec 2023-07-23 05:08:28,602 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:08:28,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-23 05:08:28,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 05:08:28,605 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37855] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1690088907636.c18424f320d916b35a3195fc83fa4924. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 05:08:28,606 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44949] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1690088907636.43ceed078730e1f8d5444075da555c0d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 05:08:28,609 DEBUG [Listener at jenkins-hbase4.apache.org/33827] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,609 DEBUG [Listener at jenkins-hbase4.apache.org/33827] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1690088907636.c18424f320d916b35a3195fc83fa4924. 2023-07-23 05:08:28,609 INFO [Listener at jenkins-hbase4.apache.org/33827] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 05:08:28,618 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-23 05:08:28,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690088908619 (current time:1690088908619). 2023-07-23 05:08:28,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 05:08:28,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] zookeeper.ReadOnlyZKClient(139): Connect 0x6cec4225 to 127.0.0.1:57388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:08:28,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12b822b2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:08:28,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:08:28,631 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45086, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:08:28,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6cec4225 to 127.0.0.1:57388 2023-07-23 05:08:28,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:08:28,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] zookeeper.ReadOnlyZKClient(139): Connect 0x24342c88 to 127.0.0.1:57388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 05:08:28,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a47af41, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 05:08:28,736 DEBUG [hconnection-0x79b9b509-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:08:28,739 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45102, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:08:28,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 05:08:28,745 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60248, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 05:08:28,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x24342c88 to 127.0.0.1:57388 2023-07-23 05:08:28,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:08:28,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-23 05:08:28,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 05:08:28,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-23 05:08:28,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-23 05:08:28,750 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-23 05:08:28,751 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690089508751 2023-07-23 05:08:28,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-23 05:08:28,751 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,752 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 05:08:28,752 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 05:08:28,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-23 05:08:28,753 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-23 05:08:28,754 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-07-23 05:08:28,755 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-23 05:08:28,755 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690089508755 2023-07-23 05:08:28,767 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,767 INFO [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-23 05:08:28,767 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:08:28,768 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-23 05:08:28,768 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-23 05:08:28,769 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,769 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,776 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:28,776 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:28,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:28,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:28,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:28,776 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:28,776 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:28,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:28,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:28,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:28,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,777 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:28,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,777 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:28,777 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,777 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-23 05:08:28,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,777 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,777 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:28,778 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-23 05:08:28,778 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 05:08:28,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-23 05:08:28,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,778 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,778 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-23 05:08:28,778 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-23 05:08:28,778 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:08:28,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-23 05:08:28,779 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-23 05:08:28,779 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-23 05:08:28,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,780 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45437,1690088792660' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-23 05:08:28,780 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,780 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-23 05:08:28,780 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-23 05:08:28,780 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:08:28,781 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-23 05:08:28,781 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,781 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-23 05:08:28,781 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-23 05:08:28,781 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 05:08:28,781 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37855,1690088792757' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-23 05:08:28,782 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-23 05:08:28,782 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-23 05:08:28,783 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44949,1690088792720' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-23 05:08:28,783 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,784 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,784 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:08:28,785 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:28,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:28,785 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,785 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:28,785 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:08:28,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:08:28,786 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,787 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:08:28,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:08:28,786 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,787 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 05:08:28,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:08:28,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:28,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:28,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:28,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:08:28,788 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37855,1690088792757' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-23 05:08:28,788 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58eed994[Count = 1] remaining members to acquire global barrier 2023-07-23 05:08:28,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:28,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:08:28,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:08:28,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:08:28,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:08:28,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:28,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:28,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:28,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:08:28,790 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44949,1690088792720' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-23 05:08:28,790 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58eed994[Count = 0] remaining members to acquire global barrier 2023-07-23 05:08:28,790 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-23 05:08:28,790 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,796 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,796 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,796 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,796 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-23 05:08:28,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,796 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:28,796 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-23 05:08:28,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,796 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:08:28,796 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:08:28,796 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-23 05:08:28,796 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 05:08:28,796 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 05:08:28,796 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-23 05:08:28,796 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690088907636.c18424f320d916b35a3195fc83fa4924. 2023-07-23 05:08:28,796 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:28,796 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690088907636.c18424f320d916b35a3195fc83fa4924. started... 2023-07-23 05:08:28,796 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690088907636.43ceed078730e1f8d5444075da555c0d. 2023-07-23 05:08:28,796 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 05:08:28,797 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690088907636.43ceed078730e1f8d5444075da555c0d. started... 2023-07-23 05:08:28,796 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45437,1690088792660' in zk 2023-07-23 05:08:28,797 INFO [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c18424f320d916b35a3195fc83fa4924 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-23 05:08:28,797 INFO [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 43ceed078730e1f8d5444075da555c0d 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-23 05:08:28,798 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-23 05:08:28,798 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:08:28,798 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1690088792660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-23 05:08:28,819 INFO [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230723fb6f498ab81145f39f8079629950efce to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230723fb6f498ab81145f39f8079629950efce 2023-07-23 05:08:28,819 INFO [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023072343e0048caa194fd092f228af65c79c2c to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023072343e0048caa194fd092f228af65c79c2c 2023-07-23 05:08:28,832 INFO [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithSkipTmp/c18424f320d916b35a3195fc83fa4924/.tmp/cf/be68c82601ef4c60bd64264b7a3abdd8 2023-07-23 05:08:28,835 INFO [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithSkipTmp/43ceed078730e1f8d5444075da555c0d/.tmp/cf/6bcaf1dd4f704a5997ee9728d0c730ff 2023-07-23 05:08:28,837 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithSkipTmp/c18424f320d916b35a3195fc83fa4924/.tmp/cf/be68c82601ef4c60bd64264b7a3abdd8 as hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithSkipTmp/c18424f320d916b35a3195fc83fa4924/cf/be68c82601ef4c60bd64264b7a3abdd8 2023-07-23 05:08:28,839 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithSkipTmp/43ceed078730e1f8d5444075da555c0d/.tmp/cf/6bcaf1dd4f704a5997ee9728d0c730ff as hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithSkipTmp/43ceed078730e1f8d5444075da555c0d/cf/6bcaf1dd4f704a5997ee9728d0c730ff 2023-07-23 05:08:28,841 INFO [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithSkipTmp/c18424f320d916b35a3195fc83fa4924/cf/be68c82601ef4c60bd64264b7a3abdd8, entries=5, sequenceid=6, filesize=5.8 K 2023-07-23 05:08:28,842 INFO [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for c18424f320d916b35a3195fc83fa4924 in 45ms, sequenceid=6, compaction requested=false 2023-07-23 05:08:28,842 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-23 05:08:28,842 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c18424f320d916b35a3195fc83fa4924: 2023-07-23 05:08:28,843 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690088907636.c18424f320d916b35a3195fc83fa4924.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,843 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:08:28,843 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithSkipTmp/c18424f320d916b35a3195fc83fa4924/cf/be68c82601ef4c60bd64264b7a3abdd8] hfiles 2023-07-23 05:08:28,843 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithSkipTmp/c18424f320d916b35a3195fc83fa4924/cf/be68c82601ef4c60bd64264b7a3abdd8 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,844 INFO [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithSkipTmp/43ceed078730e1f8d5444075da555c0d/cf/6bcaf1dd4f704a5997ee9728d0c730ff, entries=45, sequenceid=6, filesize=13.0 K 2023-07-23 05:08:28,844 INFO [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 43ceed078730e1f8d5444075da555c0d in 47ms, sequenceid=6, compaction requested=false 2023-07-23 05:08:28,846 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 43ceed078730e1f8d5444075da555c0d: 2023-07-23 05:08:28,846 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690088907636.43ceed078730e1f8d5444075da555c0d.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,846 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 05:08:28,846 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithSkipTmp/43ceed078730e1f8d5444075da555c0d/cf/6bcaf1dd4f704a5997ee9728d0c730ff] hfiles 2023-07-23 05:08:28,846 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithSkipTmp/43ceed078730e1f8d5444075da555c0d/cf/6bcaf1dd4f704a5997ee9728d0c730ff for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,852 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:08:28,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-23 05:08:28,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-23 05:08:28,853 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 05:08:28,859 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690088907636.c18424f320d916b35a3195fc83fa4924. completed. 2023-07-23 05:08:28,859 DEBUG [rs(jenkins-hbase4.apache.org,37855,1690088792757)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690088907636.c18424f320d916b35a3195fc83fa4924. 2023-07-23 05:08:28,859 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:08:28,859 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:08:28,859 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:28,859 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-23 05:08:28,859 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37855,1690088792757' in zk 2023-07-23 05:08:28,861 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-23 05:08:28,861 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:28,861 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:08:28,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:28,861 DEBUG [member: 'jenkins-hbase4.apache.org,37855,1690088792757' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-23 05:08:28,862 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690088907636.43ceed078730e1f8d5444075da555c0d. completed. 2023-07-23 05:08:28,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:08:28,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:08:28,862 DEBUG [rs(jenkins-hbase4.apache.org,44949,1690088792720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690088907636.43ceed078730e1f8d5444075da555c0d. 2023-07-23 05:08:28,862 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 05:08:28,862 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 05:08:28,862 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:28,863 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-23 05:08:28,863 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44949,1690088792720' in zk 2023-07-23 05:08:28,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:08:28,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:08:28,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,864 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:28,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:28,864 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-23 05:08:28,864 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:08:28,864 DEBUG [member: 'jenkins-hbase4.apache.org,44949,1690088792720' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-23 05:08:28,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:28,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:28,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:08:28,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:28,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:28,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:28,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,37855,1690088792757': 2023-07-23 05:08:28,868 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37855,1690088792757' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-23 05:08:28,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:28,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:08:28,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:08:28,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:08:28,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:08:28,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:28,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:28,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:28,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:08:28,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:28,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:28,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:28,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,44949,1690088792720': 2023-07-23 05:08:28,871 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44949,1690088792720' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-23 05:08:28,871 INFO [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-23 05:08:28,871 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 05:08:28,871 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 05:08:28,872 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,872 INFO [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 05:08:28,874 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,874 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 05:08:28,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 05:08:28,874 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,874 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:28,874 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,874 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:28,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,875 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:28,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:28,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:28,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 05:08:28,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:28,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:28,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:28,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:28,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,875 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:28,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,876 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:28,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 05:08:28,876 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:28,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:28,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:28,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:28,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 05:08:28,878 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:28,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,878 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:28,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:28,878 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:28,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:28,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:28,881 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:28,881 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:28,881 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:28,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:28,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:28,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:28,881 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:28,881 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:28,881 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,881 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:28,881 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,881 DEBUG [(jenkins-hbase4.apache.org,32809,1690088791154)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 05:08:28,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:28,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:28,881 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:28,881 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 05:08:28,883 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:28,883 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 05:08:28,883 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 05:08:28,881 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:28,883 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 05:08:28,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:28,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 05:08:28,883 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:28,883 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,883 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:28,883 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:08:28,883 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,883 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 05:08:28,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 05:08:28,884 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023072343e0048caa194fd092f228af65c79c2c, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230723fb6f498ab81145f39f8079629950efce] mob files 2023-07-23 05:08:28,884 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023072343e0048caa194fd092f228af65c79c2c 2023-07-23 05:08:28,884 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230723fb6f498ab81145f39f8079629950efce 2023-07-23 05:08:28,891 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,891 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,912 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,938 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-23 05:08:28,938 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,939 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:28,939 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690088908751Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1690088908890 (+139 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690088908890Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1690088908891 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1690088908895 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690088908906 (+11 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690088908938 (+32 ms) 2023-07-23 05:08:28,941 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-23 05:08:28,943 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 189 msec 2023-07-23 05:08:29,054 DEBUG [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 05:08:29,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-23 05:08:29,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 05:08:29,055 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088909055 2023-07-23 05:08:29,055 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38911, tgtDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088909055, rawTgtDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088909055, srcFsUri=hdfs://localhost:38911, srcDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd 2023-07-23 05:08:29,078 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38911, inputRoot=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd 2023-07-23 05:08:29,078 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1358161018_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088909055, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088909055/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,078 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38911, inputRoot=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd, snapshotDir=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-23 05:08:29,089 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088909055/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:29,117 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:29,117 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:29,117 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:29,118 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:29,118 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:29,118 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:29,118 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:29,198 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/hadoop-2775561517477048036.jar 2023-07-23 05:08:29,198 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:29,198 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:29,199 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:29,199 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:29,199 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:29,200 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 05:08:29,200 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 05:08:29,201 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 05:08:29,201 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 05:08:29,201 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 05:08:29,202 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 05:08:29,202 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 05:08:29,202 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 05:08:29,203 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 05:08:29,203 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 05:08:29,204 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 05:08:29,204 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:08:29,204 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:08:29,205 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 05:08:29,205 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:08:29,205 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 05:08:29,206 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 05:08:29,206 DEBUG [Listener at jenkins-hbase4.apache.org/33827] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 05:08:29,827 WARN [Listener at jenkins-hbase4.apache.org/33827] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 05:08:29,829 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-23 05:08:29,831 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-23 05:08:32,165 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 05:08:32,165 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 05:08:32,168 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088800324_0006_000001 (auth:SIMPLE) 2023-07-23 05:08:32,791 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088800324_0007_000001 (auth:SIMPLE) 2023-07-23 05:08:32,901 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 05:08:39,225 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088800324_0007_000001 (auth:SIMPLE) 2023-07-23 05:08:41,519 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088800324_0007_000001 (auth:SIMPLE) 2023-07-23 05:08:45,248 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690088800324_0007_000001 (auth:SIMPLE) 2023-07-23 05:08:47,081 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 05:08:47,081 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 05:08:47,099 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:47,099 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 05:08:47,100 INFO [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 05:08:47,100 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-154173811_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:47,101 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(367): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-23 05:08:47,101 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(367): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-23 05:08:47,101 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-154173811_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088909055/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088909055/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:47,101 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(367): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088909055/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-23 05:08:47,101 DEBUG [Listener at jenkins-hbase4.apache.org/33827] snapshot.TestExportSnapshot(367): hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/export-test/export-1690088909055/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-23 05:08:47,109 INFO [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:47,110 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:47,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:47,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-23 05:08:47,115 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088927115"}]},"ts":"1690088927115"} 2023-07-23 05:08:47,117 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-23 05:08:47,121 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-23 05:08:47,122 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c18424f320d916b35a3195fc83fa4924, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=43ceed078730e1f8d5444075da555c0d, UNASSIGN}] 2023-07-23 05:08:47,124 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c18424f320d916b35a3195fc83fa4924, UNASSIGN 2023-07-23 05:08:47,126 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=43ceed078730e1f8d5444075da555c0d, UNASSIGN 2023-07-23 05:08:47,133 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=43ceed078730e1f8d5444075da555c0d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:08:47,133 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690088907636.43ceed078730e1f8d5444075da555c0d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690088927133"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088927133"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088927133"}]},"ts":"1690088927133"} 2023-07-23 05:08:47,133 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=c18424f320d916b35a3195fc83fa4924, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:08:47,134 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690088907636.c18424f320d916b35a3195fc83fa4924.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690088927133"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690088927133"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690088927133"}]},"ts":"1690088927133"} 2023-07-23 05:08:47,135 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure 43ceed078730e1f8d5444075da555c0d, server=jenkins-hbase4.apache.org,44949,1690088792720}] 2023-07-23 05:08:47,136 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure c18424f320d916b35a3195fc83fa4924, server=jenkins-hbase4.apache.org,37855,1690088792757}] 2023-07-23 05:08:47,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-23 05:08:47,287 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 43ceed078730e1f8d5444075da555c0d 2023-07-23 05:08:47,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 43ceed078730e1f8d5444075da555c0d, disabling compactions & flushes 2023-07-23 05:08:47,288 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690088907636.43ceed078730e1f8d5444075da555c0d. 2023-07-23 05:08:47,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690088907636.43ceed078730e1f8d5444075da555c0d. 2023-07-23 05:08:47,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690088907636.43ceed078730e1f8d5444075da555c0d. after waiting 0 ms 2023-07-23 05:08:47,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690088907636.43ceed078730e1f8d5444075da555c0d. 2023-07-23 05:08:47,288 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c18424f320d916b35a3195fc83fa4924 2023-07-23 05:08:47,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c18424f320d916b35a3195fc83fa4924, disabling compactions & flushes 2023-07-23 05:08:47,293 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690088907636.c18424f320d916b35a3195fc83fa4924. 2023-07-23 05:08:47,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690088907636.c18424f320d916b35a3195fc83fa4924. 2023-07-23 05:08:47,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690088907636.c18424f320d916b35a3195fc83fa4924. after waiting 0 ms 2023-07-23 05:08:47,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690088907636.c18424f320d916b35a3195fc83fa4924. 2023-07-23 05:08:47,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithSkipTmp/43ceed078730e1f8d5444075da555c0d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 05:08:47,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:08:47,330 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690088907636.43ceed078730e1f8d5444075da555c0d. 2023-07-23 05:08:47,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 43ceed078730e1f8d5444075da555c0d: 2023-07-23 05:08:47,334 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 43ceed078730e1f8d5444075da555c0d 2023-07-23 05:08:47,340 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=43ceed078730e1f8d5444075da555c0d, regionState=CLOSED 2023-07-23 05:08:47,340 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690088907636.43ceed078730e1f8d5444075da555c0d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690088927339"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088927339"}]},"ts":"1690088927339"} 2023-07-23 05:08:47,344 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-23 05:08:47,344 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure 43ceed078730e1f8d5444075da555c0d, server=jenkins-hbase4.apache.org,44949,1690088792720 in 206 msec 2023-07-23 05:08:47,347 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=43ceed078730e1f8d5444075da555c0d, UNASSIGN in 222 msec 2023-07-23 05:08:47,347 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/default/testtb-testExportFileSystemStateWithSkipTmp/c18424f320d916b35a3195fc83fa4924/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 05:08:47,348 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:08:47,349 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690088907636.c18424f320d916b35a3195fc83fa4924. 2023-07-23 05:08:47,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c18424f320d916b35a3195fc83fa4924: 2023-07-23 05:08:47,351 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c18424f320d916b35a3195fc83fa4924 2023-07-23 05:08:47,353 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=c18424f320d916b35a3195fc83fa4924, regionState=CLOSED 2023-07-23 05:08:47,354 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690088907636.c18424f320d916b35a3195fc83fa4924.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690088927353"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690088927353"}]},"ts":"1690088927353"} 2023-07-23 05:08:47,358 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-23 05:08:47,358 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure c18424f320d916b35a3195fc83fa4924, server=jenkins-hbase4.apache.org,37855,1690088792757 in 219 msec 2023-07-23 05:08:47,360 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-23 05:08:47,360 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c18424f320d916b35a3195fc83fa4924, UNASSIGN in 236 msec 2023-07-23 05:08:47,361 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690088927361"}]},"ts":"1690088927361"} 2023-07-23 05:08:47,362 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-23 05:08:47,364 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-23 05:08:47,366 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 254 msec 2023-07-23 05:08:47,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-23 05:08:47,417 INFO [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-23 05:08:47,418 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:47,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:47,422 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:47,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:47,427 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:47,428 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45437] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:47,431 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:47,431 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:47,431 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:47,432 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:47,432 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-23 05:08:47,432 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-23 05:08:47,432 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-23 05:08:47,432 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-23 05:08:47,434 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:47,434 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:47,434 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:47,434 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:47,434 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:47,434 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:47,434 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:47,435 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c18424f320d916b35a3195fc83fa4924 2023-07-23 05:08:47,434 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 05:08:47,435 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/43ceed078730e1f8d5444075da555c0d 2023-07-23 05:08:47,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-23 05:08:47,437 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/43ceed078730e1f8d5444075da555c0d/cf, FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/43ceed078730e1f8d5444075da555c0d/recovered.edits] 2023-07-23 05:08:47,438 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c18424f320d916b35a3195fc83fa4924/cf, FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c18424f320d916b35a3195fc83fa4924/recovered.edits] 2023-07-23 05:08:47,454 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c18424f320d916b35a3195fc83fa4924/cf/be68c82601ef4c60bd64264b7a3abdd8 to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/c18424f320d916b35a3195fc83fa4924/cf/be68c82601ef4c60bd64264b7a3abdd8 2023-07-23 05:08:47,455 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/43ceed078730e1f8d5444075da555c0d/cf/6bcaf1dd4f704a5997ee9728d0c730ff to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/43ceed078730e1f8d5444075da555c0d/cf/6bcaf1dd4f704a5997ee9728d0c730ff 2023-07-23 05:08:47,459 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/43ceed078730e1f8d5444075da555c0d/recovered.edits/9.seqid to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/43ceed078730e1f8d5444075da555c0d/recovered.edits/9.seqid 2023-07-23 05:08:47,459 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c18424f320d916b35a3195fc83fa4924/recovered.edits/9.seqid to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/c18424f320d916b35a3195fc83fa4924/recovered.edits/9.seqid 2023-07-23 05:08:47,459 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/43ceed078730e1f8d5444075da555c0d 2023-07-23 05:08:47,460 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c18424f320d916b35a3195fc83fa4924 2023-07-23 05:08:47,460 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-23 05:08:47,460 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-23 05:08:47,461 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-23 05:08:47,464 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023072343e0048caa194fd092f228af65c79c2c to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023072343e0048caa194fd092f228af65c79c2c 2023-07-23 05:08:47,466 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230723fb6f498ab81145f39f8079629950efce to hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230723fb6f498ab81145f39f8079629950efce 2023-07-23 05:08:47,466 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-23 05:08:47,469 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:47,483 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-23 05:08:47,489 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-23 05:08:47,490 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:47,490 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-23 05:08:47,490 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690088907636.c18424f320d916b35a3195fc83fa4924.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690088927490"}]},"ts":"9223372036854775807"} 2023-07-23 05:08:47,490 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690088907636.43ceed078730e1f8d5444075da555c0d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690088927490"}]},"ts":"9223372036854775807"} 2023-07-23 05:08:47,493 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-23 05:08:47,493 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c18424f320d916b35a3195fc83fa4924, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690088907636.c18424f320d916b35a3195fc83fa4924.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 43ceed078730e1f8d5444075da555c0d, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690088907636.43ceed078730e1f8d5444075da555c0d.', STARTKEY => '1', ENDKEY => ''}] 2023-07-23 05:08:47,493 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-23 05:08:47,493 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690088927493"}]},"ts":"9223372036854775807"} 2023-07-23 05:08:47,498 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-23 05:08:47,501 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:47,502 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 83 msec 2023-07-23 05:08:47,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-23 05:08:47,538 INFO [Listener at jenkins-hbase4.apache.org/33827] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-23 05:08:47,551 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-23 05:08:47,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:47,554 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-23 05:08:47,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32809] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 05:08:47,589 INFO [Listener at jenkins-hbase4.apache.org/33827] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763 (was 760) Potentially hanging thread: hconnection-0x76a1f2b0-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-154173811_17 at /127.0.0.1:50158 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1304477636_1 at /127.0.0.1:33574 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-154173811_17 at /127.0.0.1:60240 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-154173811_17 at /127.0.0.1:33596 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5434 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x76a1f2b0-shared-pool-46 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x76a1f2b0-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (583231684) connection to jenkins-hbase4.apache.org/172.31.14.131:36201 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1304477636_1 at /127.0.0.1:50134 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x76a1f2b0-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=906 (was 924), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=592 (was 615), ProcessCount=181 (was 181), AvailableMemoryMB=4698 (was 4910) 2023-07-23 05:08:47,590 WARN [Listener at jenkins-hbase4.apache.org/33827] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-23 05:08:47,590 INFO [Listener at jenkins-hbase4.apache.org/33827] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-23 05:08:47,616 INFO [Listener at jenkins-hbase4.apache.org/33827] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-23 05:08:47,732 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1690088800324_0007_01_000001 is : 143 2023-07-23 05:08:52,920 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 05:09:01,741 INFO [Listener at jenkins-hbase4.apache.org/33827] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-23 05:09:15,858 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-23 05:09:15,859 INFO [Listener at jenkins-hbase4.apache.org/33827] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-23 05:09:15,974 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-23 05:09:15,986 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-23 05:09:15,987 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-23 05:09:15,999 INFO [Listener at jenkins-hbase4.apache.org/33827] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-23 05:09:16,103 ERROR [Thread[Thread-385,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-23 05:09:16,103 INFO [Listener at jenkins-hbase4.apache.org/33827] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-23 05:09:16,103 INFO [Listener at jenkins-hbase4.apache.org/33827] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-23 05:09:16,103 INFO [Listener at jenkins-hbase4.apache.org/33827] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-23 05:09:16,103 DEBUG [Listener at jenkins-hbase4.apache.org/33827] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x543dfa23 to 127.0.0.1:57388 2023-07-23 05:09:16,103 DEBUG [Listener at jenkins-hbase4.apache.org/33827] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:09:16,103 DEBUG [Listener at jenkins-hbase4.apache.org/33827] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-23 05:09:16,103 DEBUG [Listener at jenkins-hbase4.apache.org/33827] util.JVMClusterUtil(257): Found active master hash=1241008609, stopped=false 2023-07-23 05:09:16,104 DEBUG [Listener at jenkins-hbase4.apache.org/33827] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:09:16,104 DEBUG [Listener at jenkins-hbase4.apache.org/33827] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-23 05:09:16,104 INFO [Listener at jenkins-hbase4.apache.org/33827] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,32809,1690088791154 2023-07-23 05:09:16,105 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-23 05:09:16,105 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-23 05:09:16,105 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 05:09:16,105 INFO [Listener at jenkins-hbase4.apache.org/33827] procedure2.ProcedureExecutor(629): Stopping 2023-07-23 05:09:16,105 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-23 05:09:16,105 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-23 05:09:16,105 DEBUG [Listener at jenkins-hbase4.apache.org/33827] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x26ff111b to 127.0.0.1:57388 2023-07-23 05:09:16,106 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 05:09:16,106 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 05:09:16,106 DEBUG [Listener at jenkins-hbase4.apache.org/33827] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:09:16,106 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 05:09:16,106 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 05:09:16,106 INFO [Listener at jenkins-hbase4.apache.org/33827] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45437,1690088792660' ***** 2023-07-23 05:09:16,106 DEBUG [Listener at jenkins-hbase4.apache.org/33827] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:09:16,106 INFO [Listener at jenkins-hbase4.apache.org/33827] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-23 05:09:16,106 INFO [Listener at jenkins-hbase4.apache.org/33827] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44949,1690088792720' ***** 2023-07-23 05:09:16,107 DEBUG [Listener at jenkins-hbase4.apache.org/33827] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:09:16,107 INFO [Listener at jenkins-hbase4.apache.org/33827] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-23 05:09:16,107 INFO [RS:0;jenkins-hbase4:45437] regionserver.HeapMemoryManager(220): Stopping 2023-07-23 05:09:16,107 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-23 05:09:16,107 INFO [RS:1;jenkins-hbase4:44949] regionserver.HeapMemoryManager(220): Stopping 2023-07-23 05:09:16,107 INFO [RS:0;jenkins-hbase4:45437] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-23 05:09:16,107 INFO [Listener at jenkins-hbase4.apache.org/33827] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37855,1690088792757' ***** 2023-07-23 05:09:16,107 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-23 05:09:16,107 INFO [RS:0;jenkins-hbase4:45437] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-23 05:09:16,107 INFO [RS:1;jenkins-hbase4:44949] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-23 05:09:16,107 DEBUG [Listener at jenkins-hbase4.apache.org/33827] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:09:16,107 INFO [RS:1;jenkins-hbase4:44949] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-23 05:09:16,107 INFO [RS:0;jenkins-hbase4:45437] regionserver.HRegionServer(3305): Received CLOSE for 50be53dc87e8bcba1c8172066674b195 2023-07-23 05:09:16,107 INFO [RS:1;jenkins-hbase4:44949] regionserver.HRegionServer(3305): Received CLOSE for b436f5555f6fd67c866f08a780730e90 2023-07-23 05:09:16,107 INFO [Listener at jenkins-hbase4.apache.org/33827] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-23 05:09:16,108 INFO [RS:0;jenkins-hbase4:45437] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:09:16,108 INFO [RS:2;jenkins-hbase4:37855] regionserver.HeapMemoryManager(220): Stopping 2023-07-23 05:09:16,108 DEBUG [RS:0;jenkins-hbase4:45437] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0c5e5cea to 127.0.0.1:57388 2023-07-23 05:09:16,108 INFO [RS:1;jenkins-hbase4:44949] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:09:16,109 DEBUG [RS:0;jenkins-hbase4:45437] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:09:16,109 DEBUG [RS:1;jenkins-hbase4:44949] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x48fe145d to 127.0.0.1:57388 2023-07-23 05:09:16,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 50be53dc87e8bcba1c8172066674b195, disabling compactions & flushes 2023-07-23 05:09:16,109 DEBUG [RS:1;jenkins-hbase4:44949] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:09:16,108 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-23 05:09:16,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b436f5555f6fd67c866f08a780730e90, disabling compactions & flushes 2023-07-23 05:09:16,108 INFO [RS:2;jenkins-hbase4:37855] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-23 05:09:16,111 INFO [RS:1;jenkins-hbase4:44949] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-23 05:09:16,111 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690088795537.b436f5555f6fd67c866f08a780730e90. 2023-07-23 05:09:16,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690088795537.b436f5555f6fd67c866f08a780730e90. 2023-07-23 05:09:16,111 INFO [RS:0;jenkins-hbase4:45437] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-23 05:09:16,109 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690088796392.50be53dc87e8bcba1c8172066674b195. 2023-07-23 05:09:16,111 DEBUG [RS:0;jenkins-hbase4:45437] regionserver.HRegionServer(1478): Online Regions={50be53dc87e8bcba1c8172066674b195=hbase:acl,,1690088796392.50be53dc87e8bcba1c8172066674b195.} 2023-07-23 05:09:16,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690088795537.b436f5555f6fd67c866f08a780730e90. after waiting 0 ms 2023-07-23 05:09:16,111 INFO [RS:1;jenkins-hbase4:44949] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-23 05:09:16,112 INFO [RS:1;jenkins-hbase4:44949] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-23 05:09:16,111 INFO [RS:2;jenkins-hbase4:37855] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-23 05:09:16,112 INFO [RS:1;jenkins-hbase4:44949] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-23 05:09:16,112 INFO [RS:2;jenkins-hbase4:37855] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:09:16,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690088795537.b436f5555f6fd67c866f08a780730e90. 2023-07-23 05:09:16,112 DEBUG [RS:2;jenkins-hbase4:37855] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b050d2d to 127.0.0.1:57388 2023-07-23 05:09:16,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690088796392.50be53dc87e8bcba1c8172066674b195. 2023-07-23 05:09:16,112 DEBUG [RS:2;jenkins-hbase4:37855] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:09:16,112 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing b436f5555f6fd67c866f08a780730e90 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-23 05:09:16,112 INFO [RS:2;jenkins-hbase4:37855] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37855,1690088792757; all regions closed. 2023-07-23 05:09:16,112 INFO [RS:1;jenkins-hbase4:44949] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-23 05:09:16,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690088796392.50be53dc87e8bcba1c8172066674b195. after waiting 0 ms 2023-07-23 05:09:16,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690088796392.50be53dc87e8bcba1c8172066674b195. 2023-07-23 05:09:16,113 DEBUG [RS:0;jenkins-hbase4:45437] regionserver.HRegionServer(1504): Waiting on 50be53dc87e8bcba1c8172066674b195 2023-07-23 05:09:16,113 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 50be53dc87e8bcba1c8172066674b195 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-23 05:09:16,113 DEBUG [RS:1;jenkins-hbase4:44949] regionserver.HRegionServer(1478): Online Regions={b436f5555f6fd67c866f08a780730e90=hbase:namespace,,1690088795537.b436f5555f6fd67c866f08a780730e90., 1588230740=hbase:meta,,1.1588230740} 2023-07-23 05:09:16,113 DEBUG [RS:1;jenkins-hbase4:44949] regionserver.HRegionServer(1504): Waiting on 1588230740, b436f5555f6fd67c866f08a780730e90 2023-07-23 05:09:16,114 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-23 05:09:16,114 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-23 05:09:16,114 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-23 05:09:16,114 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-23 05:09:16,114 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-23 05:09:16,114 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-23 05:09:16,142 DEBUG [RS:2;jenkins-hbase4:37855] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/oldWALs 2023-07-23 05:09:16,142 INFO [RS:2;jenkins-hbase4:37855] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37855%2C1690088792757:(num 1690088794921) 2023-07-23 05:09:16,142 DEBUG [RS:2;jenkins-hbase4:37855] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:09:16,142 INFO [RS:2;jenkins-hbase4:37855] regionserver.LeaseManager(133): Closed leases 2023-07-23 05:09:16,143 INFO [RS:2;jenkins-hbase4:37855] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-23 05:09:16,143 INFO [RS:2;jenkins-hbase4:37855] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-23 05:09:16,143 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-23 05:09:16,143 INFO [RS:2;jenkins-hbase4:37855] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-23 05:09:16,143 INFO [RS:2;jenkins-hbase4:37855] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-23 05:09:16,155 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/meta/1588230740/.tmp/info/cfbb80220fc9437da3c3a8ebceefe982 2023-07-23 05:09:16,156 INFO [RS:2;jenkins-hbase4:37855] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37855 2023-07-23 05:09:16,162 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cfbb80220fc9437da3c3a8ebceefe982 2023-07-23 05:09:16,163 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/namespace/b436f5555f6fd67c866f08a780730e90/.tmp/info/475f919308b0458695165b5487c3dfb1 2023-07-23 05:09:16,164 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:09:16,164 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 05:09:16,164 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:09:16,165 ERROR [Listener at localhost/37217-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3cf3e5e8 rejected from java.util.concurrent.ThreadPoolExecutor@38cc76ae[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 108] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:603) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-07-23 05:09:16,164 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37855,1690088792757 2023-07-23 05:09:16,164 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 05:09:16,165 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 05:09:16,165 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 05:09:16,165 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/acl/50be53dc87e8bcba1c8172066674b195/.tmp/l/7db009bb68314fe08f1f057be4a44a9c 2023-07-23 05:09:16,170 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/namespace/b436f5555f6fd67c866f08a780730e90/.tmp/info/475f919308b0458695165b5487c3dfb1 as hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/namespace/b436f5555f6fd67c866f08a780730e90/info/475f919308b0458695165b5487c3dfb1 2023-07-23 05:09:16,170 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7db009bb68314fe08f1f057be4a44a9c 2023-07-23 05:09:16,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/acl/50be53dc87e8bcba1c8172066674b195/.tmp/l/7db009bb68314fe08f1f057be4a44a9c as hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/acl/50be53dc87e8bcba1c8172066674b195/l/7db009bb68314fe08f1f057be4a44a9c 2023-07-23 05:09:16,171 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37855,1690088792757] 2023-07-23 05:09:16,172 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-23 05:09:16,198 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-23 05:09:16,198 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37855,1690088792757; numProcessing=1 2023-07-23 05:09:16,198 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-23 05:09:16,202 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7db009bb68314fe08f1f057be4a44a9c 2023-07-23 05:09:16,202 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/acl/50be53dc87e8bcba1c8172066674b195/l/7db009bb68314fe08f1f057be4a44a9c, entries=7, sequenceid=18, filesize=5.2 K 2023-07-23 05:09:16,204 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37855,1690088792757 already deleted, retry=false 2023-07-23 05:09:16,204 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 50be53dc87e8bcba1c8172066674b195 in 90ms, sequenceid=18, compaction requested=false 2023-07-23 05:09:16,204 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37855,1690088792757 expired; onlineServers=2 2023-07-23 05:09:16,212 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/namespace/b436f5555f6fd67c866f08a780730e90/info/475f919308b0458695165b5487c3dfb1, entries=2, sequenceid=6, filesize=4.8 K 2023-07-23 05:09:16,213 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for b436f5555f6fd67c866f08a780730e90 in 101ms, sequenceid=6, compaction requested=false 2023-07-23 05:09:16,226 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/acl/50be53dc87e8bcba1c8172066674b195/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-23 05:09:16,226 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/meta/1588230740/.tmp/rep_barrier/deb69eb32c5d45f78f7c02f7b79362cc 2023-07-23 05:09:16,226 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/namespace/b436f5555f6fd67c866f08a780730e90/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 05:09:16,227 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:09:16,227 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1690088796392.50be53dc87e8bcba1c8172066674b195. 2023-07-23 05:09:16,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 50be53dc87e8bcba1c8172066674b195: 2023-07-23 05:09:16,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:09:16,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1690088796392.50be53dc87e8bcba1c8172066674b195. 2023-07-23 05:09:16,228 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690088795537.b436f5555f6fd67c866f08a780730e90. 2023-07-23 05:09:16,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b436f5555f6fd67c866f08a780730e90: 2023-07-23 05:09:16,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1690088795537.b436f5555f6fd67c866f08a780730e90. 2023-07-23 05:09:16,232 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for deb69eb32c5d45f78f7c02f7b79362cc 2023-07-23 05:09:16,247 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/meta/1588230740/.tmp/table/fb9950e56b3c4a36997c06710f732287 2023-07-23 05:09:16,252 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fb9950e56b3c4a36997c06710f732287 2023-07-23 05:09:16,253 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/meta/1588230740/.tmp/info/cfbb80220fc9437da3c3a8ebceefe982 as hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/meta/1588230740/info/cfbb80220fc9437da3c3a8ebceefe982 2023-07-23 05:09:16,261 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cfbb80220fc9437da3c3a8ebceefe982 2023-07-23 05:09:16,261 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/meta/1588230740/info/cfbb80220fc9437da3c3a8ebceefe982, entries=48, sequenceid=131, filesize=10.3 K 2023-07-23 05:09:16,262 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/meta/1588230740/.tmp/rep_barrier/deb69eb32c5d45f78f7c02f7b79362cc as hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/meta/1588230740/rep_barrier/deb69eb32c5d45f78f7c02f7b79362cc 2023-07-23 05:09:16,266 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for deb69eb32c5d45f78f7c02f7b79362cc 2023-07-23 05:09:16,266 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 05:09:16,266 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:37855-0x1019092dbbb0003, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 05:09:16,266 INFO [RS:2;jenkins-hbase4:37855] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37855,1690088792757; zookeeper connection closed. 2023-07-23 05:09:16,266 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/meta/1588230740/rep_barrier/deb69eb32c5d45f78f7c02f7b79362cc, entries=13, sequenceid=131, filesize=6.4 K 2023-07-23 05:09:16,267 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3b2b25eb] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3b2b25eb 2023-07-23 05:09:16,267 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/meta/1588230740/.tmp/table/fb9950e56b3c4a36997c06710f732287 as hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/meta/1588230740/table/fb9950e56b3c4a36997c06710f732287 2023-07-23 05:09:16,273 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fb9950e56b3c4a36997c06710f732287 2023-07-23 05:09:16,273 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/meta/1588230740/table/fb9950e56b3c4a36997c06710f732287, entries=24, sequenceid=131, filesize=6.9 K 2023-07-23 05:09:16,274 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 159ms, sequenceid=131, compaction requested=false 2023-07-23 05:09:16,294 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-23 05:09:16,295 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 05:09:16,295 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-23 05:09:16,296 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-23 05:09:16,296 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-23 05:09:16,296 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-23 05:09:16,313 INFO [RS:0;jenkins-hbase4:45437] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45437,1690088792660; all regions closed. 2023-07-23 05:09:16,313 INFO [RS:1;jenkins-hbase4:44949] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44949,1690088792720; all regions closed. 2023-07-23 05:09:16,321 DEBUG [RS:1;jenkins-hbase4:44949] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/oldWALs 2023-07-23 05:09:16,321 INFO [RS:1;jenkins-hbase4:44949] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44949%2C1690088792720.meta:.meta(num 1690088795140) 2023-07-23 05:09:16,321 DEBUG [RS:0;jenkins-hbase4:45437] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/oldWALs 2023-07-23 05:09:16,322 INFO [RS:0;jenkins-hbase4:45437] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45437%2C1690088792660:(num 1690088794949) 2023-07-23 05:09:16,322 DEBUG [RS:0;jenkins-hbase4:45437] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:09:16,322 INFO [RS:0;jenkins-hbase4:45437] regionserver.LeaseManager(133): Closed leases 2023-07-23 05:09:16,323 INFO [RS:0;jenkins-hbase4:45437] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-23 05:09:16,323 INFO [RS:0;jenkins-hbase4:45437] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-23 05:09:16,323 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-23 05:09:16,323 INFO [RS:0;jenkins-hbase4:45437] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-23 05:09:16,324 INFO [RS:0;jenkins-hbase4:45437] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-23 05:09:16,325 INFO [RS:0;jenkins-hbase4:45437] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45437 2023-07-23 05:09:16,328 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:09:16,328 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 05:09:16,328 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45437,1690088792660 2023-07-23 05:09:16,330 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45437,1690088792660] 2023-07-23 05:09:16,330 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45437,1690088792660; numProcessing=2 2023-07-23 05:09:16,330 DEBUG [RS:1;jenkins-hbase4:44949] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/oldWALs 2023-07-23 05:09:16,330 INFO [RS:1;jenkins-hbase4:44949] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44949%2C1690088792720:(num 1690088794950) 2023-07-23 05:09:16,330 DEBUG [RS:1;jenkins-hbase4:44949] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:09:16,330 INFO [RS:1;jenkins-hbase4:44949] regionserver.LeaseManager(133): Closed leases 2023-07-23 05:09:16,330 INFO [RS:1;jenkins-hbase4:44949] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-23 05:09:16,331 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-23 05:09:16,331 INFO [RS:1;jenkins-hbase4:44949] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44949 2023-07-23 05:09:16,332 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45437,1690088792660 already deleted, retry=false 2023-07-23 05:09:16,332 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45437,1690088792660 expired; onlineServers=1 2023-07-23 05:09:16,334 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44949,1690088792720 2023-07-23 05:09:16,334 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 05:09:16,335 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44949,1690088792720] 2023-07-23 05:09:16,335 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44949,1690088792720; numProcessing=3 2023-07-23 05:09:16,336 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44949,1690088792720 already deleted, retry=false 2023-07-23 05:09:16,336 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44949,1690088792720 expired; onlineServers=0 2023-07-23 05:09:16,336 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,32809,1690088791154' ***** 2023-07-23 05:09:16,336 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-23 05:09:16,336 DEBUG [M:0;jenkins-hbase4:32809] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8c543da, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-23 05:09:16,336 INFO [M:0;jenkins-hbase4:32809] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,32809,1690088791154 2023-07-23 05:09:16,336 INFO [M:0;jenkins-hbase4:32809] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,32809,1690088791154; all regions closed. 2023-07-23 05:09:16,336 DEBUG [M:0;jenkins-hbase4:32809] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 05:09:16,336 DEBUG [M:0;jenkins-hbase4:32809] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-23 05:09:16,336 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-23 05:09:16,336 DEBUG [M:0;jenkins-hbase4:32809] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-23 05:09:16,336 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690088794406] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690088794406,5,FailOnTimeoutGroup] 2023-07-23 05:09:16,336 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690088794406] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690088794406,5,FailOnTimeoutGroup] 2023-07-23 05:09:16,337 INFO [M:0;jenkins-hbase4:32809] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-23 05:09:16,337 INFO [M:0;jenkins-hbase4:32809] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-23 05:09:16,337 INFO [M:0;jenkins-hbase4:32809] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-23 05:09:16,337 DEBUG [M:0;jenkins-hbase4:32809] master.HMaster(1512): Stopping service threads 2023-07-23 05:09:16,337 INFO [M:0;jenkins-hbase4:32809] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-23 05:09:16,337 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-23 05:09:16,337 ERROR [M:0;jenkins-hbase4:32809] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT 2023-07-23 05:09:16,337 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-23 05:09:16,338 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-23 05:09:16,338 INFO [M:0;jenkins-hbase4:32809] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-23 05:09:16,338 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-23 05:09:16,338 DEBUG [M:0;jenkins-hbase4:32809] zookeeper.ZKUtil(398): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-23 05:09:16,339 WARN [M:0;jenkins-hbase4:32809] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-23 05:09:16,339 INFO [M:0;jenkins-hbase4:32809] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-23 05:09:16,339 INFO [M:0;jenkins-hbase4:32809] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-23 05:09:16,339 DEBUG [M:0;jenkins-hbase4:32809] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-23 05:09:16,339 INFO [M:0;jenkins-hbase4:32809] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 05:09:16,339 DEBUG [M:0;jenkins-hbase4:32809] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 05:09:16,339 DEBUG [M:0;jenkins-hbase4:32809] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-23 05:09:16,339 DEBUG [M:0;jenkins-hbase4:32809] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 05:09:16,339 INFO [M:0;jenkins-hbase4:32809] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.86 KB heapSize=452.16 KB 2023-07-23 05:09:16,356 INFO [M:0;jenkins-hbase4:32809] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.86 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/e8fba1f3b6e3446ea74ae4adb24196f8 2023-07-23 05:09:16,361 INFO [M:0;jenkins-hbase4:32809] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e8fba1f3b6e3446ea74ae4adb24196f8 2023-07-23 05:09:16,362 DEBUG [M:0;jenkins-hbase4:32809] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/e8fba1f3b6e3446ea74ae4adb24196f8 as hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/e8fba1f3b6e3446ea74ae4adb24196f8 2023-07-23 05:09:16,366 INFO [M:0;jenkins-hbase4:32809] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e8fba1f3b6e3446ea74ae4adb24196f8 2023-07-23 05:09:16,366 INFO [M:0;jenkins-hbase4:32809] regionserver.HStore(1080): Added hdfs://localhost:38911/user/jenkins/test-data/5160ff72-dc54-e1bd-1be8-db87af14c0dd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/e8fba1f3b6e3446ea74ae4adb24196f8, entries=119, sequenceid=899, filesize=28.7 K 2023-07-23 05:09:16,367 INFO [M:0;jenkins-hbase4:32809] regionserver.HRegion(2948): Finished flush of dataSize ~375.86 KB/384885, heapSize ~452.14 KB/462992, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 28ms, sequenceid=899, compaction requested=false 2023-07-23 05:09:16,369 INFO [M:0;jenkins-hbase4:32809] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 05:09:16,369 DEBUG [M:0;jenkins-hbase4:32809] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-23 05:09:16,374 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-23 05:09:16,374 INFO [M:0;jenkins-hbase4:32809] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-23 05:09:16,374 INFO [M:0;jenkins-hbase4:32809] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:32809 2023-07-23 05:09:16,377 DEBUG [M:0;jenkins-hbase4:32809] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,32809,1690088791154 already deleted, retry=false 2023-07-23 05:09:16,430 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 05:09:16,430 INFO [RS:0;jenkins-hbase4:45437] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45437,1690088792660; zookeeper connection closed. 2023-07-23 05:09:16,430 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1019092dbbb0001, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 05:09:16,430 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5d56774b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5d56774b 2023-07-23 05:09:16,530 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 05:09:16,530 INFO [M:0;jenkins-hbase4:32809] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,32809,1690088791154; zookeeper connection closed. 2023-07-23 05:09:16,530 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): master:32809-0x1019092dbbb0000, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 05:09:16,630 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 05:09:16,630 INFO [RS:1;jenkins-hbase4:44949] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44949,1690088792720; zookeeper connection closed. 2023-07-23 05:09:16,630 DEBUG [Listener at localhost/37217-EventThread] zookeeper.ZKWatcher(600): regionserver:44949-0x1019092dbbb0002, quorum=127.0.0.1:57388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 05:09:16,631 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@11c5e9b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@11c5e9b 2023-07-23 05:09:16,631 INFO [Listener at jenkins-hbase4.apache.org/33827] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-23 05:09:16,632 WARN [Listener at jenkins-hbase4.apache.org/33827] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-23 05:09:16,642 INFO [Listener at jenkins-hbase4.apache.org/33827] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-23 05:09:16,745 WARN [BP-198462209-172.31.14.131-1690088787127 heartbeating to localhost/127.0.0.1:38911] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-23 05:09:16,746 WARN [BP-198462209-172.31.14.131-1690088787127 heartbeating to localhost/127.0.0.1:38911] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-198462209-172.31.14.131-1690088787127 (Datanode Uuid 66f08036-e875-4e1c-807f-72dfe6e3dd5b) service to localhost/127.0.0.1:38911 2023-07-23 05:09:16,748 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/cluster_6208cc7e-f826-e9bd-232f-095b41f2684b/dfs/data/data5/current/BP-198462209-172.31.14.131-1690088787127] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-23 05:09:16,748 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/cluster_6208cc7e-f826-e9bd-232f-095b41f2684b/dfs/data/data6/current/BP-198462209-172.31.14.131-1690088787127] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-23 05:09:16,751 WARN [Listener at jenkins-hbase4.apache.org/33827] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-23 05:09:16,768 INFO [Listener at jenkins-hbase4.apache.org/33827] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-23 05:09:16,774 WARN [BP-198462209-172.31.14.131-1690088787127 heartbeating to localhost/127.0.0.1:38911] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-23 05:09:16,774 WARN [BP-198462209-172.31.14.131-1690088787127 heartbeating to localhost/127.0.0.1:38911] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-198462209-172.31.14.131-1690088787127 (Datanode Uuid 5c98c315-51cd-4a00-834d-484be290f5e1) service to localhost/127.0.0.1:38911 2023-07-23 05:09:16,775 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/cluster_6208cc7e-f826-e9bd-232f-095b41f2684b/dfs/data/data3/current/BP-198462209-172.31.14.131-1690088787127] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-23 05:09:16,775 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/cluster_6208cc7e-f826-e9bd-232f-095b41f2684b/dfs/data/data4/current/BP-198462209-172.31.14.131-1690088787127] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-23 05:09:16,782 WARN [Listener at jenkins-hbase4.apache.org/33827] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-23 05:09:16,809 INFO [Listener at jenkins-hbase4.apache.org/33827] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-23 05:09:16,812 WARN [BP-198462209-172.31.14.131-1690088787127 heartbeating to localhost/127.0.0.1:38911] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-23 05:09:16,812 WARN [BP-198462209-172.31.14.131-1690088787127 heartbeating to localhost/127.0.0.1:38911] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-198462209-172.31.14.131-1690088787127 (Datanode Uuid f8c0bac9-7d8b-4c0a-8f24-8f087d075de8) service to localhost/127.0.0.1:38911 2023-07-23 05:09:16,813 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/cluster_6208cc7e-f826-e9bd-232f-095b41f2684b/dfs/data/data1/current/BP-198462209-172.31.14.131-1690088787127] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-23 05:09:16,813 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8c7f3973-1747-fc5d-525c-6bb9b5f6c555/cluster_6208cc7e-f826-e9bd-232f-095b41f2684b/dfs/data/data2/current/BP-198462209-172.31.14.131-1690088787127] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-23 05:09:16,888 INFO [Listener at jenkins-hbase4.apache.org/33827] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-23 05:09:16,929 INFO [Listener at jenkins-hbase4.apache.org/33827] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-23 05:09:17,084 INFO [Listener at jenkins-hbase4.apache.org/33827] hbase.HBaseTestingUtility(1293): Minicluster is down