2023-07-20 12:10:20,153 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-20 12:10:20,472 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1 2023-07-20 12:10:20,472 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-20 12:10:20,472 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-20 12:10:20,518 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-20 12:10:20,881 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-20 12:10:20,882 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/cluster_516f25e7-6d47-16d0-f492-9f19a2a0360c, deleteOnExit=true 2023-07-20 12:10:20,882 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-20 12:10:20,883 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/test.cache.data in system properties and HBase conf 2023-07-20 12:10:20,884 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/hadoop.tmp.dir in system properties and HBase conf 2023-07-20 12:10:20,884 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/hadoop.log.dir in system properties and HBase conf 2023-07-20 12:10:20,885 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-20 12:10:20,885 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-20 12:10:20,886 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-20 12:10:21,390 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-20 12:10:21,397 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-20 12:10:21,398 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-20 12:10:21,398 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-20 12:10:21,399 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-20 12:10:21,399 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-20 12:10:21,400 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-20 12:10:21,400 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-20 12:10:21,401 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-20 12:10:21,401 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-20 12:10:21,402 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/nfs.dump.dir in system properties and HBase conf 2023-07-20 12:10:21,402 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/java.io.tmpdir in system properties and HBase conf 2023-07-20 12:10:21,402 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-20 12:10:21,403 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-20 12:10:21,403 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-20 12:10:22,117 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-20 12:10:22,122 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-20 12:10:22,536 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-20 12:10:22,763 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-20 12:10:22,785 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 12:10:22,839 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 12:10:22,913 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/java.io.tmpdir/Jetty_localhost_43893_hdfs____.ll89gj/webapp 2023-07-20 12:10:23,081 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43893 2023-07-20 12:10:23,096 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-20 12:10:23,096 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-20 12:10:23,802 WARN [Listener at localhost/37499] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-20 12:10:23,963 WARN [Listener at localhost/37499] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-20 12:10:24,039 WARN [Listener at localhost/37499] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 12:10:24,047 INFO [Listener at localhost/37499] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 12:10:24,057 INFO [Listener at localhost/37499] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/java.io.tmpdir/Jetty_localhost_37503_datanode____.t9sged/webapp 2023-07-20 12:10:24,216 INFO [Listener at localhost/37499] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37503 2023-07-20 12:10:24,859 WARN [Listener at localhost/42529] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-20 12:10:24,996 WARN [Listener at localhost/42529] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-20 12:10:25,006 WARN [Listener at localhost/42529] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 12:10:25,009 INFO [Listener at localhost/42529] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 12:10:25,018 INFO [Listener at localhost/42529] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/java.io.tmpdir/Jetty_localhost_33769_datanode____.owxd8f/webapp 2023-07-20 12:10:25,174 INFO [Listener at localhost/42529] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33769 2023-07-20 12:10:25,198 WARN [Listener at localhost/43709] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-20 12:10:25,245 WARN [Listener at localhost/43709] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-20 12:10:25,252 WARN [Listener at localhost/43709] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 12:10:25,254 INFO [Listener at localhost/43709] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 12:10:25,264 INFO [Listener at localhost/43709] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/java.io.tmpdir/Jetty_localhost_44809_datanode____.6wqhug/webapp 2023-07-20 12:10:25,475 INFO [Listener at localhost/43709] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44809 2023-07-20 12:10:25,517 WARN [Listener at localhost/39119] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-20 12:10:25,785 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc7bd1a93da8aefa3: Processing first storage report for DS-a0c76932-b70b-4aa4-ad34-d821d3a28262 from datanode aaa995f7-8b66-4bfe-bda3-962061aec446 2023-07-20 12:10:25,787 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc7bd1a93da8aefa3: from storage DS-a0c76932-b70b-4aa4-ad34-d821d3a28262 node DatanodeRegistration(127.0.0.1:34551, datanodeUuid=aaa995f7-8b66-4bfe-bda3-962061aec446, infoPort=36281, infoSecurePort=0, ipcPort=43709, storageInfo=lv=-57;cid=testClusterID;nsid=222882310;c=1689855022221), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-20 12:10:25,788 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc7bd1a93da8aefa3: Processing first storage report for DS-2d7a3faa-239c-4c95-93b7-3f6beeb0898d from datanode aaa995f7-8b66-4bfe-bda3-962061aec446 2023-07-20 12:10:25,789 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc7bd1a93da8aefa3: from storage DS-2d7a3faa-239c-4c95-93b7-3f6beeb0898d node DatanodeRegistration(127.0.0.1:34551, datanodeUuid=aaa995f7-8b66-4bfe-bda3-962061aec446, infoPort=36281, infoSecurePort=0, ipcPort=43709, storageInfo=lv=-57;cid=testClusterID;nsid=222882310;c=1689855022221), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-20 12:10:25,789 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb22497173b5e2ec0: Processing first storage report for DS-85760d8e-ddaf-4be2-ba32-339472e101fd from datanode 6896c29f-600a-471c-b7e5-7087f9722f48 2023-07-20 12:10:25,789 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb22497173b5e2ec0: from storage DS-85760d8e-ddaf-4be2-ba32-339472e101fd node DatanodeRegistration(127.0.0.1:32925, datanodeUuid=6896c29f-600a-471c-b7e5-7087f9722f48, infoPort=38647, infoSecurePort=0, ipcPort=42529, storageInfo=lv=-57;cid=testClusterID;nsid=222882310;c=1689855022221), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-20 12:10:25,789 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf85aac4ef9f25706: Processing first storage report for DS-ff7b0a6d-5365-46d3-9130-f6fc25d1c384 from datanode a44f1ad5-183f-40ac-8f6b-893082a89699 2023-07-20 12:10:25,789 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf85aac4ef9f25706: from storage DS-ff7b0a6d-5365-46d3-9130-f6fc25d1c384 node DatanodeRegistration(127.0.0.1:42507, datanodeUuid=a44f1ad5-183f-40ac-8f6b-893082a89699, infoPort=34599, infoSecurePort=0, ipcPort=39119, storageInfo=lv=-57;cid=testClusterID;nsid=222882310;c=1689855022221), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-20 12:10:25,789 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb22497173b5e2ec0: Processing first storage report for DS-35ecb79f-b809-4124-b01d-8c7e5b25c148 from datanode 6896c29f-600a-471c-b7e5-7087f9722f48 2023-07-20 12:10:25,789 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb22497173b5e2ec0: from storage DS-35ecb79f-b809-4124-b01d-8c7e5b25c148 node DatanodeRegistration(127.0.0.1:32925, datanodeUuid=6896c29f-600a-471c-b7e5-7087f9722f48, infoPort=38647, infoSecurePort=0, ipcPort=42529, storageInfo=lv=-57;cid=testClusterID;nsid=222882310;c=1689855022221), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-20 12:10:25,790 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf85aac4ef9f25706: Processing first storage report for DS-1cc45459-72af-44ca-9068-ce3741d547b9 from datanode a44f1ad5-183f-40ac-8f6b-893082a89699 2023-07-20 12:10:25,790 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf85aac4ef9f25706: from storage DS-1cc45459-72af-44ca-9068-ce3741d547b9 node DatanodeRegistration(127.0.0.1:42507, datanodeUuid=a44f1ad5-183f-40ac-8f6b-893082a89699, infoPort=34599, infoSecurePort=0, ipcPort=39119, storageInfo=lv=-57;cid=testClusterID;nsid=222882310;c=1689855022221), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-20 12:10:26,119 DEBUG [Listener at localhost/39119] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1 2023-07-20 12:10:26,211 INFO [Listener at localhost/39119] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/cluster_516f25e7-6d47-16d0-f492-9f19a2a0360c/zookeeper_0, clientPort=59849, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/cluster_516f25e7-6d47-16d0-f492-9f19a2a0360c/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/cluster_516f25e7-6d47-16d0-f492-9f19a2a0360c/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-20 12:10:26,237 INFO [Listener at localhost/39119] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=59849 2023-07-20 12:10:26,246 INFO [Listener at localhost/39119] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 12:10:26,249 INFO [Listener at localhost/39119] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 12:10:26,963 INFO [Listener at localhost/39119] util.FSUtils(471): Created version file at hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc with version=8 2023-07-20 12:10:26,963 INFO [Listener at localhost/39119] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/hbase-staging 2023-07-20 12:10:27,350 INFO [Listener at localhost/39119] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-20 12:10:27,996 INFO [Listener at localhost/39119] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-20 12:10:28,035 INFO [Listener at localhost/39119] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 12:10:28,036 INFO [Listener at localhost/39119] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-20 12:10:28,036 INFO [Listener at localhost/39119] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-20 12:10:28,036 INFO [Listener at localhost/39119] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 12:10:28,036 INFO [Listener at localhost/39119] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-20 12:10:28,203 INFO [Listener at localhost/39119] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-20 12:10:28,301 DEBUG [Listener at localhost/39119] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-20 12:10:28,414 INFO [Listener at localhost/39119] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46247 2023-07-20 12:10:28,429 INFO [Listener at localhost/39119] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 12:10:28,432 INFO [Listener at localhost/39119] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 12:10:28,461 INFO [Listener at localhost/39119] zookeeper.RecoverableZooKeeper(93): Process identifier=master:46247 connecting to ZooKeeper ensemble=127.0.0.1:59849 2023-07-20 12:10:28,536 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:462470x0, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-20 12:10:28,548 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:46247-0x10182a3e70e0000 connected 2023-07-20 12:10:28,611 DEBUG [Listener at localhost/39119] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-20 12:10:28,612 DEBUG [Listener at localhost/39119] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 12:10:28,630 DEBUG [Listener at localhost/39119] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-20 12:10:28,650 DEBUG [Listener at localhost/39119] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46247 2023-07-20 12:10:28,654 DEBUG [Listener at localhost/39119] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46247 2023-07-20 12:10:28,656 DEBUG [Listener at localhost/39119] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46247 2023-07-20 12:10:28,658 DEBUG [Listener at localhost/39119] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46247 2023-07-20 12:10:28,662 DEBUG [Listener at localhost/39119] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46247 2023-07-20 12:10:28,672 INFO [Listener at localhost/39119] master.HMaster(444): hbase.rootdir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc, hbase.cluster.distributed=false 2023-07-20 12:10:28,765 INFO [Listener at localhost/39119] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-20 12:10:28,766 INFO [Listener at localhost/39119] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 12:10:28,766 INFO [Listener at localhost/39119] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-20 12:10:28,766 INFO [Listener at localhost/39119] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-20 12:10:28,766 INFO [Listener at localhost/39119] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 12:10:28,766 INFO [Listener at localhost/39119] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-20 12:10:28,771 INFO [Listener at localhost/39119] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-20 12:10:28,775 INFO [Listener at localhost/39119] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41865 2023-07-20 12:10:28,778 INFO [Listener at localhost/39119] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-20 12:10:28,784 INFO [Listener at localhost/39119] mob.MobFileCache(124): MobFileCache disabled 2023-07-20 12:10:28,786 INFO [Listener at localhost/39119] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 12:10:28,788 INFO [Listener at localhost/39119] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 12:10:28,790 INFO [Listener at localhost/39119] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41865 connecting to ZooKeeper ensemble=127.0.0.1:59849 2023-07-20 12:10:28,794 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:418650x0, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-20 12:10:28,795 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41865-0x10182a3e70e0001 connected 2023-07-20 12:10:28,796 DEBUG [Listener at localhost/39119] zookeeper.ZKUtil(164): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-20 12:10:28,797 DEBUG [Listener at localhost/39119] zookeeper.ZKUtil(164): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 12:10:28,798 DEBUG [Listener at localhost/39119] zookeeper.ZKUtil(164): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-20 12:10:28,798 DEBUG [Listener at localhost/39119] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41865 2023-07-20 12:10:28,799 DEBUG [Listener at localhost/39119] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41865 2023-07-20 12:10:28,803 DEBUG [Listener at localhost/39119] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41865 2023-07-20 12:10:28,803 DEBUG [Listener at localhost/39119] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41865 2023-07-20 12:10:28,803 DEBUG [Listener at localhost/39119] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41865 2023-07-20 12:10:28,826 INFO [Listener at localhost/39119] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-20 12:10:28,826 INFO [Listener at localhost/39119] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 12:10:28,826 INFO [Listener at localhost/39119] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-20 12:10:28,827 INFO [Listener at localhost/39119] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-20 12:10:28,828 INFO [Listener at localhost/39119] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 12:10:28,828 INFO [Listener at localhost/39119] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-20 12:10:28,828 INFO [Listener at localhost/39119] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-20 12:10:28,830 INFO [Listener at localhost/39119] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39003 2023-07-20 12:10:28,830 INFO [Listener at localhost/39119] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-20 12:10:28,832 INFO [Listener at localhost/39119] mob.MobFileCache(124): MobFileCache disabled 2023-07-20 12:10:28,832 INFO [Listener at localhost/39119] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 12:10:28,835 INFO [Listener at localhost/39119] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 12:10:28,840 INFO [Listener at localhost/39119] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39003 connecting to ZooKeeper ensemble=127.0.0.1:59849 2023-07-20 12:10:28,854 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:390030x0, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-20 12:10:28,858 DEBUG [Listener at localhost/39119] zookeeper.ZKUtil(164): regionserver:390030x0, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-20 12:10:28,859 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39003-0x10182a3e70e0002 connected 2023-07-20 12:10:28,859 DEBUG [Listener at localhost/39119] zookeeper.ZKUtil(164): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 12:10:28,860 DEBUG [Listener at localhost/39119] zookeeper.ZKUtil(164): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-20 12:10:28,862 DEBUG [Listener at localhost/39119] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39003 2023-07-20 12:10:28,863 DEBUG [Listener at localhost/39119] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39003 2023-07-20 12:10:28,871 DEBUG [Listener at localhost/39119] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39003 2023-07-20 12:10:28,875 DEBUG [Listener at localhost/39119] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39003 2023-07-20 12:10:28,875 DEBUG [Listener at localhost/39119] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39003 2023-07-20 12:10:28,889 INFO [Listener at localhost/39119] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-20 12:10:28,890 INFO [Listener at localhost/39119] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 12:10:28,890 INFO [Listener at localhost/39119] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-20 12:10:28,890 INFO [Listener at localhost/39119] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-20 12:10:28,890 INFO [Listener at localhost/39119] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 12:10:28,890 INFO [Listener at localhost/39119] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-20 12:10:28,890 INFO [Listener at localhost/39119] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-20 12:10:28,895 INFO [Listener at localhost/39119] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43611 2023-07-20 12:10:28,895 INFO [Listener at localhost/39119] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-20 12:10:28,896 INFO [Listener at localhost/39119] mob.MobFileCache(124): MobFileCache disabled 2023-07-20 12:10:28,898 INFO [Listener at localhost/39119] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 12:10:28,900 INFO [Listener at localhost/39119] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 12:10:28,901 INFO [Listener at localhost/39119] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43611 connecting to ZooKeeper ensemble=127.0.0.1:59849 2023-07-20 12:10:28,907 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:436110x0, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-20 12:10:28,908 DEBUG [Listener at localhost/39119] zookeeper.ZKUtil(164): regionserver:436110x0, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-20 12:10:28,909 DEBUG [Listener at localhost/39119] zookeeper.ZKUtil(164): regionserver:436110x0, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 12:10:28,910 DEBUG [Listener at localhost/39119] zookeeper.ZKUtil(164): regionserver:436110x0, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-20 12:10:28,911 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43611-0x10182a3e70e0003 connected 2023-07-20 12:10:28,915 DEBUG [Listener at localhost/39119] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43611 2023-07-20 12:10:28,915 DEBUG [Listener at localhost/39119] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43611 2023-07-20 12:10:28,918 DEBUG [Listener at localhost/39119] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43611 2023-07-20 12:10:28,922 DEBUG [Listener at localhost/39119] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43611 2023-07-20 12:10:28,923 DEBUG [Listener at localhost/39119] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43611 2023-07-20 12:10:28,926 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,46247,1689855027157 2023-07-20 12:10:28,939 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-20 12:10:28,941 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,46247,1689855027157 2023-07-20 12:10:28,964 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-20 12:10:28,964 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-20 12:10:28,964 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-20 12:10:28,964 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-20 12:10:28,965 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 12:10:28,966 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-20 12:10:28,968 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,46247,1689855027157 from backup master directory 2023-07-20 12:10:28,968 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-20 12:10:28,973 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,46247,1689855027157 2023-07-20 12:10:28,973 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-20 12:10:28,973 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-20 12:10:28,974 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,46247,1689855027157 2023-07-20 12:10:28,978 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-20 12:10:28,979 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-20 12:10:29,107 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/hbase.id with ID: fd5f1058-d587-4ed1-b193-d1fcffe9ec85 2023-07-20 12:10:29,175 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 12:10:29,209 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 12:10:29,287 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x60a6497b to 127.0.0.1:59849 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 12:10:29,341 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5efa924c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 12:10:29,374 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-20 12:10:29,377 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-20 12:10:29,410 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-20 12:10:29,410 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-20 12:10:29,413 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-20 12:10:29,420 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-20 12:10:29,422 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-20 12:10:29,464 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/MasterData/data/master/store-tmp 2023-07-20 12:10:29,536 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 12:10:29,536 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-20 12:10:29,536 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 12:10:29,536 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 12:10:29,537 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-20 12:10:29,537 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 12:10:29,537 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 12:10:29,537 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-20 12:10:29,539 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/MasterData/WALs/jenkins-hbase4.apache.org,46247,1689855027157 2023-07-20 12:10:29,570 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46247%2C1689855027157, suffix=, logDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/MasterData/WALs/jenkins-hbase4.apache.org,46247,1689855027157, archiveDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/MasterData/oldWALs, maxLogs=10 2023-07-20 12:10:29,652 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32925,DS-85760d8e-ddaf-4be2-ba32-339472e101fd,DISK] 2023-07-20 12:10:29,652 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42507,DS-ff7b0a6d-5365-46d3-9130-f6fc25d1c384,DISK] 2023-07-20 12:10:29,652 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34551,DS-a0c76932-b70b-4aa4-ad34-d821d3a28262,DISK] 2023-07-20 12:10:29,661 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-20 12:10:29,741 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/MasterData/WALs/jenkins-hbase4.apache.org,46247,1689855027157/jenkins-hbase4.apache.org%2C46247%2C1689855027157.1689855029586 2023-07-20 12:10:29,742 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34551,DS-a0c76932-b70b-4aa4-ad34-d821d3a28262,DISK], DatanodeInfoWithStorage[127.0.0.1:32925,DS-85760d8e-ddaf-4be2-ba32-339472e101fd,DISK], DatanodeInfoWithStorage[127.0.0.1:42507,DS-ff7b0a6d-5365-46d3-9130-f6fc25d1c384,DISK]] 2023-07-20 12:10:29,742 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-20 12:10:29,743 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 12:10:29,746 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-20 12:10:29,747 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-20 12:10:29,827 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-20 12:10:29,858 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-20 12:10:29,891 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-20 12:10:29,904 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 12:10:29,912 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-20 12:10:29,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-20 12:10:29,934 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-20 12:10:29,945 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 12:10:29,947 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64297530, jitterRate=-0.04189214110374451}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 12:10:29,947 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-20 12:10:29,953 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-20 12:10:29,979 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-20 12:10:29,979 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-20 12:10:29,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-20 12:10:29,985 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-20 12:10:30,027 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 42 msec 2023-07-20 12:10:30,027 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-20 12:10:30,075 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-20 12:10:30,083 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-20 12:10:30,110 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-20 12:10:30,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-20 12:10:30,116 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-20 12:10:30,123 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-20 12:10:30,128 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-20 12:10:30,134 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 12:10:30,138 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-20 12:10:30,139 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-20 12:10:30,154 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-20 12:10:30,159 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-20 12:10:30,159 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-20 12:10:30,159 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-20 12:10:30,159 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-20 12:10:30,159 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 12:10:30,161 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,46247,1689855027157, sessionid=0x10182a3e70e0000, setting cluster-up flag (Was=false) 2023-07-20 12:10:30,188 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 12:10:30,205 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-20 12:10:30,211 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46247,1689855027157 2023-07-20 12:10:30,218 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 12:10:30,227 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-20 12:10:30,229 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46247,1689855027157 2023-07-20 12:10:30,232 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp 2023-07-20 12:10:30,336 INFO [RS:1;jenkins-hbase4:39003] regionserver.HRegionServer(951): ClusterId : fd5f1058-d587-4ed1-b193-d1fcffe9ec85 2023-07-20 12:10:30,336 INFO [RS:0;jenkins-hbase4:41865] regionserver.HRegionServer(951): ClusterId : fd5f1058-d587-4ed1-b193-d1fcffe9ec85 2023-07-20 12:10:30,339 INFO [RS:2;jenkins-hbase4:43611] regionserver.HRegionServer(951): ClusterId : fd5f1058-d587-4ed1-b193-d1fcffe9ec85 2023-07-20 12:10:30,343 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-20 12:10:30,346 DEBUG [RS:0;jenkins-hbase4:41865] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-20 12:10:30,346 DEBUG [RS:2;jenkins-hbase4:43611] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-20 12:10:30,346 DEBUG [RS:1;jenkins-hbase4:39003] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-20 12:10:30,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 12:10:30,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-20 12:10:30,353 DEBUG [RS:2;jenkins-hbase4:43611] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-20 12:10:30,353 DEBUG [RS:1;jenkins-hbase4:39003] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-20 12:10:30,353 DEBUG [RS:0;jenkins-hbase4:41865] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-20 12:10:30,353 DEBUG [RS:1;jenkins-hbase4:39003] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-20 12:10:30,353 DEBUG [RS:2;jenkins-hbase4:43611] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-20 12:10:30,353 DEBUG [RS:0;jenkins-hbase4:41865] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-20 12:10:30,358 DEBUG [RS:0;jenkins-hbase4:41865] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-20 12:10:30,358 DEBUG [RS:1;jenkins-hbase4:39003] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-20 12:10:30,360 DEBUG [RS:1;jenkins-hbase4:39003] zookeeper.ReadOnlyZKClient(139): Connect 0x33a2ea7f to 127.0.0.1:59849 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 12:10:30,360 DEBUG [RS:2;jenkins-hbase4:43611] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-20 12:10:30,360 DEBUG [RS:0;jenkins-hbase4:41865] zookeeper.ReadOnlyZKClient(139): Connect 0x7cd5a480 to 127.0.0.1:59849 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 12:10:30,369 DEBUG [RS:2;jenkins-hbase4:43611] zookeeper.ReadOnlyZKClient(139): Connect 0x5deae49f to 127.0.0.1:59849 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 12:10:30,396 DEBUG [RS:1;jenkins-hbase4:39003] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d65027b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 12:10:30,397 DEBUG [RS:0;jenkins-hbase4:41865] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7212456a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 12:10:30,397 DEBUG [RS:1;jenkins-hbase4:39003] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@395a810f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-20 12:10:30,397 DEBUG [RS:0;jenkins-hbase4:41865] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@762dcff0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-20 12:10:30,400 DEBUG [RS:2;jenkins-hbase4:43611] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@532d0152, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 12:10:30,400 DEBUG [RS:2;jenkins-hbase4:43611] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12100b69, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-20 12:10:30,426 DEBUG [RS:1;jenkins-hbase4:39003] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:39003 2023-07-20 12:10:30,427 DEBUG [RS:2;jenkins-hbase4:43611] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:43611 2023-07-20 12:10:30,428 DEBUG [RS:0;jenkins-hbase4:41865] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:41865 2023-07-20 12:10:30,433 INFO [RS:2;jenkins-hbase4:43611] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-20 12:10:30,433 INFO [RS:0;jenkins-hbase4:41865] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-20 12:10:30,433 INFO [RS:1;jenkins-hbase4:39003] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-20 12:10:30,434 INFO [RS:1;jenkins-hbase4:39003] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-20 12:10:30,434 INFO [RS:0;jenkins-hbase4:41865] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-20 12:10:30,434 INFO [RS:2;jenkins-hbase4:43611] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-20 12:10:30,434 DEBUG [RS:1;jenkins-hbase4:39003] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-20 12:10:30,434 DEBUG [RS:2;jenkins-hbase4:43611] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-20 12:10:30,436 INFO [RS:2;jenkins-hbase4:43611] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 12:10:30,436 DEBUG [RS:2;jenkins-hbase4:43611] regionserver.HRegionServer(1022): About to register with Master. 2023-07-20 12:10:30,434 DEBUG [RS:0;jenkins-hbase4:41865] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-20 12:10:30,435 INFO [RS:1;jenkins-hbase4:39003] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 12:10:30,438 DEBUG [RS:1;jenkins-hbase4:39003] regionserver.HRegionServer(1022): About to register with Master. 2023-07-20 12:10:30,438 INFO [RS:0;jenkins-hbase4:41865] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 12:10:30,439 DEBUG [RS:0;jenkins-hbase4:41865] regionserver.HRegionServer(1022): About to register with Master. 2023-07-20 12:10:30,439 INFO [RS:2;jenkins-hbase4:43611] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46247,1689855027157 with isa=jenkins-hbase4.apache.org/172.31.14.131:43611, startcode=1689855028889 2023-07-20 12:10:30,439 INFO [RS:0;jenkins-hbase4:41865] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46247,1689855027157 with isa=jenkins-hbase4.apache.org/172.31.14.131:41865, startcode=1689855028765 2023-07-20 12:10:30,439 INFO [RS:1;jenkins-hbase4:39003] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46247,1689855027157 with isa=jenkins-hbase4.apache.org/172.31.14.131:39003, startcode=1689855028825 2023-07-20 12:10:30,463 DEBUG [RS:2;jenkins-hbase4:43611] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-20 12:10:30,465 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-20 12:10:30,466 DEBUG [RS:1;jenkins-hbase4:39003] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-20 12:10:30,465 DEBUG [RS:0;jenkins-hbase4:41865] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-20 12:10:30,480 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-20 12:10:30,481 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-20 12:10:30,481 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-20 12:10:30,481 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-20 12:10:30,481 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-20 12:10:30,481 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 12:10:30,481 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-20 12:10:30,481 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 12:10:30,485 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689855060485 2023-07-20 12:10:30,511 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-20 12:10:30,517 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-20 12:10:30,527 INFO [PEWorker-2] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-20 12:10:30,536 INFO [PEWorker-2] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-20 12:10:30,541 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-20 12:10:30,553 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-20 12:10:30,554 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-20 12:10:30,555 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-20 12:10:30,555 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-20 12:10:30,560 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-20 12:10:30,562 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-20 12:10:30,565 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-20 12:10:30,565 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-20 12:10:30,571 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-20 12:10:30,571 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-20 12:10:30,574 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689855030573,5,FailOnTimeoutGroup] 2023-07-20 12:10:30,576 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33459, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-20 12:10:30,576 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52025, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-20 12:10:30,576 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43091, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-20 12:10:30,579 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689855030575,5,FailOnTimeoutGroup] 2023-07-20 12:10:30,580 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-20 12:10:30,580 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-20 12:10:30,582 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-20 12:10:30,583 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-20 12:10:30,596 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46247] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:30,627 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46247] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:30,629 DEBUG [RS:0;jenkins-hbase4:41865] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc 2023-07-20 12:10:30,629 DEBUG [RS:0;jenkins-hbase4:41865] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37499 2023-07-20 12:10:30,629 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46247] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:30,629 DEBUG [RS:0;jenkins-hbase4:41865] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-20 12:10:30,650 DEBUG [RS:1;jenkins-hbase4:39003] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc 2023-07-20 12:10:30,650 DEBUG [RS:1;jenkins-hbase4:39003] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37499 2023-07-20 12:10:30,650 DEBUG [RS:1;jenkins-hbase4:39003] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-20 12:10:30,657 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 12:10:30,662 DEBUG [RS:1;jenkins-hbase4:39003] zookeeper.ZKUtil(162): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:30,663 DEBUG [RS:0;jenkins-hbase4:41865] zookeeper.ZKUtil(162): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:30,663 WARN [RS:1;jenkins-hbase4:39003] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-20 12:10:30,681 INFO [RS:1;jenkins-hbase4:39003] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-20 12:10:30,681 DEBUG [RS:1;jenkins-hbase4:39003] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/WALs/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:30,663 WARN [RS:0;jenkins-hbase4:41865] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-20 12:10:30,681 DEBUG [RS:2;jenkins-hbase4:43611] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc 2023-07-20 12:10:30,681 DEBUG [RS:2;jenkins-hbase4:43611] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37499 2023-07-20 12:10:30,681 DEBUG [RS:2;jenkins-hbase4:43611] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-20 12:10:30,685 DEBUG [RS:2;jenkins-hbase4:43611] zookeeper.ZKUtil(162): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:30,685 WARN [RS:2;jenkins-hbase4:43611] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-20 12:10:30,681 INFO [RS:0;jenkins-hbase4:41865] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-20 12:10:30,686 DEBUG [RS:0;jenkins-hbase4:41865] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/WALs/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:30,685 INFO [RS:2;jenkins-hbase4:43611] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-20 12:10:30,691 DEBUG [RS:2;jenkins-hbase4:43611] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/WALs/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:30,699 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41865,1689855028765] 2023-07-20 12:10:30,699 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39003,1689855028825] 2023-07-20 12:10:30,699 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43611,1689855028889] 2023-07-20 12:10:30,728 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-20 12:10:30,729 INFO [PEWorker-2] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-20 12:10:30,729 INFO [PEWorker-2] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc 2023-07-20 12:10:30,732 DEBUG [RS:0;jenkins-hbase4:41865] zookeeper.ZKUtil(162): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:30,733 DEBUG [RS:2;jenkins-hbase4:43611] zookeeper.ZKUtil(162): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:30,733 DEBUG [RS:0;jenkins-hbase4:41865] zookeeper.ZKUtil(162): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:30,733 DEBUG [RS:2;jenkins-hbase4:43611] zookeeper.ZKUtil(162): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:30,733 DEBUG [RS:1;jenkins-hbase4:39003] zookeeper.ZKUtil(162): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:30,734 DEBUG [RS:0;jenkins-hbase4:41865] zookeeper.ZKUtil(162): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:30,734 DEBUG [RS:2;jenkins-hbase4:43611] zookeeper.ZKUtil(162): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:30,734 DEBUG [RS:1;jenkins-hbase4:39003] zookeeper.ZKUtil(162): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:30,735 DEBUG [RS:1;jenkins-hbase4:39003] zookeeper.ZKUtil(162): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:30,748 DEBUG [RS:0;jenkins-hbase4:41865] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-20 12:10:30,748 DEBUG [RS:2;jenkins-hbase4:43611] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-20 12:10:30,748 DEBUG [RS:1;jenkins-hbase4:39003] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-20 12:10:30,766 INFO [RS:1;jenkins-hbase4:39003] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-20 12:10:30,766 INFO [RS:2;jenkins-hbase4:43611] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-20 12:10:30,766 INFO [RS:0;jenkins-hbase4:41865] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-20 12:10:30,784 DEBUG [PEWorker-2] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 12:10:30,793 INFO [RS:1;jenkins-hbase4:39003] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-20 12:10:30,793 INFO [RS:0;jenkins-hbase4:41865] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-20 12:10:30,797 INFO [RS:2;jenkins-hbase4:43611] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-20 12:10:30,799 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-20 12:10:30,813 INFO [RS:0;jenkins-hbase4:41865] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-20 12:10:30,813 INFO [RS:1;jenkins-hbase4:39003] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-20 12:10:30,813 INFO [RS:0;jenkins-hbase4:41865] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 12:10:30,813 INFO [RS:2;jenkins-hbase4:43611] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-20 12:10:30,820 INFO [RS:2;jenkins-hbase4:43611] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 12:10:30,813 INFO [RS:1;jenkins-hbase4:39003] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 12:10:30,820 INFO [RS:0;jenkins-hbase4:41865] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-20 12:10:30,834 INFO [RS:1;jenkins-hbase4:39003] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-20 12:10:30,835 INFO [RS:2;jenkins-hbase4:43611] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-20 12:10:30,843 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/meta/1588230740/info 2023-07-20 12:10:30,844 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-20 12:10:30,845 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 12:10:30,846 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-20 12:10:30,855 INFO [RS:2;jenkins-hbase4:43611] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-20 12:10:30,856 INFO [RS:1;jenkins-hbase4:39003] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-20 12:10:30,856 DEBUG [RS:2;jenkins-hbase4:43611] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 12:10:30,856 DEBUG [RS:2;jenkins-hbase4:43611] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 12:10:30,856 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/meta/1588230740/rep_barrier 2023-07-20 12:10:30,856 INFO [RS:0;jenkins-hbase4:41865] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-20 12:10:30,856 DEBUG [RS:2;jenkins-hbase4:43611] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 12:10:30,857 DEBUG [RS:2;jenkins-hbase4:43611] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 12:10:30,857 DEBUG [RS:2;jenkins-hbase4:43611] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 12:10:30,857 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-20 12:10:30,857 DEBUG [RS:2;jenkins-hbase4:43611] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-20 12:10:30,857 DEBUG [RS:2;jenkins-hbase4:43611] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 12:10:30,858 DEBUG [RS:2;jenkins-hbase4:43611] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 12:10:30,858 DEBUG [RS:2;jenkins-hbase4:43611] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 12:10:30,858 DEBUG [RS:2;jenkins-hbase4:43611] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 12:10:30,858 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 12:10:30,857 DEBUG [RS:0;jenkins-hbase4:41865] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 12:10:30,856 DEBUG [RS:1;jenkins-hbase4:39003] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 12:10:30,868 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-20 12:10:30,868 DEBUG [RS:1;jenkins-hbase4:39003] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 12:10:30,868 DEBUG [RS:0;jenkins-hbase4:41865] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 12:10:30,868 DEBUG [RS:1;jenkins-hbase4:39003] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 12:10:30,869 DEBUG [RS:0;jenkins-hbase4:41865] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 12:10:30,869 DEBUG [RS:1;jenkins-hbase4:39003] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 12:10:30,869 DEBUG [RS:0;jenkins-hbase4:41865] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 12:10:30,869 DEBUG [RS:1;jenkins-hbase4:39003] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 12:10:30,869 DEBUG [RS:0;jenkins-hbase4:41865] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 12:10:30,869 DEBUG [RS:1;jenkins-hbase4:39003] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-20 12:10:30,869 DEBUG [RS:0;jenkins-hbase4:41865] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-20 12:10:30,869 DEBUG [RS:1;jenkins-hbase4:39003] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 12:10:30,869 DEBUG [RS:0;jenkins-hbase4:41865] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 12:10:30,869 DEBUG [RS:1;jenkins-hbase4:39003] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 12:10:30,869 DEBUG [RS:0;jenkins-hbase4:41865] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 12:10:30,869 DEBUG [RS:1;jenkins-hbase4:39003] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 12:10:30,870 DEBUG [RS:0;jenkins-hbase4:41865] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 12:10:30,870 DEBUG [RS:1;jenkins-hbase4:39003] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 12:10:30,870 DEBUG [RS:0;jenkins-hbase4:41865] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 12:10:30,876 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/meta/1588230740/table 2023-07-20 12:10:30,876 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-20 12:10:30,879 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 12:10:30,881 INFO [RS:2;jenkins-hbase4:43611] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-20 12:10:30,882 INFO [RS:2;jenkins-hbase4:43611] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-20 12:10:30,882 INFO [RS:2;jenkins-hbase4:43611] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-20 12:10:30,886 DEBUG [PEWorker-2] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/meta/1588230740 2023-07-20 12:10:30,886 INFO [RS:1;jenkins-hbase4:39003] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-20 12:10:30,887 DEBUG [PEWorker-2] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/meta/1588230740 2023-07-20 12:10:30,887 INFO [RS:1;jenkins-hbase4:39003] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-20 12:10:30,887 INFO [RS:1;jenkins-hbase4:39003] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-20 12:10:30,892 DEBUG [PEWorker-2] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-20 12:10:30,894 DEBUG [PEWorker-2] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-20 12:10:30,899 INFO [RS:0;jenkins-hbase4:41865] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-20 12:10:30,899 INFO [RS:0;jenkins-hbase4:41865] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-20 12:10:30,900 INFO [RS:0;jenkins-hbase4:41865] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-20 12:10:30,908 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 12:10:30,909 INFO [PEWorker-2] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66309668, jitterRate=-0.011908948421478271}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-20 12:10:30,909 DEBUG [PEWorker-2] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-20 12:10:30,909 DEBUG [PEWorker-2] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-20 12:10:30,909 INFO [PEWorker-2] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-20 12:10:30,909 DEBUG [PEWorker-2] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-20 12:10:30,909 DEBUG [PEWorker-2] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-20 12:10:30,909 DEBUG [PEWorker-2] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-20 12:10:30,912 INFO [RS:2;jenkins-hbase4:43611] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-20 12:10:30,912 INFO [PEWorker-2] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-20 12:10:30,913 DEBUG [PEWorker-2] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-20 12:10:30,917 INFO [RS:2;jenkins-hbase4:43611] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43611,1689855028889-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 12:10:30,917 INFO [RS:0;jenkins-hbase4:41865] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-20 12:10:30,919 INFO [RS:0;jenkins-hbase4:41865] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41865,1689855028765-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 12:10:30,920 INFO [RS:1;jenkins-hbase4:39003] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-20 12:10:30,921 INFO [RS:1;jenkins-hbase4:39003] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39003,1689855028825-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 12:10:30,927 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-20 12:10:30,927 INFO [PEWorker-2] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-20 12:10:30,946 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-20 12:10:30,955 INFO [RS:0;jenkins-hbase4:41865] regionserver.Replication(203): jenkins-hbase4.apache.org,41865,1689855028765 started 2023-07-20 12:10:30,955 INFO [RS:0;jenkins-hbase4:41865] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,41865,1689855028765, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41865, sessionid=0x10182a3e70e0001 2023-07-20 12:10:30,956 INFO [RS:1;jenkins-hbase4:39003] regionserver.Replication(203): jenkins-hbase4.apache.org,39003,1689855028825 started 2023-07-20 12:10:30,956 INFO [RS:1;jenkins-hbase4:39003] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39003,1689855028825, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39003, sessionid=0x10182a3e70e0002 2023-07-20 12:10:30,956 DEBUG [RS:0;jenkins-hbase4:41865] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-20 12:10:30,956 DEBUG [RS:0;jenkins-hbase4:41865] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:30,956 DEBUG [RS:0;jenkins-hbase4:41865] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41865,1689855028765' 2023-07-20 12:10:30,956 DEBUG [RS:0;jenkins-hbase4:41865] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-20 12:10:30,958 DEBUG [RS:0;jenkins-hbase4:41865] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-20 12:10:30,959 DEBUG [RS:0;jenkins-hbase4:41865] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-20 12:10:30,959 DEBUG [RS:0;jenkins-hbase4:41865] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-20 12:10:30,959 DEBUG [RS:0;jenkins-hbase4:41865] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:30,959 DEBUG [RS:0;jenkins-hbase4:41865] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41865,1689855028765' 2023-07-20 12:10:30,959 DEBUG [RS:0;jenkins-hbase4:41865] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:10:30,959 DEBUG [RS:0;jenkins-hbase4:41865] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:10:30,960 DEBUG [RS:0;jenkins-hbase4:41865] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-20 12:10:30,960 INFO [RS:0;jenkins-hbase4:41865] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-20 12:10:30,960 INFO [RS:0;jenkins-hbase4:41865] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-20 12:10:30,966 INFO [RS:2;jenkins-hbase4:43611] regionserver.Replication(203): jenkins-hbase4.apache.org,43611,1689855028889 started 2023-07-20 12:10:30,966 DEBUG [RS:1;jenkins-hbase4:39003] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-20 12:10:30,967 INFO [RS:2;jenkins-hbase4:43611] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,43611,1689855028889, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43611, sessionid=0x10182a3e70e0003 2023-07-20 12:10:30,967 DEBUG [RS:1;jenkins-hbase4:39003] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:30,972 DEBUG [RS:2;jenkins-hbase4:43611] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-20 12:10:30,973 DEBUG [RS:2;jenkins-hbase4:43611] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:30,973 DEBUG [RS:2;jenkins-hbase4:43611] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43611,1689855028889' 2023-07-20 12:10:30,973 DEBUG [RS:2;jenkins-hbase4:43611] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-20 12:10:30,972 DEBUG [RS:1;jenkins-hbase4:39003] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39003,1689855028825' 2023-07-20 12:10:30,971 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-20 12:10:30,973 DEBUG [RS:1;jenkins-hbase4:39003] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-20 12:10:30,974 DEBUG [RS:2;jenkins-hbase4:43611] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-20 12:10:30,974 DEBUG [RS:1;jenkins-hbase4:39003] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-20 12:10:30,975 DEBUG [RS:1;jenkins-hbase4:39003] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-20 12:10:30,975 DEBUG [RS:1;jenkins-hbase4:39003] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-20 12:10:30,975 DEBUG [RS:2;jenkins-hbase4:43611] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-20 12:10:30,977 DEBUG [RS:2;jenkins-hbase4:43611] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-20 12:10:30,977 DEBUG [RS:2;jenkins-hbase4:43611] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:30,977 DEBUG [RS:2;jenkins-hbase4:43611] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43611,1689855028889' 2023-07-20 12:10:30,977 DEBUG [RS:2;jenkins-hbase4:43611] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:10:30,977 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-20 12:10:30,978 DEBUG [RS:2;jenkins-hbase4:43611] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:10:30,975 DEBUG [RS:1;jenkins-hbase4:39003] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:30,978 DEBUG [RS:1;jenkins-hbase4:39003] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39003,1689855028825' 2023-07-20 12:10:30,978 DEBUG [RS:1;jenkins-hbase4:39003] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:10:30,978 DEBUG [RS:2;jenkins-hbase4:43611] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-20 12:10:30,978 INFO [RS:2;jenkins-hbase4:43611] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-20 12:10:30,980 DEBUG [RS:1;jenkins-hbase4:39003] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:10:30,980 INFO [RS:2;jenkins-hbase4:43611] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-20 12:10:30,981 DEBUG [RS:1;jenkins-hbase4:39003] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-20 12:10:30,981 INFO [RS:1;jenkins-hbase4:39003] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-20 12:10:30,981 INFO [RS:1;jenkins-hbase4:39003] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-20 12:10:31,075 INFO [RS:0;jenkins-hbase4:41865] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41865%2C1689855028765, suffix=, logDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/WALs/jenkins-hbase4.apache.org,41865,1689855028765, archiveDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/oldWALs, maxLogs=32 2023-07-20 12:10:31,084 INFO [RS:2;jenkins-hbase4:43611] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43611%2C1689855028889, suffix=, logDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/WALs/jenkins-hbase4.apache.org,43611,1689855028889, archiveDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/oldWALs, maxLogs=32 2023-07-20 12:10:31,115 INFO [RS:1;jenkins-hbase4:39003] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39003%2C1689855028825, suffix=, logDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/WALs/jenkins-hbase4.apache.org,39003,1689855028825, archiveDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/oldWALs, maxLogs=32 2023-07-20 12:10:31,131 DEBUG [jenkins-hbase4:46247] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-20 12:10:31,136 DEBUG [jenkins-hbase4:46247] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 12:10:31,146 DEBUG [jenkins-hbase4:46247] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 12:10:31,146 DEBUG [jenkins-hbase4:46247] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 12:10:31,146 DEBUG [jenkins-hbase4:46247] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 12:10:31,146 DEBUG [jenkins-hbase4:46247] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 12:10:31,165 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32925,DS-85760d8e-ddaf-4be2-ba32-339472e101fd,DISK] 2023-07-20 12:10:31,175 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42507,DS-ff7b0a6d-5365-46d3-9130-f6fc25d1c384,DISK] 2023-07-20 12:10:31,180 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34551,DS-a0c76932-b70b-4aa4-ad34-d821d3a28262,DISK] 2023-07-20 12:10:31,180 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34551,DS-a0c76932-b70b-4aa4-ad34-d821d3a28262,DISK] 2023-07-20 12:10:31,181 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32925,DS-85760d8e-ddaf-4be2-ba32-339472e101fd,DISK] 2023-07-20 12:10:31,181 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42507,DS-ff7b0a6d-5365-46d3-9130-f6fc25d1c384,DISK] 2023-07-20 12:10:31,181 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41865,1689855028765, state=OPENING 2023-07-20 12:10:31,184 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34551,DS-a0c76932-b70b-4aa4-ad34-d821d3a28262,DISK] 2023-07-20 12:10:31,184 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32925,DS-85760d8e-ddaf-4be2-ba32-339472e101fd,DISK] 2023-07-20 12:10:31,185 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42507,DS-ff7b0a6d-5365-46d3-9130-f6fc25d1c384,DISK] 2023-07-20 12:10:31,199 DEBUG [PEWorker-5] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-20 12:10:31,201 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 12:10:31,202 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-20 12:10:31,206 INFO [RS:2;jenkins-hbase4:43611] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/WALs/jenkins-hbase4.apache.org,43611,1689855028889/jenkins-hbase4.apache.org%2C43611%2C1689855028889.1689855031103 2023-07-20 12:10:31,206 DEBUG [RS:2;jenkins-hbase4:43611] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34551,DS-a0c76932-b70b-4aa4-ad34-d821d3a28262,DISK], DatanodeInfoWithStorage[127.0.0.1:32925,DS-85760d8e-ddaf-4be2-ba32-339472e101fd,DISK], DatanodeInfoWithStorage[127.0.0.1:42507,DS-ff7b0a6d-5365-46d3-9130-f6fc25d1c384,DISK]] 2023-07-20 12:10:31,208 INFO [RS:1;jenkins-hbase4:39003] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/WALs/jenkins-hbase4.apache.org,39003,1689855028825/jenkins-hbase4.apache.org%2C39003%2C1689855028825.1689855031117 2023-07-20 12:10:31,208 DEBUG [RS:1;jenkins-hbase4:39003] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34551,DS-a0c76932-b70b-4aa4-ad34-d821d3a28262,DISK], DatanodeInfoWithStorage[127.0.0.1:32925,DS-85760d8e-ddaf-4be2-ba32-339472e101fd,DISK], DatanodeInfoWithStorage[127.0.0.1:42507,DS-ff7b0a6d-5365-46d3-9130-f6fc25d1c384,DISK]] 2023-07-20 12:10:31,212 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41865,1689855028765}] 2023-07-20 12:10:31,224 INFO [RS:0;jenkins-hbase4:41865] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/WALs/jenkins-hbase4.apache.org,41865,1689855028765/jenkins-hbase4.apache.org%2C41865%2C1689855028765.1689855031101 2023-07-20 12:10:31,232 DEBUG [RS:0;jenkins-hbase4:41865] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34551,DS-a0c76932-b70b-4aa4-ad34-d821d3a28262,DISK], DatanodeInfoWithStorage[127.0.0.1:42507,DS-ff7b0a6d-5365-46d3-9130-f6fc25d1c384,DISK], DatanodeInfoWithStorage[127.0.0.1:32925,DS-85760d8e-ddaf-4be2-ba32-339472e101fd,DISK]] 2023-07-20 12:10:31,429 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:31,433 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-20 12:10:31,437 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33584, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-20 12:10:31,460 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-20 12:10:31,461 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-20 12:10:31,465 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41865%2C1689855028765.meta, suffix=.meta, logDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/WALs/jenkins-hbase4.apache.org,41865,1689855028765, archiveDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/oldWALs, maxLogs=32 2023-07-20 12:10:31,488 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42507,DS-ff7b0a6d-5365-46d3-9130-f6fc25d1c384,DISK] 2023-07-20 12:10:31,488 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34551,DS-a0c76932-b70b-4aa4-ad34-d821d3a28262,DISK] 2023-07-20 12:10:31,491 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32925,DS-85760d8e-ddaf-4be2-ba32-339472e101fd,DISK] 2023-07-20 12:10:31,508 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/WALs/jenkins-hbase4.apache.org,41865,1689855028765/jenkins-hbase4.apache.org%2C41865%2C1689855028765.meta.1689855031467.meta 2023-07-20 12:10:31,512 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42507,DS-ff7b0a6d-5365-46d3-9130-f6fc25d1c384,DISK], DatanodeInfoWithStorage[127.0.0.1:34551,DS-a0c76932-b70b-4aa4-ad34-d821d3a28262,DISK], DatanodeInfoWithStorage[127.0.0.1:32925,DS-85760d8e-ddaf-4be2-ba32-339472e101fd,DISK]] 2023-07-20 12:10:31,512 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-20 12:10:31,514 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-20 12:10:31,515 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 12:10:31,516 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-20 12:10:31,518 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-20 12:10:31,520 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-20 12:10:31,534 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-20 12:10:31,534 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 12:10:31,534 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-20 12:10:31,534 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-20 12:10:31,538 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-20 12:10:31,540 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/meta/1588230740/info 2023-07-20 12:10:31,540 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/meta/1588230740/info 2023-07-20 12:10:31,541 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-20 12:10:31,543 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 12:10:31,543 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-20 12:10:31,545 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/meta/1588230740/rep_barrier 2023-07-20 12:10:31,545 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/meta/1588230740/rep_barrier 2023-07-20 12:10:31,546 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-20 12:10:31,547 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 12:10:31,547 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-20 12:10:31,551 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/meta/1588230740/table 2023-07-20 12:10:31,551 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/meta/1588230740/table 2023-07-20 12:10:31,551 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-20 12:10:31,552 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 12:10:31,556 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/meta/1588230740 2023-07-20 12:10:31,562 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/meta/1588230740 2023-07-20 12:10:31,566 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-20 12:10:31,569 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-20 12:10:31,571 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69909691, jitterRate=0.04173557460308075}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-20 12:10:31,574 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-20 12:10:31,586 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689855031417 2023-07-20 12:10:31,609 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-20 12:10:31,611 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-20 12:10:31,612 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41865,1689855028765, state=OPEN 2023-07-20 12:10:31,616 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-20 12:10:31,617 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-20 12:10:31,623 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-20 12:10:31,623 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41865,1689855028765 in 404 msec 2023-07-20 12:10:31,631 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-20 12:10:31,631 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 679 msec 2023-07-20 12:10:31,637 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.2770 sec 2023-07-20 12:10:31,637 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689855031637, completionTime=-1 2023-07-20 12:10:31,637 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-20 12:10:31,637 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-20 12:10:31,746 DEBUG [hconnection-0x18f07d5b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:10:31,749 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33590, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:10:31,775 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-20 12:10:31,776 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689855091776 2023-07-20 12:10:31,776 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689855151776 2023-07-20 12:10:31,776 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 138 msec 2023-07-20 12:10:31,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46247,1689855027157-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 12:10:31,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46247,1689855027157-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-20 12:10:31,801 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46247,1689855027157-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-20 12:10:31,803 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:46247, period=300000, unit=MILLISECONDS is enabled. 2023-07-20 12:10:31,803 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-20 12:10:31,811 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-20 12:10:31,819 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-20 12:10:31,820 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-20 12:10:31,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-20 12:10:31,833 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 12:10:31,837 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 12:10:31,859 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/hbase/namespace/ace36fd6302cf0989f2fd79aaf8b3f5d 2023-07-20 12:10:31,863 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/hbase/namespace/ace36fd6302cf0989f2fd79aaf8b3f5d empty. 2023-07-20 12:10:31,864 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/hbase/namespace/ace36fd6302cf0989f2fd79aaf8b3f5d 2023-07-20 12:10:31,864 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-20 12:10:31,915 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-20 12:10:31,917 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => ace36fd6302cf0989f2fd79aaf8b3f5d, NAME => 'hbase:namespace,,1689855031820.ace36fd6302cf0989f2fd79aaf8b3f5d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp 2023-07-20 12:10:31,934 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689855031820.ace36fd6302cf0989f2fd79aaf8b3f5d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 12:10:31,935 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing ace36fd6302cf0989f2fd79aaf8b3f5d, disabling compactions & flushes 2023-07-20 12:10:31,935 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689855031820.ace36fd6302cf0989f2fd79aaf8b3f5d. 2023-07-20 12:10:31,935 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689855031820.ace36fd6302cf0989f2fd79aaf8b3f5d. 2023-07-20 12:10:31,935 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689855031820.ace36fd6302cf0989f2fd79aaf8b3f5d. after waiting 0 ms 2023-07-20 12:10:31,935 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689855031820.ace36fd6302cf0989f2fd79aaf8b3f5d. 2023-07-20 12:10:31,935 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689855031820.ace36fd6302cf0989f2fd79aaf8b3f5d. 2023-07-20 12:10:31,935 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for ace36fd6302cf0989f2fd79aaf8b3f5d: 2023-07-20 12:10:31,947 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 12:10:31,963 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689855031820.ace36fd6302cf0989f2fd79aaf8b3f5d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689855031951"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689855031951"}]},"ts":"1689855031951"} 2023-07-20 12:10:31,991 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-20 12:10:31,993 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 12:10:31,998 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689855031994"}]},"ts":"1689855031994"} 2023-07-20 12:10:32,002 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-20 12:10:32,007 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 12:10:32,009 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 12:10:32,009 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 12:10:32,009 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 12:10:32,009 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 12:10:32,012 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ace36fd6302cf0989f2fd79aaf8b3f5d, ASSIGN}] 2023-07-20 12:10:32,015 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ace36fd6302cf0989f2fd79aaf8b3f5d, ASSIGN 2023-07-20 12:10:32,017 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=ace36fd6302cf0989f2fd79aaf8b3f5d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39003,1689855028825; forceNewPlan=false, retain=false 2023-07-20 12:10:32,170 INFO [jenkins-hbase4:46247] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-20 12:10:32,171 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ace36fd6302cf0989f2fd79aaf8b3f5d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:32,171 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689855031820.ace36fd6302cf0989f2fd79aaf8b3f5d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689855032171"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689855032171"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689855032171"}]},"ts":"1689855032171"} 2023-07-20 12:10:32,176 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure ace36fd6302cf0989f2fd79aaf8b3f5d, server=jenkins-hbase4.apache.org,39003,1689855028825}] 2023-07-20 12:10:32,332 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:32,333 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-20 12:10:32,336 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59746, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-20 12:10:32,344 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689855031820.ace36fd6302cf0989f2fd79aaf8b3f5d. 2023-07-20 12:10:32,345 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ace36fd6302cf0989f2fd79aaf8b3f5d, NAME => 'hbase:namespace,,1689855031820.ace36fd6302cf0989f2fd79aaf8b3f5d.', STARTKEY => '', ENDKEY => ''} 2023-07-20 12:10:32,345 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689855031820.ace36fd6302cf0989f2fd79aaf8b3f5d. service=AccessControlService 2023-07-20 12:10:32,346 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 12:10:32,347 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace ace36fd6302cf0989f2fd79aaf8b3f5d 2023-07-20 12:10:32,347 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689855031820.ace36fd6302cf0989f2fd79aaf8b3f5d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 12:10:32,347 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ace36fd6302cf0989f2fd79aaf8b3f5d 2023-07-20 12:10:32,347 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ace36fd6302cf0989f2fd79aaf8b3f5d 2023-07-20 12:10:32,349 INFO [StoreOpener-ace36fd6302cf0989f2fd79aaf8b3f5d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region ace36fd6302cf0989f2fd79aaf8b3f5d 2023-07-20 12:10:32,353 DEBUG [StoreOpener-ace36fd6302cf0989f2fd79aaf8b3f5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/namespace/ace36fd6302cf0989f2fd79aaf8b3f5d/info 2023-07-20 12:10:32,353 DEBUG [StoreOpener-ace36fd6302cf0989f2fd79aaf8b3f5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/namespace/ace36fd6302cf0989f2fd79aaf8b3f5d/info 2023-07-20 12:10:32,353 INFO [StoreOpener-ace36fd6302cf0989f2fd79aaf8b3f5d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ace36fd6302cf0989f2fd79aaf8b3f5d columnFamilyName info 2023-07-20 12:10:32,355 INFO [StoreOpener-ace36fd6302cf0989f2fd79aaf8b3f5d-1] regionserver.HStore(310): Store=ace36fd6302cf0989f2fd79aaf8b3f5d/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 12:10:32,357 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/namespace/ace36fd6302cf0989f2fd79aaf8b3f5d 2023-07-20 12:10:32,358 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/namespace/ace36fd6302cf0989f2fd79aaf8b3f5d 2023-07-20 12:10:32,363 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ace36fd6302cf0989f2fd79aaf8b3f5d 2023-07-20 12:10:32,367 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/namespace/ace36fd6302cf0989f2fd79aaf8b3f5d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 12:10:32,368 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ace36fd6302cf0989f2fd79aaf8b3f5d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75264217, jitterRate=0.12152422964572906}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 12:10:32,368 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ace36fd6302cf0989f2fd79aaf8b3f5d: 2023-07-20 12:10:32,370 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689855031820.ace36fd6302cf0989f2fd79aaf8b3f5d., pid=6, masterSystemTime=1689855032332 2023-07-20 12:10:32,376 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689855031820.ace36fd6302cf0989f2fd79aaf8b3f5d. 2023-07-20 12:10:32,376 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689855031820.ace36fd6302cf0989f2fd79aaf8b3f5d. 2023-07-20 12:10:32,378 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ace36fd6302cf0989f2fd79aaf8b3f5d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:32,378 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689855031820.ace36fd6302cf0989f2fd79aaf8b3f5d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689855032377"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689855032377"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689855032377"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689855032377"}]},"ts":"1689855032377"} 2023-07-20 12:10:32,387 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-20 12:10:32,387 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure ace36fd6302cf0989f2fd79aaf8b3f5d, server=jenkins-hbase4.apache.org,39003,1689855028825 in 207 msec 2023-07-20 12:10:32,392 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-20 12:10:32,393 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=ace36fd6302cf0989f2fd79aaf8b3f5d, ASSIGN in 375 msec 2023-07-20 12:10:32,394 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 12:10:32,394 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689855032394"}]},"ts":"1689855032394"} 2023-07-20 12:10:32,397 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-20 12:10:32,402 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 12:10:32,405 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 581 msec 2023-07-20 12:10:32,434 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-20 12:10:32,435 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-20 12:10:32,435 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 12:10:32,459 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:10:32,464 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59762, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:10:32,478 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-20 12:10:32,503 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-20 12:10:32,509 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 38 msec 2023-07-20 12:10:32,522 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-20 12:10:32,537 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-20 12:10:32,543 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 21 msec 2023-07-20 12:10:32,560 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-20 12:10:32,562 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-20 12:10:32,563 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.589sec 2023-07-20 12:10:32,566 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-20 12:10:32,567 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-20 12:10:32,567 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-20 12:10:32,568 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46247,1689855027157-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-20 12:10:32,569 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46247,1689855027157-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-20 12:10:32,594 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-20 12:10:32,596 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-20 12:10:32,598 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 12:10:32,600 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 12:10:32,603 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-20 12:10:32,603 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/hbase/acl/f1ce01a510a04cc69fea3d7670ad816b 2023-07-20 12:10:32,604 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/hbase/acl/f1ce01a510a04cc69fea3d7670ad816b empty. 2023-07-20 12:10:32,607 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/hbase/acl/f1ce01a510a04cc69fea3d7670ad816b 2023-07-20 12:10:32,607 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-20 12:10:32,611 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-20 12:10:32,633 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-20 12:10:32,635 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => f1ce01a510a04cc69fea3d7670ad816b, NAME => 'hbase:acl,,1689855032589.f1ce01a510a04cc69fea3d7670ad816b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp 2023-07-20 12:10:32,646 DEBUG [Listener at localhost/39119] zookeeper.ReadOnlyZKClient(139): Connect 0x59ecae38 to 127.0.0.1:59849 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 12:10:32,668 DEBUG [Listener at localhost/39119] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1154650d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 12:10:32,684 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689855032589.f1ce01a510a04cc69fea3d7670ad816b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 12:10:32,685 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing f1ce01a510a04cc69fea3d7670ad816b, disabling compactions & flushes 2023-07-20 12:10:32,685 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689855032589.f1ce01a510a04cc69fea3d7670ad816b. 2023-07-20 12:10:32,685 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689855032589.f1ce01a510a04cc69fea3d7670ad816b. 2023-07-20 12:10:32,685 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689855032589.f1ce01a510a04cc69fea3d7670ad816b. after waiting 0 ms 2023-07-20 12:10:32,686 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689855032589.f1ce01a510a04cc69fea3d7670ad816b. 2023-07-20 12:10:32,686 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689855032589.f1ce01a510a04cc69fea3d7670ad816b. 2023-07-20 12:10:32,686 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for f1ce01a510a04cc69fea3d7670ad816b: 2023-07-20 12:10:32,690 DEBUG [hconnection-0x665d92ba-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:10:32,694 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 12:10:32,697 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689855032589.f1ce01a510a04cc69fea3d7670ad816b.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689855032697"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689855032697"}]},"ts":"1689855032697"} 2023-07-20 12:10:32,700 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-20 12:10:32,705 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 12:10:32,705 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689855032705"}]},"ts":"1689855032705"} 2023-07-20 12:10:32,706 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33596, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:10:32,708 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-20 12:10:32,709 INFO [Listener at localhost/39119] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,46247,1689855027157 2023-07-20 12:10:32,709 INFO [Listener at localhost/39119] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-20 12:10:32,710 INFO [Listener at localhost/39119] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/test.cache.data in system properties and HBase conf 2023-07-20 12:10:32,710 INFO [Listener at localhost/39119] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/hadoop.tmp.dir in system properties and HBase conf 2023-07-20 12:10:32,710 INFO [Listener at localhost/39119] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/hadoop.log.dir in system properties and HBase conf 2023-07-20 12:10:32,710 INFO [Listener at localhost/39119] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-20 12:10:32,710 INFO [Listener at localhost/39119] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-20 12:10:32,710 INFO [Listener at localhost/39119] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-20 12:10:32,711 INFO [Listener at localhost/39119] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-20 12:10:32,711 INFO [Listener at localhost/39119] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-20 12:10:32,711 INFO [Listener at localhost/39119] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-20 12:10:32,711 INFO [Listener at localhost/39119] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-20 12:10:32,711 INFO [Listener at localhost/39119] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-20 12:10:32,711 INFO [Listener at localhost/39119] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-20 12:10:32,712 INFO [Listener at localhost/39119] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-20 12:10:32,712 INFO [Listener at localhost/39119] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-20 12:10:32,713 INFO [Listener at localhost/39119] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-20 12:10:32,713 INFO [Listener at localhost/39119] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/nfs.dump.dir in system properties and HBase conf 2023-07-20 12:10:32,713 INFO [Listener at localhost/39119] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/java.io.tmpdir in system properties and HBase conf 2023-07-20 12:10:32,713 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 12:10:32,713 INFO [Listener at localhost/39119] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-20 12:10:32,713 INFO [Listener at localhost/39119] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-20 12:10:32,713 INFO [Listener at localhost/39119] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-20 12:10:32,714 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 12:10:32,714 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 12:10:32,715 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 12:10:32,715 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 12:10:32,715 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=f1ce01a510a04cc69fea3d7670ad816b, ASSIGN}] 2023-07-20 12:10:32,715 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-20 12:10:32,727 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=f1ce01a510a04cc69fea3d7670ad816b, ASSIGN 2023-07-20 12:10:32,730 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=f1ce01a510a04cc69fea3d7670ad816b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43611,1689855028889; forceNewPlan=false, retain=false 2023-07-20 12:10:32,880 INFO [jenkins-hbase4:46247] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-20 12:10:32,881 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=f1ce01a510a04cc69fea3d7670ad816b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:32,881 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689855032589.f1ce01a510a04cc69fea3d7670ad816b.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689855032881"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689855032881"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689855032881"}]},"ts":"1689855032881"} 2023-07-20 12:10:32,885 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure f1ce01a510a04cc69fea3d7670ad816b, server=jenkins-hbase4.apache.org,43611,1689855028889}] 2023-07-20 12:10:32,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-20 12:10:33,040 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:33,041 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-20 12:10:33,042 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45486, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-20 12:10:33,056 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689855032589.f1ce01a510a04cc69fea3d7670ad816b. 2023-07-20 12:10:33,056 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f1ce01a510a04cc69fea3d7670ad816b, NAME => 'hbase:acl,,1689855032589.f1ce01a510a04cc69fea3d7670ad816b.', STARTKEY => '', ENDKEY => ''} 2023-07-20 12:10:33,056 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689855032589.f1ce01a510a04cc69fea3d7670ad816b. service=AccessControlService 2023-07-20 12:10:33,057 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 12:10:33,057 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl f1ce01a510a04cc69fea3d7670ad816b 2023-07-20 12:10:33,057 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689855032589.f1ce01a510a04cc69fea3d7670ad816b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 12:10:33,057 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f1ce01a510a04cc69fea3d7670ad816b 2023-07-20 12:10:33,057 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f1ce01a510a04cc69fea3d7670ad816b 2023-07-20 12:10:33,061 INFO [StoreOpener-f1ce01a510a04cc69fea3d7670ad816b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region f1ce01a510a04cc69fea3d7670ad816b 2023-07-20 12:10:33,064 DEBUG [StoreOpener-f1ce01a510a04cc69fea3d7670ad816b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/acl/f1ce01a510a04cc69fea3d7670ad816b/l 2023-07-20 12:10:33,064 DEBUG [StoreOpener-f1ce01a510a04cc69fea3d7670ad816b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/acl/f1ce01a510a04cc69fea3d7670ad816b/l 2023-07-20 12:10:33,064 INFO [StoreOpener-f1ce01a510a04cc69fea3d7670ad816b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f1ce01a510a04cc69fea3d7670ad816b columnFamilyName l 2023-07-20 12:10:33,065 INFO [StoreOpener-f1ce01a510a04cc69fea3d7670ad816b-1] regionserver.HStore(310): Store=f1ce01a510a04cc69fea3d7670ad816b/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 12:10:33,068 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/acl/f1ce01a510a04cc69fea3d7670ad816b 2023-07-20 12:10:33,069 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/acl/f1ce01a510a04cc69fea3d7670ad816b 2023-07-20 12:10:33,080 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f1ce01a510a04cc69fea3d7670ad816b 2023-07-20 12:10:33,084 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/acl/f1ce01a510a04cc69fea3d7670ad816b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 12:10:33,085 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f1ce01a510a04cc69fea3d7670ad816b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70549807, jitterRate=0.051274046301841736}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 12:10:33,085 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f1ce01a510a04cc69fea3d7670ad816b: 2023-07-20 12:10:33,089 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689855032589.f1ce01a510a04cc69fea3d7670ad816b., pid=11, masterSystemTime=1689855033040 2023-07-20 12:10:33,096 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689855032589.f1ce01a510a04cc69fea3d7670ad816b. 2023-07-20 12:10:33,097 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689855032589.f1ce01a510a04cc69fea3d7670ad816b. 2023-07-20 12:10:33,098 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=f1ce01a510a04cc69fea3d7670ad816b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:33,099 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689855032589.f1ce01a510a04cc69fea3d7670ad816b.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689855033098"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689855033098"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689855033098"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689855033098"}]},"ts":"1689855033098"} 2023-07-20 12:10:33,108 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-20 12:10:33,108 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure f1ce01a510a04cc69fea3d7670ad816b, server=jenkins-hbase4.apache.org,43611,1689855028889 in 218 msec 2023-07-20 12:10:33,114 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 12:10:33,115 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689855033114"}]},"ts":"1689855033114"} 2023-07-20 12:10:33,115 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-20 12:10:33,115 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=f1ce01a510a04cc69fea3d7670ad816b, ASSIGN in 393 msec 2023-07-20 12:10:33,117 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-20 12:10:33,121 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 12:10:33,125 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 527 msec 2023-07-20 12:10:33,216 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-20 12:10:33,216 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-20 12:10:33,227 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-20 12:10:34,122 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 12:10:34,519 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 12:10:34,526 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_45343_jobhistory____83htfe/webapp 2023-07-20 12:10:34,696 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-20 12:10:34,697 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-20 12:10:34,697 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-20 12:10:34,701 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-20 12:10:34,790 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 12:10:35,178 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 12:10:35,585 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-20 12:10:35,629 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:45343 2023-07-20 12:10:37,091 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 12:10:37,122 WARN [Listener at jenkins-hbase4.apache.org/38625] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 12:10:37,405 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-20 12:10:37,406 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-20 12:10:37,407 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-20 12:10:37,408 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 12:10:37,409 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-20 12:10:37,409 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 12:10:37,409 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-20 12:10:37,410 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-20 12:10:37,410 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-20 12:10:37,410 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 12:10:37,410 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-20 12:10:37,410 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-20 12:10:37,410 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-20 12:10:37,463 WARN [Listener at jenkins-hbase4.apache.org/38625] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-20 12:10:37,464 INFO [Listener at jenkins-hbase4.apache.org/38625] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 12:10:37,478 INFO [Listener at jenkins-hbase4.apache.org/38625] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34941_cluster____.hiaui9/webapp 2023-07-20 12:10:37,556 INFO [Listener at jenkins-hbase4.apache.org/38625] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-20 12:10:37,556 INFO [Listener at jenkins-hbase4.apache.org/38625] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-20 12:10:37,556 INFO [Listener at jenkins-hbase4.apache.org/38625] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-20 12:10:37,557 INFO [Listener at jenkins-hbase4.apache.org/38625] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-20 12:10:37,570 INFO [Listener at jenkins-hbase4.apache.org/38625] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 12:10:37,800 INFO [Listener at jenkins-hbase4.apache.org/38625] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 12:10:37,899 INFO [Listener at jenkins-hbase4.apache.org/38625] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 12:10:37,911 INFO [Listener at jenkins-hbase4.apache.org/38625] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34941 2023-07-20 12:10:38,602 WARN [Listener at jenkins-hbase4.apache.org/37901] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 12:10:38,632 WARN [Listener at jenkins-hbase4.apache.org/37901] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-20 12:10:38,633 INFO [Listener at jenkins-hbase4.apache.org/37901] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 12:10:38,644 INFO [Listener at jenkins-hbase4.apache.org/37901] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_41445_node____.j9bp2i/webapp 2023-07-20 12:10:38,705 INFO [Listener at jenkins-hbase4.apache.org/37901] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-20 12:10:38,705 INFO [Listener at jenkins-hbase4.apache.org/37901] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-20 12:10:38,705 INFO [Listener at jenkins-hbase4.apache.org/37901] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-20 12:10:38,705 INFO [Listener at jenkins-hbase4.apache.org/37901] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-20 12:10:38,716 INFO [Listener at jenkins-hbase4.apache.org/37901] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 12:10:38,747 INFO [Listener at jenkins-hbase4.apache.org/37901] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 12:10:38,860 INFO [Listener at jenkins-hbase4.apache.org/37901] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 12:10:38,883 INFO [Listener at jenkins-hbase4.apache.org/37901] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:41445 2023-07-20 12:10:39,130 WARN [Listener at jenkins-hbase4.apache.org/34263] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 12:10:39,137 WARN [Listener at jenkins-hbase4.apache.org/34263] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-20 12:10:39,138 INFO [Listener at jenkins-hbase4.apache.org/34263] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 12:10:39,146 INFO [Listener at jenkins-hbase4.apache.org/34263] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_42277_node____.r7z52m/webapp 2023-07-20 12:10:39,209 INFO [Listener at jenkins-hbase4.apache.org/34263] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-20 12:10:39,210 INFO [Listener at jenkins-hbase4.apache.org/34263] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-20 12:10:39,210 INFO [Listener at jenkins-hbase4.apache.org/34263] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-20 12:10:39,210 INFO [Listener at jenkins-hbase4.apache.org/34263] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-20 12:10:39,221 INFO [Listener at jenkins-hbase4.apache.org/34263] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 12:10:39,237 INFO [Listener at jenkins-hbase4.apache.org/34263] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 12:10:39,304 INFO [Listener at jenkins-hbase4.apache.org/34263] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 12:10:39,310 INFO [Listener at jenkins-hbase4.apache.org/34263] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:42277 2023-07-20 12:10:39,331 INFO [Listener at jenkins-hbase4.apache.org/34263] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-20 12:10:39,332 INFO [Listener at jenkins-hbase4.apache.org/34263] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 12:10:39,391 INFO [Listener at jenkins-hbase4.apache.org/34263] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=708, OpenFileDescriptor=898, MaxFileDescriptor=60000, SystemLoadAverage=276, ProcessCount=179, AvailableMemoryMB=4986 2023-07-20 12:10:39,392 WARN [Listener at jenkins-hbase4.apache.org/34263] hbase.ResourceChecker(130): Thread=708 is superior to 500 2023-07-20 12:10:39,416 DEBUG [Listener at jenkins-hbase4.apache.org/34263] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-20 12:10:39,422 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36742, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-20 12:10:39,429 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-20 12:10:39,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-20 12:10:39,434 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 12:10:39,435 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-20 12:10:39,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-20 12:10:39,438 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 12:10:39,443 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportWithTargetName/892b85871b26d782d22c02a479dc367e 2023-07-20 12:10:39,447 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportWithTargetName/892b85871b26d782d22c02a479dc367e empty. 2023-07-20 12:10:39,447 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportWithTargetName/9263122b8bfb4ddbeb4a907c820434fa 2023-07-20 12:10:39,448 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportWithTargetName/892b85871b26d782d22c02a479dc367e 2023-07-20 12:10:39,449 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportWithTargetName/9263122b8bfb4ddbeb4a907c820434fa empty. 2023-07-20 12:10:39,450 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportWithTargetName/9263122b8bfb4ddbeb4a907c820434fa 2023-07-20 12:10:39,450 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-20 12:10:39,480 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-20 12:10:39,481 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 892b85871b26d782d22c02a479dc367e, NAME => 'testtb-testExportWithTargetName,,1689855039428.892b85871b26d782d22c02a479dc367e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp 2023-07-20 12:10:39,481 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9263122b8bfb4ddbeb4a907c820434fa, NAME => 'testtb-testExportWithTargetName,1,1689855039428.9263122b8bfb4ddbeb4a907c820434fa.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp 2023-07-20 12:10:39,528 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689855039428.9263122b8bfb4ddbeb4a907c820434fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 12:10:39,528 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 9263122b8bfb4ddbeb4a907c820434fa, disabling compactions & flushes 2023-07-20 12:10:39,528 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689855039428.9263122b8bfb4ddbeb4a907c820434fa. 2023-07-20 12:10:39,528 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689855039428.9263122b8bfb4ddbeb4a907c820434fa. 2023-07-20 12:10:39,528 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689855039428.9263122b8bfb4ddbeb4a907c820434fa. after waiting 0 ms 2023-07-20 12:10:39,528 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689855039428.9263122b8bfb4ddbeb4a907c820434fa. 2023-07-20 12:10:39,528 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689855039428.9263122b8bfb4ddbeb4a907c820434fa. 2023-07-20 12:10:39,528 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 9263122b8bfb4ddbeb4a907c820434fa: 2023-07-20 12:10:39,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-20 12:10:39,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-20 12:10:39,922 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689855039428.892b85871b26d782d22c02a479dc367e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 12:10:39,923 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 892b85871b26d782d22c02a479dc367e, disabling compactions & flushes 2023-07-20 12:10:39,923 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689855039428.892b85871b26d782d22c02a479dc367e. 2023-07-20 12:10:39,923 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689855039428.892b85871b26d782d22c02a479dc367e. 2023-07-20 12:10:39,923 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689855039428.892b85871b26d782d22c02a479dc367e. after waiting 0 ms 2023-07-20 12:10:39,923 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689855039428.892b85871b26d782d22c02a479dc367e. 2023-07-20 12:10:39,923 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689855039428.892b85871b26d782d22c02a479dc367e. 2023-07-20 12:10:39,923 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 892b85871b26d782d22c02a479dc367e: 2023-07-20 12:10:39,926 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 12:10:39,928 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689855039428.9263122b8bfb4ddbeb4a907c820434fa.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689855039928"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689855039928"}]},"ts":"1689855039928"} 2023-07-20 12:10:39,928 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689855039428.892b85871b26d782d22c02a479dc367e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689855039928"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689855039928"}]},"ts":"1689855039928"} 2023-07-20 12:10:39,975 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 12:10:39,977 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 12:10:39,977 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689855039977"}]},"ts":"1689855039977"} 2023-07-20 12:10:39,979 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-20 12:10:39,983 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 12:10:39,985 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 12:10:39,985 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 12:10:39,985 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 12:10:39,985 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 12:10:39,986 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=892b85871b26d782d22c02a479dc367e, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9263122b8bfb4ddbeb4a907c820434fa, ASSIGN}] 2023-07-20 12:10:39,988 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=892b85871b26d782d22c02a479dc367e, ASSIGN 2023-07-20 12:10:39,989 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9263122b8bfb4ddbeb4a907c820434fa, ASSIGN 2023-07-20 12:10:39,990 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=892b85871b26d782d22c02a479dc367e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39003,1689855028825; forceNewPlan=false, retain=false 2023-07-20 12:10:39,990 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9263122b8bfb4ddbeb4a907c820434fa, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43611,1689855028889; forceNewPlan=false, retain=false 2023-07-20 12:10:40,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-20 12:10:40,140 INFO [jenkins-hbase4:46247] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 12:10:40,142 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=9263122b8bfb4ddbeb4a907c820434fa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:40,142 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=892b85871b26d782d22c02a479dc367e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:40,143 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689855039428.9263122b8bfb4ddbeb4a907c820434fa.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689855040142"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689855040142"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689855040142"}]},"ts":"1689855040142"} 2023-07-20 12:10:40,143 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689855039428.892b85871b26d782d22c02a479dc367e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689855040142"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689855040142"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689855040142"}]},"ts":"1689855040142"} 2023-07-20 12:10:40,146 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 9263122b8bfb4ddbeb4a907c820434fa, server=jenkins-hbase4.apache.org,43611,1689855028889}] 2023-07-20 12:10:40,148 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 892b85871b26d782d22c02a479dc367e, server=jenkins-hbase4.apache.org,39003,1689855028825}] 2023-07-20 12:10:40,305 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689855039428.9263122b8bfb4ddbeb4a907c820434fa. 2023-07-20 12:10:40,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9263122b8bfb4ddbeb4a907c820434fa, NAME => 'testtb-testExportWithTargetName,1,1689855039428.9263122b8bfb4ddbeb4a907c820434fa.', STARTKEY => '1', ENDKEY => ''} 2023-07-20 12:10:40,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689855039428.9263122b8bfb4ddbeb4a907c820434fa. service=AccessControlService 2023-07-20 12:10:40,306 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689855039428.892b85871b26d782d22c02a479dc367e. 2023-07-20 12:10:40,306 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 12:10:40,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 892b85871b26d782d22c02a479dc367e, NAME => 'testtb-testExportWithTargetName,,1689855039428.892b85871b26d782d22c02a479dc367e.', STARTKEY => '', ENDKEY => '1'} 2023-07-20 12:10:40,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 9263122b8bfb4ddbeb4a907c820434fa 2023-07-20 12:10:40,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689855039428.9263122b8bfb4ddbeb4a907c820434fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 12:10:40,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689855039428.892b85871b26d782d22c02a479dc367e. service=AccessControlService 2023-07-20 12:10:40,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9263122b8bfb4ddbeb4a907c820434fa 2023-07-20 12:10:40,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9263122b8bfb4ddbeb4a907c820434fa 2023-07-20 12:10:40,307 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 12:10:40,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 892b85871b26d782d22c02a479dc367e 2023-07-20 12:10:40,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689855039428.892b85871b26d782d22c02a479dc367e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 12:10:40,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 892b85871b26d782d22c02a479dc367e 2023-07-20 12:10:40,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 892b85871b26d782d22c02a479dc367e 2023-07-20 12:10:40,311 INFO [StoreOpener-9263122b8bfb4ddbeb4a907c820434fa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9263122b8bfb4ddbeb4a907c820434fa 2023-07-20 12:10:40,311 INFO [StoreOpener-892b85871b26d782d22c02a479dc367e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 892b85871b26d782d22c02a479dc367e 2023-07-20 12:10:40,313 DEBUG [StoreOpener-9263122b8bfb4ddbeb4a907c820434fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportWithTargetName/9263122b8bfb4ddbeb4a907c820434fa/cf 2023-07-20 12:10:40,313 DEBUG [StoreOpener-9263122b8bfb4ddbeb4a907c820434fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportWithTargetName/9263122b8bfb4ddbeb4a907c820434fa/cf 2023-07-20 12:10:40,313 DEBUG [StoreOpener-892b85871b26d782d22c02a479dc367e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportWithTargetName/892b85871b26d782d22c02a479dc367e/cf 2023-07-20 12:10:40,313 DEBUG [StoreOpener-892b85871b26d782d22c02a479dc367e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportWithTargetName/892b85871b26d782d22c02a479dc367e/cf 2023-07-20 12:10:40,318 INFO [StoreOpener-9263122b8bfb4ddbeb4a907c820434fa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9263122b8bfb4ddbeb4a907c820434fa columnFamilyName cf 2023-07-20 12:10:40,318 INFO [StoreOpener-892b85871b26d782d22c02a479dc367e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 892b85871b26d782d22c02a479dc367e columnFamilyName cf 2023-07-20 12:10:40,321 INFO [StoreOpener-9263122b8bfb4ddbeb4a907c820434fa-1] regionserver.HStore(310): Store=9263122b8bfb4ddbeb4a907c820434fa/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 12:10:40,324 INFO [StoreOpener-892b85871b26d782d22c02a479dc367e-1] regionserver.HStore(310): Store=892b85871b26d782d22c02a479dc367e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 12:10:40,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportWithTargetName/892b85871b26d782d22c02a479dc367e 2023-07-20 12:10:40,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportWithTargetName/892b85871b26d782d22c02a479dc367e 2023-07-20 12:10:40,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportWithTargetName/9263122b8bfb4ddbeb4a907c820434fa 2023-07-20 12:10:40,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportWithTargetName/9263122b8bfb4ddbeb4a907c820434fa 2023-07-20 12:10:40,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9263122b8bfb4ddbeb4a907c820434fa 2023-07-20 12:10:40,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 892b85871b26d782d22c02a479dc367e 2023-07-20 12:10:40,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportWithTargetName/892b85871b26d782d22c02a479dc367e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 12:10:40,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportWithTargetName/9263122b8bfb4ddbeb4a907c820434fa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 12:10:40,351 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 892b85871b26d782d22c02a479dc367e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73226758, jitterRate=0.09116372466087341}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 12:10:40,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 892b85871b26d782d22c02a479dc367e: 2023-07-20 12:10:40,351 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9263122b8bfb4ddbeb4a907c820434fa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61949566, jitterRate=-0.07687953114509583}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 12:10:40,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9263122b8bfb4ddbeb4a907c820434fa: 2023-07-20 12:10:40,352 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689855039428.892b85871b26d782d22c02a479dc367e., pid=16, masterSystemTime=1689855040301 2023-07-20 12:10:40,355 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689855039428.9263122b8bfb4ddbeb4a907c820434fa., pid=15, masterSystemTime=1689855040299 2023-07-20 12:10:40,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689855039428.892b85871b26d782d22c02a479dc367e. 2023-07-20 12:10:40,358 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689855039428.892b85871b26d782d22c02a479dc367e. 2023-07-20 12:10:40,359 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=892b85871b26d782d22c02a479dc367e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:40,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689855039428.9263122b8bfb4ddbeb4a907c820434fa. 2023-07-20 12:10:40,360 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689855039428.892b85871b26d782d22c02a479dc367e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689855040359"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689855040359"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689855040359"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689855040359"}]},"ts":"1689855040359"} 2023-07-20 12:10:40,360 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689855039428.9263122b8bfb4ddbeb4a907c820434fa. 2023-07-20 12:10:40,361 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=9263122b8bfb4ddbeb4a907c820434fa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:40,364 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689855039428.9263122b8bfb4ddbeb4a907c820434fa.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689855040361"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689855040361"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689855040361"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689855040361"}]},"ts":"1689855040361"} 2023-07-20 12:10:40,368 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-20 12:10:40,369 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 892b85871b26d782d22c02a479dc367e, server=jenkins-hbase4.apache.org,39003,1689855028825 in 217 msec 2023-07-20 12:10:40,371 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-20 12:10:40,372 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 9263122b8bfb4ddbeb4a907c820434fa, server=jenkins-hbase4.apache.org,43611,1689855028889 in 221 msec 2023-07-20 12:10:40,372 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=892b85871b26d782d22c02a479dc367e, ASSIGN in 383 msec 2023-07-20 12:10:40,375 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-20 12:10:40,375 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9263122b8bfb4ddbeb4a907c820434fa, ASSIGN in 385 msec 2023-07-20 12:10:40,377 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 12:10:40,377 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689855040377"}]},"ts":"1689855040377"} 2023-07-20 12:10:40,379 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-20 12:10:40,383 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 12:10:40,389 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-20 12:10:40,396 DEBUG [PEWorker-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:10:40,400 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47552, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:10:40,404 DEBUG [hconnection-0x929c31e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:10:40,407 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53564, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-07-20 12:10:40,417 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43611] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-20 12:10:40,457 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-20 12:10:40,457 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-20 12:10:40,457 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-20 12:10:40,457 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 12:10:40,457 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-20 12:10:40,466 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 12:10:40,466 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-20 12:10:40,466 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-20 12:10:40,466 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-20 12:10:40,478 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 1.0380 sec 2023-07-20 12:10:40,479 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-20 12:10:40,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-20 12:10:40,546 INFO [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-20 12:10:40,551 DEBUG [Listener at jenkins-hbase4.apache.org/34263] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-20 12:10:40,552 DEBUG [Listener at jenkins-hbase4.apache.org/34263] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689855039428.892b85871b26d782d22c02a479dc367e. 2023-07-20 12:10:40,555 INFO [Listener at jenkins-hbase4.apache.org/34263] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 12:10:40,581 DEBUG [hconnection-0x665d92ba-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:10:40,585 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60852, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:10:40,588 DEBUG [hconnection-0x665d92ba-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:10:40,592 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47554, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:10:40,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-20 12:10:40,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689855040607 (current time:1689855040607). 2023-07-20 12:10:40,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 12:10:40,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(139): Connect 0x6e5c1ab0 to 127.0.0.1:59849 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 12:10:40,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10f0eb7b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 12:10:40,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:10:40,617 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53576, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:10:40,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6e5c1ab0 to 127.0.0.1:59849 2023-07-20 12:10:40,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 12:10:40,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(139): Connect 0x18e5a0de to 127.0.0.1:59849 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 12:10:40,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@462f545, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 12:10:40,628 DEBUG [hconnection-0x749f326f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:10:40,629 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53584, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:10:40,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:10:40,636 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47556, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:10:40,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x18e5a0de to 127.0.0.1:59849 2023-07-20 12:10:40,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 12:10:40,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-20 12:10:40,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 12:10:40,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-20 12:10:40,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-20 12:10:40,682 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-20 12:10:40,683 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689855640683 2023-07-20 12:10:40,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-20 12:10:40,683 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-20 12:10:40,686 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-20 12:10:40,687 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-20 12:10:40,688 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 13 msec 2023-07-20 12:10:40,689 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-20 12:10:40,690 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689855640690 2023-07-20 12:10:40,692 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 12:10:40,693 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 12:10:40,714 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,715 INFO [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-20 12:10:40,715 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:10:40,716 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-20 12:10:40,716 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-20 12:10:40,716 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,716 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,721 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:10:40,721 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:10:40,721 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:40,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:10:40,721 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:10:40,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:10:40,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:10:40,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:10:40,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:10:40,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:10:40,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,723 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:40,723 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:40,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,724 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,724 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,724 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:40,724 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 12:10:40,724 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-20 12:10:40,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-20 12:10:40,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,725 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-20 12:10:40,726 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-20 12:10:40,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-20 12:10:40,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,726 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-20 12:10:40,728 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,728 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,728 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,729 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-20 12:10:40,729 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:10:40,730 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-20 12:10:40,730 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-20 12:10:40,730 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-20 12:10:40,730 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41865,1689855028765' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-20 12:10:40,730 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-20 12:10:40,730 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:10:40,730 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:10:40,731 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-20 12:10:40,731 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-20 12:10:40,731 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-20 12:10:40,731 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39003,1689855028825' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-20 12:10:40,732 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-20 12:10:40,732 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43611,1689855028889' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-20 12:10:40,734 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,735 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:40,735 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:40,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:10:40,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:10:40,737 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,737 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:40,737 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:10:40,737 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 12:10:40,737 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,737 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 12:10:40,737 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:10:40,737 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 12:10:40,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:40,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:40,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:40,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:10:40,740 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39003,1689855028825' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-20 12:10:40,740 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6cfb0a57[Count = 1] remaining members to acquire global barrier 2023-07-20 12:10:40,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:40,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:10:40,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:10:40,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:10:40,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:10:40,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:40,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:40,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:40,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:10:40,742 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43611,1689855028889' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-20 12:10:40,742 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6cfb0a57[Count = 0] remaining members to acquire global barrier 2023-07-20 12:10:40,742 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-20 12:10:40,742 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,744 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,744 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,745 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-20 12:10:40,745 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-20 12:10:40,744 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,745 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:40,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,745 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-20 12:10:40,745 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-20 12:10:40,745 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41865,1689855028765' in zk 2023-07-20 12:10:40,745 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:40,745 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 12:10:40,746 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 12:10:40,746 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 12:10:40,746 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689855039428.892b85871b26d782d22c02a479dc367e. 2023-07-20 12:10:40,746 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689855039428.9263122b8bfb4ddbeb4a907c820434fa. 2023-07-20 12:10:40,746 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 12:10:40,746 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 12:10:40,746 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689855039428.892b85871b26d782d22c02a479dc367e. started... 2023-07-20 12:10:40,746 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689855039428.9263122b8bfb4ddbeb4a907c820434fa. started... 2023-07-20 12:10:40,748 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-20 12:10:40,748 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:10:40,748 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-20 12:10:40,751 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 892b85871b26d782d22c02a479dc367e: 2023-07-20 12:10:40,751 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9263122b8bfb4ddbeb4a907c820434fa: 2023-07-20 12:10:40,752 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689855039428.9263122b8bfb4ddbeb4a907c820434fa.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,752 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689855039428.892b85871b26d782d22c02a479dc367e.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,758 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 12:10:40,758 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 12:10:40,761 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 12:10:40,761 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 12:10:40,784 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689855039428.892b85871b26d782d22c02a479dc367e. completed. 2023-07-20 12:10:40,784 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689855039428.892b85871b26d782d22c02a479dc367e. 2023-07-20 12:10:40,784 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 12:10:40,784 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 12:10:40,784 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:40,785 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-20 12:10:40,785 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39003,1689855028825' in zk 2023-07-20 12:10:40,785 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689855039428.9263122b8bfb4ddbeb4a907c820434fa. completed. 2023-07-20 12:10:40,785 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689855039428.9263122b8bfb4ddbeb4a907c820434fa. 2023-07-20 12:10:40,785 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 12:10:40,785 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 12:10:40,785 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:40,785 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-20 12:10:40,785 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43611,1689855028889' in zk 2023-07-20 12:10:40,787 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:40,787 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-20 12:10:40,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:40,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:10:40,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:10:40,787 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:10:40,787 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-20 12:10:40,789 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:40,789 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-20 12:10:40,789 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:10:40,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:10:40,789 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-20 12:10:40,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:10:40,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:40,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:40,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:40,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:10:40,793 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 12:10:40,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:40,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:40,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:40,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39003,1689855028825': 2023-07-20 12:10:40,795 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39003,1689855028825' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-20 12:10:40,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:40,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:10:40,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:10:40,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:10:40,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:10:40,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 12:10:40,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:40,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:40,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:40,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-20 12:10:40,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:10:40,798 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 12:10:40,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:40,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:40,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:40,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43611,1689855028889': 2023-07-20 12:10:40,800 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43611,1689855028889' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-20 12:10:40,800 INFO [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-20 12:10:40,800 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 12:10:40,800 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 12:10:40,800 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,800 INFO [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 12:10:40,803 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,803 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:10:40,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,804 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,804 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,804 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,804 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:10:40,804 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:10:40,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:10:40,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:10:40,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,804 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:40,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:10:40,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:10:40,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:10:40,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:10:40,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:10:40,805 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:40,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:10:40,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:10:40,805 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:40,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:10:40,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:40,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:40,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:40,808 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:40,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:10:40,809 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:40,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,809 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:40,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:40,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:40,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:40,825 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:10:40,825 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:10:40,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:10:40,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:10:40,825 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:10:40,825 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:40,825 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,825 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:40,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:10:40,825 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:10:40,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:10:40,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:10:40,825 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:10:40,825 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:10:40,826 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:10:40,826 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-20 12:10:40,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:10:40,825 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:40,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:10:40,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:10:40,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:10:40,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:10:40,826 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,826 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:10:40,826 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 12:10:40,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:10:40,826 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,828 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:40,828 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,828 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:40,828 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:40,828 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,828 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,828 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-20 12:10:40,847 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,900 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,940 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-20 12:10:40,941 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,941 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:40,942 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689855040683Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689855040847 (+164 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689855040847Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689855040847Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689855040859 (+12 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689855040886 (+27 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689855040940 (+54 ms) 2023-07-20 12:10:40,943 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-20 12:10:40,946 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 258 msec 2023-07-20 12:10:40,998 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 12:10:41,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 12:10:41,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 12:10:41,017 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39003] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689855039428.892b85871b26d782d22c02a479dc367e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 12:10:41,020 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43611] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689855039428.9263122b8bfb4ddbeb4a907c820434fa. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 12:10:41,026 DEBUG [Listener at jenkins-hbase4.apache.org/34263] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-20 12:10:41,026 DEBUG [Listener at jenkins-hbase4.apache.org/34263] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689855039428.892b85871b26d782d22c02a479dc367e. 2023-07-20 12:10:41,026 INFO [Listener at jenkins-hbase4.apache.org/34263] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 12:10:41,049 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-20 12:10:41,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689855041049 (current time:1689855041049). 2023-07-20 12:10:41,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 12:10:41,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(139): Connect 0x0b1dd17f to 127.0.0.1:59849 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 12:10:41,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@752d58c7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 12:10:41,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:10:41,082 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53590, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:10:41,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b1dd17f to 127.0.0.1:59849 2023-07-20 12:10:41,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 12:10:41,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(139): Connect 0x20dc5967 to 127.0.0.1:59849 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 12:10:41,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@452ff22a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 12:10:41,105 DEBUG [hconnection-0x5a5b6128-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:10:41,112 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53602, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:10:41,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:10:41,122 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47562, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:10:41,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x20dc5967 to 127.0.0.1:59849 2023-07-20 12:10:41,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 12:10:41,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-20 12:10:41,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 12:10:41,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-20 12:10:41,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-20 12:10:41,129 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-20 12:10:41,130 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689855641130 2023-07-20 12:10:41,130 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-20 12:10:41,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-20 12:10:41,132 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 12:10:41,132 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 12:10:41,133 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-20 12:10:41,133 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-20 12:10:41,139 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-07-20 12:10:41,144 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-20 12:10:41,146 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689855641146 2023-07-20 12:10:41,195 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-20 12:10:41,196 INFO [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-20 12:10:41,196 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:10:41,197 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-20 12:10:41,197 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-20 12:10:41,197 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,197 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,199 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:10:41,199 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:10:41,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:10:41,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:10:41,199 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:10:41,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:10:41,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:10:41,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:10:41,199 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:41,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:10:41,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,200 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:41,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,200 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:41,200 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,200 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,201 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,201 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:41,201 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 12:10:41,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-20 12:10:41,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-20 12:10:41,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,201 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-20 12:10:41,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-20 12:10:41,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,201 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-20 12:10:41,201 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-20 12:10:41,202 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-20 12:10:41,202 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-20 12:10:41,202 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-20 12:10:41,202 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:10:41,202 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-20 12:10:41,202 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-20 12:10:41,203 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:10:41,203 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-20 12:10:41,204 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-20 12:10:41,203 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-20 12:10:41,204 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-20 12:10:41,204 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-20 12:10:41,204 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39003,1689855028825' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-20 12:10:41,204 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:10:41,204 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41865,1689855028765' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-20 12:10:41,205 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-20 12:10:41,205 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-20 12:10:41,205 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43611,1689855028889' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-20 12:10:41,208 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,209 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:41,209 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:41,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:41,209 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:10:41,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:10:41,209 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,209 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,209 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 12:10:41,211 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:10:41,211 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,211 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 12:10:41,211 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 12:10:41,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:10:41,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 12:10:41,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:41,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:41,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:41,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:10:41,213 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39003,1689855028825' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-20 12:10:41,213 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d5c126a[Count = 1] remaining members to acquire global barrier 2023-07-20 12:10:41,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:41,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:10:41,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:10:41,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:10:41,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:10:41,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 12:10:41,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:41,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:41,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:41,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:10:41,216 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43611,1689855028889' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-20 12:10:41,217 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d5c126a[Count = 0] remaining members to acquire global barrier 2023-07-20 12:10:41,217 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-20 12:10:41,217 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,222 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,222 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,222 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,222 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-20 12:10:41,222 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-20 12:10:41,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,222 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:41,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,223 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-20 12:10:41,223 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-20 12:10:41,223 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41865,1689855028765' in zk 2023-07-20 12:10:41,223 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:41,223 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 12:10:41,226 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 12:10:41,226 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 12:10:41,226 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689855039428.892b85871b26d782d22c02a479dc367e. 2023-07-20 12:10:41,226 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-20 12:10:41,226 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 12:10:41,226 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689855039428.9263122b8bfb4ddbeb4a907c820434fa. 2023-07-20 12:10:41,226 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 12:10:41,226 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689855039428.9263122b8bfb4ddbeb4a907c820434fa. started... 2023-07-20 12:10:41,226 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:10:41,226 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689855039428.892b85871b26d782d22c02a479dc367e. started... 2023-07-20 12:10:41,233 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 12:10:41,226 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-20 12:10:41,233 INFO [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 892b85871b26d782d22c02a479dc367e 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-20 12:10:41,233 INFO [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9263122b8bfb4ddbeb4a907c820434fa 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-20 12:10:41,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 12:10:41,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-20 12:10:41,235 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 12:10:41,398 INFO [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230720dc22752934d74ae8bb090afa1bc4eecf to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230720dc22752934d74ae8bb090afa1bc4eecf 2023-07-20 12:10:41,398 INFO [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230720b11f387601804787b864317129e00c28 to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230720b11f387601804787b864317129e00c28 2023-07-20 12:10:41,436 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 12:10:41,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 12:10:41,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-20 12:10:41,454 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 12:10:41,460 INFO [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportWithTargetName/892b85871b26d782d22c02a479dc367e/.tmp/cf/d69a9087f3354f9d9c9ac210ab928c35 2023-07-20 12:10:41,465 INFO [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportWithTargetName/9263122b8bfb4ddbeb4a907c820434fa/.tmp/cf/a04f9cc2614749b4a85661428c85c05a 2023-07-20 12:10:41,472 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportWithTargetName/892b85871b26d782d22c02a479dc367e/.tmp/cf/d69a9087f3354f9d9c9ac210ab928c35 as hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportWithTargetName/892b85871b26d782d22c02a479dc367e/cf/d69a9087f3354f9d9c9ac210ab928c35 2023-07-20 12:10:41,474 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportWithTargetName/9263122b8bfb4ddbeb4a907c820434fa/.tmp/cf/a04f9cc2614749b4a85661428c85c05a as hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportWithTargetName/9263122b8bfb4ddbeb4a907c820434fa/cf/a04f9cc2614749b4a85661428c85c05a 2023-07-20 12:10:41,482 INFO [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportWithTargetName/892b85871b26d782d22c02a479dc367e/cf/d69a9087f3354f9d9c9ac210ab928c35, entries=4, sequenceid=6, filesize=5.6 K 2023-07-20 12:10:41,484 INFO [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportWithTargetName/9263122b8bfb4ddbeb4a907c820434fa/cf/a04f9cc2614749b4a85661428c85c05a, entries=46, sequenceid=6, filesize=12.6 K 2023-07-20 12:10:41,487 INFO [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 892b85871b26d782d22c02a479dc367e in 254ms, sequenceid=6, compaction requested=false 2023-07-20 12:10:41,487 INFO [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 9263122b8bfb4ddbeb4a907c820434fa in 254ms, sequenceid=6, compaction requested=false 2023-07-20 12:10:41,487 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-20 12:10:41,488 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-20 12:10:41,490 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 892b85871b26d782d22c02a479dc367e: 2023-07-20 12:10:41,490 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9263122b8bfb4ddbeb4a907c820434fa: 2023-07-20 12:10:41,490 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689855039428.892b85871b26d782d22c02a479dc367e.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-20 12:10:41,490 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 12:10:41,490 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689855039428.9263122b8bfb4ddbeb4a907c820434fa.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-20 12:10:41,490 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportWithTargetName/892b85871b26d782d22c02a479dc367e/cf/d69a9087f3354f9d9c9ac210ab928c35] hfiles 2023-07-20 12:10:41,490 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 12:10:41,490 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportWithTargetName/892b85871b26d782d22c02a479dc367e/cf/d69a9087f3354f9d9c9ac210ab928c35 for snapshot=snaptb0-testExportWithTargetName 2023-07-20 12:10:41,490 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportWithTargetName/9263122b8bfb4ddbeb4a907c820434fa/cf/a04f9cc2614749b4a85661428c85c05a] hfiles 2023-07-20 12:10:41,491 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportWithTargetName/9263122b8bfb4ddbeb4a907c820434fa/cf/a04f9cc2614749b4a85661428c85c05a for snapshot=snaptb0-testExportWithTargetName 2023-07-20 12:10:41,526 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689855039428.9263122b8bfb4ddbeb4a907c820434fa. completed. 2023-07-20 12:10:41,526 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689855039428.9263122b8bfb4ddbeb4a907c820434fa. 2023-07-20 12:10:41,526 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 12:10:41,526 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 12:10:41,526 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:41,526 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-20 12:10:41,526 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43611,1689855028889' in zk 2023-07-20 12:10:41,527 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689855039428.892b85871b26d782d22c02a479dc367e. completed. 2023-07-20 12:10:41,527 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689855039428.892b85871b26d782d22c02a479dc367e. 2023-07-20 12:10:41,528 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 12:10:41,528 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 12:10:41,528 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:41,528 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-20 12:10:41,528 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39003,1689855028825' in zk 2023-07-20 12:10:41,528 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-20 12:10:41,528 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:41,528 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:10:41,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:41,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:10:41,528 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-20 12:10:41,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:10:41,531 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:41,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:10:41,531 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-20 12:10:41,531 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:10:41,531 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-20 12:10:41,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:10:41,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 12:10:41,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:41,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:41,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:41,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:10:41,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 12:10:41,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:41,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:41,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:41,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43611,1689855028889': 2023-07-20 12:10:41,536 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43611,1689855028889' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-20 12:10:41,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:41,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:10:41,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:10:41,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:10:41,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:10:41,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 12:10:41,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:41,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:41,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:41,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:10:41,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 12:10:41,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:41,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:41,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:41,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39003,1689855028825': 2023-07-20 12:10:41,541 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39003,1689855028825' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-20 12:10:41,541 INFO [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-20 12:10:41,541 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 12:10:41,541 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 12:10:41,541 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-20 12:10:41,541 INFO [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 12:10:41,544 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,544 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:10:41,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:10:41,544 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,544 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:10:41,544 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:10:41,544 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:10:41,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:10:41,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,545 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:41,545 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:10:41,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:10:41,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:10:41,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:10:41,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 12:10:41,545 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:41,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:10:41,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:10:41,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:10:41,546 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:41,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 12:10:41,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:41,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:41,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:41,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:10:41,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 12:10:41,549 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:41,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:41,550 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:41,551 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:41,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:41,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:41,564 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:10:41,564 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:10:41,564 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:41,564 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:10:41,564 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:10:41,564 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,565 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:10:41,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:10:41,564 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-20 12:10:41,564 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:10:41,566 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-20 12:10:41,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:10:41,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:10:41,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:10:41,564 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:10:41,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:10:41,566 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-20 12:10:41,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:10:41,566 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 12:10:41,566 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:41,566 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:41,566 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,566 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:41,566 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,566 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:41,567 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:41,567 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,567 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:10:41,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:10:41,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:10:41,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:10:41,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:10:41,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:10:41,568 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230720dc22752934d74ae8bb090afa1bc4eecf, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230720b11f387601804787b864317129e00c28] mob files 2023-07-20 12:10:41,568 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230720dc22752934d74ae8bb090afa1bc4eecf 2023-07-20 12:10:41,568 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230720b11f387601804787b864317129e00c28 2023-07-20 12:10:41,585 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-20 12:10:41,585 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,635 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,703 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-20 12:10:41,703 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,704 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-20 12:10:41,704 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689855041130Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689855041585 (+455 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689855041585Loading Region manifests for snaptb0-testExportWithTargetName at 1689855041585Writing data manifest for snaptb0-testExportWithTargetName at 1689855041590 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689855041617 (+27 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689855041703 (+86 ms) 2023-07-20 12:10:41,707 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-20 12:10:41,710 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 577 msec 2023-07-20 12:10:41,754 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 12:10:41,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 12:10:41,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 12:10:41,758 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855041758 2023-07-20 12:10:41,759 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37499, tgtDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855041758, rawTgtDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855041758, srcFsUri=hdfs://localhost:37499, srcDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc 2023-07-20 12:10:41,810 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37499, inputRoot=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc 2023-07-20 12:10:41,810 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_553555330_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855041758, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855041758/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-20 12:10:41,811 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37499, inputRoot=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc, snapshotDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-20 12:10:41,861 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855041758/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-20 12:10:42,006 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 12:10:42,007 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 12:10:42,008 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 12:10:42,008 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 12:10:43,043 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/hadoop-2133885455637551469.jar 2023-07-20 12:10:43,044 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 12:10:43,045 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 12:10:43,134 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/hadoop-3208439340409650833.jar 2023-07-20 12:10:43,134 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 12:10:43,135 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 12:10:43,135 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 12:10:43,136 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 12:10:43,137 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 12:10:43,137 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 12:10:43,137 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 12:10:43,138 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 12:10:43,139 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 12:10:43,139 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 12:10:43,140 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 12:10:43,140 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 12:10:43,141 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 12:10:43,141 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 12:10:43,142 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 12:10:43,142 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 12:10:43,147 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 12:10:43,147 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 12:10:43,148 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 12:10:43,148 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 12:10:43,148 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 12:10:43,149 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 12:10:43,150 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 12:10:44,152 WARN [Listener at jenkins-hbase4.apache.org/34263] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 12:10:44,157 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-20 12:10:44,166 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-20 12:10:44,721 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 12:10:44,723 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 12:10:45,240 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689855037970_0001_000001 (auth:SIMPLE) 2023-07-20 12:10:45,834 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 12:10:50,621 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689855037970_0001_000001 (auth:SIMPLE) 2023-07-20 12:10:52,871 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689855037970_0001_000001 (auth:SIMPLE) 2023-07-20 12:10:56,219 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689855037970_0001_000001 (auth:SIMPLE) 2023-07-20 12:10:58,165 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 12:10:58,167 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 12:10:58,178 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-20 12:10:58,178 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 12:10:58,179 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 12:10:58,179 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1891902696_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-20 12:10:58,180 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(367): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-20 12:10:58,180 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(367): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-20 12:10:58,180 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1891902696_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855041758/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855041758/.hbase-snapshot/testExportWithTargetName 2023-07-20 12:10:58,181 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(367): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855041758/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-20 12:10:58,181 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(367): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855041758/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-20 12:10:58,194 INFO [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-20 12:10:58,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-20 12:10:58,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-20 12:10:58,215 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689855058214"}]},"ts":"1689855058214"} 2023-07-20 12:10:58,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-20 12:10:58,216 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-20 12:10:58,218 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-20 12:10:58,220 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=892b85871b26d782d22c02a479dc367e, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9263122b8bfb4ddbeb4a907c820434fa, UNASSIGN}] 2023-07-20 12:10:58,222 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=892b85871b26d782d22c02a479dc367e, UNASSIGN 2023-07-20 12:10:58,223 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9263122b8bfb4ddbeb4a907c820434fa, UNASSIGN 2023-07-20 12:10:58,224 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=892b85871b26d782d22c02a479dc367e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:58,224 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=9263122b8bfb4ddbeb4a907c820434fa, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:58,224 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689855039428.892b85871b26d782d22c02a479dc367e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689855058224"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689855058224"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689855058224"}]},"ts":"1689855058224"} 2023-07-20 12:10:58,224 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689855039428.9263122b8bfb4ddbeb4a907c820434fa.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689855058224"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689855058224"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689855058224"}]},"ts":"1689855058224"} 2023-07-20 12:10:58,226 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 892b85871b26d782d22c02a479dc367e, server=jenkins-hbase4.apache.org,39003,1689855028825}] 2023-07-20 12:10:58,227 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 9263122b8bfb4ddbeb4a907c820434fa, server=jenkins-hbase4.apache.org,43611,1689855028889}] 2023-07-20 12:10:58,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-20 12:10:58,387 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 892b85871b26d782d22c02a479dc367e 2023-07-20 12:10:58,387 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9263122b8bfb4ddbeb4a907c820434fa 2023-07-20 12:10:58,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 892b85871b26d782d22c02a479dc367e, disabling compactions & flushes 2023-07-20 12:10:58,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9263122b8bfb4ddbeb4a907c820434fa, disabling compactions & flushes 2023-07-20 12:10:58,388 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689855039428.892b85871b26d782d22c02a479dc367e. 2023-07-20 12:10:58,388 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689855039428.9263122b8bfb4ddbeb4a907c820434fa. 2023-07-20 12:10:58,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689855039428.892b85871b26d782d22c02a479dc367e. 2023-07-20 12:10:58,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689855039428.9263122b8bfb4ddbeb4a907c820434fa. 2023-07-20 12:10:58,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689855039428.892b85871b26d782d22c02a479dc367e. after waiting 0 ms 2023-07-20 12:10:58,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689855039428.9263122b8bfb4ddbeb4a907c820434fa. after waiting 0 ms 2023-07-20 12:10:58,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689855039428.9263122b8bfb4ddbeb4a907c820434fa. 2023-07-20 12:10:58,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689855039428.892b85871b26d782d22c02a479dc367e. 2023-07-20 12:10:58,401 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportWithTargetName/9263122b8bfb4ddbeb4a907c820434fa/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 12:10:58,401 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportWithTargetName/892b85871b26d782d22c02a479dc367e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 12:10:58,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 12:10:58,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 12:10:58,403 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689855039428.892b85871b26d782d22c02a479dc367e. 2023-07-20 12:10:58,403 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689855039428.9263122b8bfb4ddbeb4a907c820434fa. 2023-07-20 12:10:58,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 892b85871b26d782d22c02a479dc367e: 2023-07-20 12:10:58,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9263122b8bfb4ddbeb4a907c820434fa: 2023-07-20 12:10:58,405 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9263122b8bfb4ddbeb4a907c820434fa 2023-07-20 12:10:58,406 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=9263122b8bfb4ddbeb4a907c820434fa, regionState=CLOSED 2023-07-20 12:10:58,406 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 892b85871b26d782d22c02a479dc367e 2023-07-20 12:10:58,406 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689855039428.9263122b8bfb4ddbeb4a907c820434fa.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689855058406"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689855058406"}]},"ts":"1689855058406"} 2023-07-20 12:10:58,407 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=892b85871b26d782d22c02a479dc367e, regionState=CLOSED 2023-07-20 12:10:58,407 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689855039428.892b85871b26d782d22c02a479dc367e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689855058407"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689855058407"}]},"ts":"1689855058407"} 2023-07-20 12:10:58,413 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-20 12:10:58,413 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 9263122b8bfb4ddbeb4a907c820434fa, server=jenkins-hbase4.apache.org,43611,1689855028889 in 182 msec 2023-07-20 12:10:58,414 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-20 12:10:58,414 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 892b85871b26d782d22c02a479dc367e, server=jenkins-hbase4.apache.org,39003,1689855028825 in 184 msec 2023-07-20 12:10:58,417 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9263122b8bfb4ddbeb4a907c820434fa, UNASSIGN in 193 msec 2023-07-20 12:10:58,419 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-20 12:10:58,419 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=892b85871b26d782d22c02a479dc367e, UNASSIGN in 194 msec 2023-07-20 12:10:58,421 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689855058420"}]},"ts":"1689855058420"} 2023-07-20 12:10:58,423 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-20 12:10:58,424 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-20 12:10:58,427 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 222 msec 2023-07-20 12:10:58,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-20 12:10:58,519 INFO [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-20 12:10:58,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-20 12:10:58,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-20 12:10:58,535 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-20 12:10:58,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-20 12:10:58,537 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-20 12:10:58,541 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43611] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-20 12:10:58,544 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 12:10:58,544 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 12:10:58,544 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 12:10:58,544 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 12:10:58,545 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-20 12:10:58,545 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-20 12:10:58,545 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportWithTargetName/892b85871b26d782d22c02a479dc367e 2023-07-20 12:10:58,545 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-20 12:10:58,545 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-20 12:10:58,545 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportWithTargetName/9263122b8bfb4ddbeb4a907c820434fa 2023-07-20 12:10:58,546 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 12:10:58,546 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 12:10:58,546 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 12:10:58,547 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:10:58,547 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:10:58,546 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 12:10:58,546 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:10:58,547 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:10:58,550 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportWithTargetName/892b85871b26d782d22c02a479dc367e/cf, FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportWithTargetName/892b85871b26d782d22c02a479dc367e/recovered.edits] 2023-07-20 12:10:58,550 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportWithTargetName/9263122b8bfb4ddbeb4a907c820434fa/cf, FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportWithTargetName/9263122b8bfb4ddbeb4a907c820434fa/recovered.edits] 2023-07-20 12:10:58,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-20 12:10:58,559 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportWithTargetName/9263122b8bfb4ddbeb4a907c820434fa/cf/a04f9cc2614749b4a85661428c85c05a to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testExportWithTargetName/9263122b8bfb4ddbeb4a907c820434fa/cf/a04f9cc2614749b4a85661428c85c05a 2023-07-20 12:10:58,559 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportWithTargetName/892b85871b26d782d22c02a479dc367e/cf/d69a9087f3354f9d9c9ac210ab928c35 to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testExportWithTargetName/892b85871b26d782d22c02a479dc367e/cf/d69a9087f3354f9d9c9ac210ab928c35 2023-07-20 12:10:58,564 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportWithTargetName/9263122b8bfb4ddbeb4a907c820434fa/recovered.edits/9.seqid to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testExportWithTargetName/9263122b8bfb4ddbeb4a907c820434fa/recovered.edits/9.seqid 2023-07-20 12:10:58,564 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportWithTargetName/892b85871b26d782d22c02a479dc367e/recovered.edits/9.seqid to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testExportWithTargetName/892b85871b26d782d22c02a479dc367e/recovered.edits/9.seqid 2023-07-20 12:10:58,564 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportWithTargetName/9263122b8bfb4ddbeb4a907c820434fa 2023-07-20 12:10:58,565 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportWithTargetName/892b85871b26d782d22c02a479dc367e 2023-07-20 12:10:58,565 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-20 12:10:58,565 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-20 12:10:58,566 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-20 12:10:58,571 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230720dc22752934d74ae8bb090afa1bc4eecf to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230720dc22752934d74ae8bb090afa1bc4eecf 2023-07-20 12:10:58,572 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230720b11f387601804787b864317129e00c28 to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230720b11f387601804787b864317129e00c28 2023-07-20 12:10:58,573 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-20 12:10:58,576 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-20 12:10:58,600 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-20 12:10:58,604 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-20 12:10:58,605 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-20 12:10:58,605 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-20 12:10:58,606 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689855039428.892b85871b26d782d22c02a479dc367e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689855058605"}]},"ts":"9223372036854775807"} 2023-07-20 12:10:58,606 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689855039428.9263122b8bfb4ddbeb4a907c820434fa.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689855058605"}]},"ts":"9223372036854775807"} 2023-07-20 12:10:58,608 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-20 12:10:58,608 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 892b85871b26d782d22c02a479dc367e, NAME => 'testtb-testExportWithTargetName,,1689855039428.892b85871b26d782d22c02a479dc367e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 9263122b8bfb4ddbeb4a907c820434fa, NAME => 'testtb-testExportWithTargetName,1,1689855039428.9263122b8bfb4ddbeb4a907c820434fa.', STARTKEY => '1', ENDKEY => ''}] 2023-07-20 12:10:58,608 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-20 12:10:58,609 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689855058609"}]},"ts":"9223372036854775807"} 2023-07-20 12:10:58,611 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-20 12:10:58,614 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-20 12:10:58,617 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 89 msec 2023-07-20 12:10:58,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-20 12:10:58,653 INFO [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-20 12:10:58,673 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-20 12:10:58,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-20 12:10:58,680 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-20 12:10:58,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-20 12:10:58,712 INFO [Listener at jenkins-hbase4.apache.org/34263] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=754 (was 708) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/cluster_516f25e7-6d47-16d0-f492-9f19a2a0360c/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18f07d5b-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1315 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/cluster_516f25e7-6d47-16d0-f492-9f19a2a0360c/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1753867629) connection to jenkins-hbase4.apache.org/172.31.14.131:41243 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1753867629) connection to jenkins-hbase4.apache.org/172.31.14.131:42371 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18f07d5b-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/cluster_516f25e7-6d47-16d0-f492-9f19a2a0360c/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/cluster_516f25e7-6d47-16d0-f492-9f19a2a0360c/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18f07d5b-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/cluster_516f25e7-6d47-16d0-f492-9f19a2a0360c/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_49558370_1 at /127.0.0.1:56634 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1891902696_17 at /127.0.0.1:42976 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18f07d5b-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/cluster_516f25e7-6d47-16d0-f492-9f19a2a0360c/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1891902696_17 at /127.0.0.1:48486 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_49558370_1 at /127.0.0.1:48472 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1891902696_17 at /127.0.0.1:56666 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=923 (was 898) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=412 (was 276) - SystemLoadAverage LEAK? -, ProcessCount=188 (was 179) - ProcessCount LEAK? -, AvailableMemoryMB=3273 (was 4986) 2023-07-20 12:10:58,713 WARN [Listener at jenkins-hbase4.apache.org/34263] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-07-20 12:10:58,733 INFO [Listener at jenkins-hbase4.apache.org/34263] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=754, OpenFileDescriptor=923, MaxFileDescriptor=60000, SystemLoadAverage=412, ProcessCount=188, AvailableMemoryMB=3273 2023-07-20 12:10:58,733 WARN [Listener at jenkins-hbase4.apache.org/34263] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-07-20 12:10:58,735 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-20 12:10:58,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-20 12:10:58,740 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 12:10:58,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-20 12:10:58,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-20 12:10:58,742 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 12:10:58,745 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemState/6be381d452f8e9a5a4c335cfcfde0718 2023-07-20 12:10:58,745 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemState/562c9643fc58e63cd931b7b833c7e986 2023-07-20 12:10:58,745 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemState/6be381d452f8e9a5a4c335cfcfde0718 empty. 2023-07-20 12:10:58,746 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemState/562c9643fc58e63cd931b7b833c7e986 empty. 2023-07-20 12:10:58,746 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemState/562c9643fc58e63cd931b7b833c7e986 2023-07-20 12:10:58,746 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemState/6be381d452f8e9a5a4c335cfcfde0718 2023-07-20 12:10:58,746 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-20 12:10:58,760 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-20 12:10:58,761 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6be381d452f8e9a5a4c335cfcfde0718, NAME => 'testtb-testExportFileSystemState,,1689855058735.6be381d452f8e9a5a4c335cfcfde0718.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp 2023-07-20 12:10:58,761 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 562c9643fc58e63cd931b7b833c7e986, NAME => 'testtb-testExportFileSystemState,1,1689855058735.562c9643fc58e63cd931b7b833c7e986.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp 2023-07-20 12:10:58,795 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689855058735.6be381d452f8e9a5a4c335cfcfde0718.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 12:10:58,795 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689855058735.562c9643fc58e63cd931b7b833c7e986.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 12:10:58,798 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 6be381d452f8e9a5a4c335cfcfde0718, disabling compactions & flushes 2023-07-20 12:10:58,798 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 562c9643fc58e63cd931b7b833c7e986, disabling compactions & flushes 2023-07-20 12:10:58,798 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689855058735.6be381d452f8e9a5a4c335cfcfde0718. 2023-07-20 12:10:58,798 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689855058735.562c9643fc58e63cd931b7b833c7e986. 2023-07-20 12:10:58,798 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689855058735.6be381d452f8e9a5a4c335cfcfde0718. 2023-07-20 12:10:58,798 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689855058735.562c9643fc58e63cd931b7b833c7e986. 2023-07-20 12:10:58,798 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689855058735.6be381d452f8e9a5a4c335cfcfde0718. after waiting 0 ms 2023-07-20 12:10:58,799 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689855058735.562c9643fc58e63cd931b7b833c7e986. after waiting 0 ms 2023-07-20 12:10:58,799 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689855058735.6be381d452f8e9a5a4c335cfcfde0718. 2023-07-20 12:10:58,799 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689855058735.562c9643fc58e63cd931b7b833c7e986. 2023-07-20 12:10:58,799 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689855058735.6be381d452f8e9a5a4c335cfcfde0718. 2023-07-20 12:10:58,799 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 6be381d452f8e9a5a4c335cfcfde0718: 2023-07-20 12:10:58,799 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689855058735.562c9643fc58e63cd931b7b833c7e986. 2023-07-20 12:10:58,799 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 562c9643fc58e63cd931b7b833c7e986: 2023-07-20 12:10:58,803 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 12:10:58,804 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689855058735.6be381d452f8e9a5a4c335cfcfde0718.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689855058804"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689855058804"}]},"ts":"1689855058804"} 2023-07-20 12:10:58,805 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689855058735.562c9643fc58e63cd931b7b833c7e986.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689855058804"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689855058804"}]},"ts":"1689855058804"} 2023-07-20 12:10:58,808 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 12:10:58,809 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 12:10:58,810 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689855058809"}]},"ts":"1689855058809"} 2023-07-20 12:10:58,812 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-20 12:10:58,817 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 12:10:58,819 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 12:10:58,819 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 12:10:58,819 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 12:10:58,819 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 12:10:58,820 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6be381d452f8e9a5a4c335cfcfde0718, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=562c9643fc58e63cd931b7b833c7e986, ASSIGN}] 2023-07-20 12:10:58,823 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=562c9643fc58e63cd931b7b833c7e986, ASSIGN 2023-07-20 12:10:58,824 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6be381d452f8e9a5a4c335cfcfde0718, ASSIGN 2023-07-20 12:10:58,824 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=562c9643fc58e63cd931b7b833c7e986, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41865,1689855028765; forceNewPlan=false, retain=false 2023-07-20 12:10:58,825 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6be381d452f8e9a5a4c335cfcfde0718, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39003,1689855028825; forceNewPlan=false, retain=false 2023-07-20 12:10:58,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-20 12:10:58,975 INFO [jenkins-hbase4:46247] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 12:10:58,978 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=6be381d452f8e9a5a4c335cfcfde0718, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:58,978 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=562c9643fc58e63cd931b7b833c7e986, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:58,978 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689855058735.6be381d452f8e9a5a4c335cfcfde0718.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689855058978"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689855058978"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689855058978"}]},"ts":"1689855058978"} 2023-07-20 12:10:58,978 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689855058735.562c9643fc58e63cd931b7b833c7e986.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689855058978"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689855058978"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689855058978"}]},"ts":"1689855058978"} 2023-07-20 12:10:58,981 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 562c9643fc58e63cd931b7b833c7e986, server=jenkins-hbase4.apache.org,41865,1689855028765}] 2023-07-20 12:10:58,985 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 6be381d452f8e9a5a4c335cfcfde0718, server=jenkins-hbase4.apache.org,39003,1689855028825}] 2023-07-20 12:10:59,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-20 12:10:59,144 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689855058735.6be381d452f8e9a5a4c335cfcfde0718. 2023-07-20 12:10:59,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6be381d452f8e9a5a4c335cfcfde0718, NAME => 'testtb-testExportFileSystemState,,1689855058735.6be381d452f8e9a5a4c335cfcfde0718.', STARTKEY => '', ENDKEY => '1'} 2023-07-20 12:10:59,144 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689855058735.562c9643fc58e63cd931b7b833c7e986. 2023-07-20 12:10:59,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 562c9643fc58e63cd931b7b833c7e986, NAME => 'testtb-testExportFileSystemState,1,1689855058735.562c9643fc58e63cd931b7b833c7e986.', STARTKEY => '1', ENDKEY => ''} 2023-07-20 12:10:59,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689855058735.6be381d452f8e9a5a4c335cfcfde0718. service=AccessControlService 2023-07-20 12:10:59,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 12:10:59,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 6be381d452f8e9a5a4c335cfcfde0718 2023-07-20 12:10:59,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689855058735.6be381d452f8e9a5a4c335cfcfde0718.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 12:10:59,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6be381d452f8e9a5a4c335cfcfde0718 2023-07-20 12:10:59,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6be381d452f8e9a5a4c335cfcfde0718 2023-07-20 12:10:59,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689855058735.562c9643fc58e63cd931b7b833c7e986. service=AccessControlService 2023-07-20 12:10:59,146 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 12:10:59,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 562c9643fc58e63cd931b7b833c7e986 2023-07-20 12:10:59,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689855058735.562c9643fc58e63cd931b7b833c7e986.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 12:10:59,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 562c9643fc58e63cd931b7b833c7e986 2023-07-20 12:10:59,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 562c9643fc58e63cd931b7b833c7e986 2023-07-20 12:10:59,146 INFO [StoreOpener-6be381d452f8e9a5a4c335cfcfde0718-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6be381d452f8e9a5a4c335cfcfde0718 2023-07-20 12:10:59,148 INFO [StoreOpener-562c9643fc58e63cd931b7b833c7e986-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 562c9643fc58e63cd931b7b833c7e986 2023-07-20 12:10:59,148 DEBUG [StoreOpener-6be381d452f8e9a5a4c335cfcfde0718-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemState/6be381d452f8e9a5a4c335cfcfde0718/cf 2023-07-20 12:10:59,148 DEBUG [StoreOpener-6be381d452f8e9a5a4c335cfcfde0718-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemState/6be381d452f8e9a5a4c335cfcfde0718/cf 2023-07-20 12:10:59,149 INFO [StoreOpener-6be381d452f8e9a5a4c335cfcfde0718-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6be381d452f8e9a5a4c335cfcfde0718 columnFamilyName cf 2023-07-20 12:10:59,150 DEBUG [StoreOpener-562c9643fc58e63cd931b7b833c7e986-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemState/562c9643fc58e63cd931b7b833c7e986/cf 2023-07-20 12:10:59,150 DEBUG [StoreOpener-562c9643fc58e63cd931b7b833c7e986-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemState/562c9643fc58e63cd931b7b833c7e986/cf 2023-07-20 12:10:59,150 INFO [StoreOpener-562c9643fc58e63cd931b7b833c7e986-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 562c9643fc58e63cd931b7b833c7e986 columnFamilyName cf 2023-07-20 12:10:59,151 INFO [StoreOpener-6be381d452f8e9a5a4c335cfcfde0718-1] regionserver.HStore(310): Store=6be381d452f8e9a5a4c335cfcfde0718/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 12:10:59,152 INFO [StoreOpener-562c9643fc58e63cd931b7b833c7e986-1] regionserver.HStore(310): Store=562c9643fc58e63cd931b7b833c7e986/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 12:10:59,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemState/6be381d452f8e9a5a4c335cfcfde0718 2023-07-20 12:10:59,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemState/562c9643fc58e63cd931b7b833c7e986 2023-07-20 12:10:59,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemState/562c9643fc58e63cd931b7b833c7e986 2023-07-20 12:10:59,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemState/6be381d452f8e9a5a4c335cfcfde0718 2023-07-20 12:10:59,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 562c9643fc58e63cd931b7b833c7e986 2023-07-20 12:10:59,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6be381d452f8e9a5a4c335cfcfde0718 2023-07-20 12:10:59,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemState/562c9643fc58e63cd931b7b833c7e986/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 12:10:59,168 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 562c9643fc58e63cd931b7b833c7e986; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67895001, jitterRate=0.011714354157447815}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 12:10:59,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 562c9643fc58e63cd931b7b833c7e986: 2023-07-20 12:10:59,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemState/6be381d452f8e9a5a4c335cfcfde0718/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 12:10:59,170 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6be381d452f8e9a5a4c335cfcfde0718; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67961384, jitterRate=0.012703537940979004}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 12:10:59,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6be381d452f8e9a5a4c335cfcfde0718: 2023-07-20 12:10:59,171 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689855058735.6be381d452f8e9a5a4c335cfcfde0718., pid=31, masterSystemTime=1689855059139 2023-07-20 12:10:59,172 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689855058735.562c9643fc58e63cd931b7b833c7e986., pid=30, masterSystemTime=1689855059134 2023-07-20 12:10:59,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689855058735.6be381d452f8e9a5a4c335cfcfde0718. 2023-07-20 12:10:59,173 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689855058735.6be381d452f8e9a5a4c335cfcfde0718. 2023-07-20 12:10:59,175 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=6be381d452f8e9a5a4c335cfcfde0718, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:59,176 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689855058735.6be381d452f8e9a5a4c335cfcfde0718.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689855059175"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689855059175"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689855059175"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689855059175"}]},"ts":"1689855059175"} 2023-07-20 12:10:59,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689855058735.562c9643fc58e63cd931b7b833c7e986. 2023-07-20 12:10:59,176 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689855058735.562c9643fc58e63cd931b7b833c7e986. 2023-07-20 12:10:59,179 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=562c9643fc58e63cd931b7b833c7e986, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:59,179 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689855058735.562c9643fc58e63cd931b7b833c7e986.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689855059179"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689855059179"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689855059179"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689855059179"}]},"ts":"1689855059179"} 2023-07-20 12:10:59,185 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-20 12:10:59,185 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 6be381d452f8e9a5a4c335cfcfde0718, server=jenkins-hbase4.apache.org,39003,1689855028825 in 194 msec 2023-07-20 12:10:59,188 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-20 12:10:59,188 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6be381d452f8e9a5a4c335cfcfde0718, ASSIGN in 365 msec 2023-07-20 12:10:59,188 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 562c9643fc58e63cd931b7b833c7e986, server=jenkins-hbase4.apache.org,41865,1689855028765 in 202 msec 2023-07-20 12:10:59,191 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-20 12:10:59,191 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=562c9643fc58e63cd931b7b833c7e986, ASSIGN in 368 msec 2023-07-20 12:10:59,192 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 12:10:59,193 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689855059193"}]},"ts":"1689855059193"} 2023-07-20 12:10:59,198 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-20 12:10:59,202 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 12:10:59,202 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-20 12:10:59,204 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43611] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-20 12:10:59,206 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:10:59,206 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:10:59,206 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:10:59,206 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:10:59,207 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 12:10:59,207 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 12:10:59,207 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 12:10:59,207 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 12:10:59,210 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 472 msec 2023-07-20 12:10:59,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-20 12:10:59,346 INFO [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-20 12:10:59,349 DEBUG [Listener at jenkins-hbase4.apache.org/34263] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-20 12:10:59,349 DEBUG [Listener at jenkins-hbase4.apache.org/34263] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689855058735.6be381d452f8e9a5a4c335cfcfde0718. 2023-07-20 12:10:59,351 INFO [Listener at jenkins-hbase4.apache.org/34263] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 12:10:59,364 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 12:10:59,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689855059364 (current time:1689855059364). 2023-07-20 12:10:59,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 12:10:59,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(139): Connect 0x5bc1c616 to 127.0.0.1:59849 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 12:10:59,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d2d09a1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 12:10:59,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:10:59,375 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43986, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:10:59,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5bc1c616 to 127.0.0.1:59849 2023-07-20 12:10:59,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 12:10:59,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(139): Connect 0x1e6cdd19 to 127.0.0.1:59849 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 12:10:59,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b4859b4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 12:10:59,384 DEBUG [hconnection-0xe6d217d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:10:59,386 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44002, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:10:59,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:10:59,392 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35630, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:10:59,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1e6cdd19 to 127.0.0.1:59849 2023-07-20 12:10:59,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 12:10:59,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-20 12:10:59,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 12:10:59,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 12:10:59,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-20 12:10:59,398 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-20 12:10:59,399 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689855659399 2023-07-20 12:10:59,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 12:10:59,399 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-20 12:10:59,400 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 12:10:59,401 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 12:10:59,402 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-20 12:10:59,402 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-20 12:10:59,403 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-20 12:10:59,404 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-20 12:10:59,405 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689855659405 2023-07-20 12:10:59,441 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,442 INFO [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-20 12:10:59,442 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:10:59,443 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-20 12:10:59,444 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-20 12:10:59,444 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,444 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,448 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:10:59,448 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:10:59,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:10:59,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:10:59,448 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:10:59,448 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:59,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:10:59,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:10:59,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:10:59,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:10:59,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,449 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:59,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,449 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,449 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:59,453 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,453 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-20 12:10:59,453 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:59,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-20 12:10:59,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,454 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 12:10:59,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-20 12:10:59,454 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-20 12:10:59,454 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-20 12:10:59,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,454 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-20 12:10:59,454 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,454 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,454 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-20 12:10:59,455 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:10:59,455 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-20 12:10:59,455 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:10:59,460 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,462 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-20 12:10:59,462 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-20 12:10:59,462 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-20 12:10:59,462 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39003,1689855028825' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-20 12:10:59,462 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-20 12:10:59,462 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:10:59,462 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-20 12:10:59,464 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-20 12:10:59,464 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-20 12:10:59,464 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43611,1689855028889' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-20 12:10:59,464 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41865,1689855028765' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-20 12:10:59,466 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:59,466 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:59,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:10:59,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:10:59,472 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,472 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,472 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:59,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:10:59,472 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,472 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 12:10:59,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:10:59,473 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,473 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 12:10:59,473 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,473 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 12:10:59,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:59,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:59,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:59,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:10:59,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41865,1689855028765' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-20 12:10:59,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27fd12af[Count = 1] remaining members to acquire global barrier 2023-07-20 12:10:59,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:59,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:10:59,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:10:59,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:10:59,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:10:59,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:59,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:59,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:59,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:10:59,479 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39003,1689855028825' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-20 12:10:59,479 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27fd12af[Count = 0] remaining members to acquire global barrier 2023-07-20 12:10:59,479 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-20 12:10:59,479 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,481 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,481 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,481 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,481 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-20 12:10:59,481 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:59,481 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-20 12:10:59,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,481 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 12:10:59,481 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-20 12:10:59,481 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 12:10:59,481 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 12:10:59,481 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 12:10:59,481 DEBUG [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689855058735.562c9643fc58e63cd931b7b833c7e986. 2023-07-20 12:10:59,481 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689855058735.6be381d452f8e9a5a4c335cfcfde0718. 2023-07-20 12:10:59,481 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-20 12:10:59,482 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689855058735.6be381d452f8e9a5a4c335cfcfde0718. started... 2023-07-20 12:10:59,482 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43611,1689855028889' in zk 2023-07-20 12:10:59,482 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:59,482 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 12:10:59,481 DEBUG [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689855058735.562c9643fc58e63cd931b7b833c7e986. started... 2023-07-20 12:10:59,482 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6be381d452f8e9a5a4c335cfcfde0718: 2023-07-20 12:10:59,483 DEBUG [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 562c9643fc58e63cd931b7b833c7e986: 2023-07-20 12:10:59,484 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689855058735.6be381d452f8e9a5a4c335cfcfde0718.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,484 DEBUG [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689855058735.562c9643fc58e63cd931b7b833c7e986.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,484 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 12:10:59,484 DEBUG [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 12:10:59,484 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 12:10:59,484 DEBUG [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 12:10:59,485 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-20 12:10:59,485 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:10:59,485 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-20 12:10:59,501 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 12:10:59,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 12:10:59,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 12:10:59,502 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 12:10:59,510 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689855058735.6be381d452f8e9a5a4c335cfcfde0718. completed. 2023-07-20 12:10:59,510 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689855058735.6be381d452f8e9a5a4c335cfcfde0718. 2023-07-20 12:10:59,510 DEBUG [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689855058735.562c9643fc58e63cd931b7b833c7e986. completed. 2023-07-20 12:10:59,510 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 12:10:59,510 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 12:10:59,510 DEBUG [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689855058735.562c9643fc58e63cd931b7b833c7e986. 2023-07-20 12:10:59,510 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:59,510 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 12:10:59,511 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 12:10:59,510 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-20 12:10:59,511 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:59,511 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39003,1689855028825' in zk 2023-07-20 12:10:59,511 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-20 12:10:59,511 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41865,1689855028765' in zk 2023-07-20 12:10:59,512 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:59,512 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-20 12:10:59,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:59,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:10:59,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:10:59,512 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:59,512 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-20 12:10:59,512 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:10:59,513 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:10:59,513 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-20 12:10:59,514 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-20 12:10:59,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:10:59,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:10:59,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:59,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:59,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:59,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:10:59,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:59,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:59,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:59,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,41865,1689855028765': 2023-07-20 12:10:59,519 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41865,1689855028765' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-20 12:10:59,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:59,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:10:59,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:10:59,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:10:59,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:10:59,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:59,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:59,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:59,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:10:59,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:59,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:59,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:59,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39003,1689855028825': 2023-07-20 12:10:59,524 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39003,1689855028825' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-20 12:10:59,524 INFO [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-20 12:10:59,524 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 12:10:59,524 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 12:10:59,524 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,524 INFO [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 12:10:59,527 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,527 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:10:59,527 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,527 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:10:59,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,527 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:10:59,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:10:59,528 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,528 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:10:59,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:10:59,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:10:59,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:10:59,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:10:59,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:10:59,529 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:59,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,529 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:59,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:10:59,531 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:59,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:59,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:59,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:59,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:10:59,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,533 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:59,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:59,533 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:59,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:59,534 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:59,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:59,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:10:59,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:10:59,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,539 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:59,539 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,539 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:59,539 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:10:59,539 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:10:59,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:10:59,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:10:59,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:10:59,539 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:10:59,539 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:10:59,539 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:10:59,539 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:10:59,539 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:59,539 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:10:59,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:10:59,541 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:10:59,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:10:59,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:10:59,540 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-20 12:10:59,540 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:10:59,541 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:59,542 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,542 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,542 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 12:10:59,542 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:59,542 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:59,542 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:10:59,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:10:59,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:10:59,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:10:59,542 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,543 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-20 12:10:59,556 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,557 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,639 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,684 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-20 12:10:59,684 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,685 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-20 12:10:59,685 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689855059399Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689855059556 (+157 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689855059556Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689855059556Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689855059565 (+9 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689855059621 (+56 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689855059684 (+63 ms) 2023-07-20 12:10:59,688 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-20 12:10:59,695 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 288 msec 2023-07-20 12:10:59,702 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 12:10:59,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 12:10:59,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 12:10:59,711 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39003] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689855058735.6be381d452f8e9a5a4c335cfcfde0718. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 12:10:59,713 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41865] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689855058735.562c9643fc58e63cd931b7b833c7e986. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 12:10:59,717 DEBUG [Listener at jenkins-hbase4.apache.org/34263] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-20 12:10:59,717 DEBUG [Listener at jenkins-hbase4.apache.org/34263] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689855058735.6be381d452f8e9a5a4c335cfcfde0718. 2023-07-20 12:10:59,718 INFO [Listener at jenkins-hbase4.apache.org/34263] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 12:10:59,730 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 12:10:59,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689855059730 (current time:1689855059730). 2023-07-20 12:10:59,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 12:10:59,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(139): Connect 0x1d61900b to 127.0.0.1:59849 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 12:10:59,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10e93c20, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 12:10:59,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:10:59,747 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44008, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:10:59,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1d61900b to 127.0.0.1:59849 2023-07-20 12:10:59,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 12:10:59,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(139): Connect 0x7a1ed1cf to 127.0.0.1:59849 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 12:10:59,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@32bfde3e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 12:10:59,763 DEBUG [hconnection-0x275995f3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:10:59,765 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44012, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:10:59,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:10:59,775 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35640, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:10:59,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a1ed1cf to 127.0.0.1:59849 2023-07-20 12:10:59,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 12:10:59,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-20 12:10:59,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 12:10:59,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 12:10:59,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-20 12:10:59,787 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-20 12:10:59,788 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689855659788 2023-07-20 12:10:59,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 12:10:59,788 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-20 12:10:59,791 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-20 12:10:59,793 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 12:10:59,793 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 12:10:59,793 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-20 12:10:59,796 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 11 msec 2023-07-20 12:10:59,797 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-20 12:10:59,799 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689855659799 2023-07-20 12:10:59,818 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-20 12:10:59,818 INFO [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-20 12:10:59,818 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:10:59,820 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-20 12:10:59,820 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-20 12:10:59,820 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 12:10:59,820 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 12:10:59,822 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:10:59,822 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:10:59,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:10:59,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:10:59,822 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:10:59,822 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:59,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:10:59,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:10:59,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:10:59,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:10:59,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 12:10:59,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 12:10:59,822 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:59,823 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:59,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 12:10:59,823 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 12:10:59,823 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 12:10:59,823 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:59,823 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 12:10:59,823 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 12:10:59,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-20 12:10:59,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 12:10:59,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-20 12:10:59,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 12:10:59,824 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-20 12:10:59,824 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-20 12:10:59,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-20 12:10:59,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 12:10:59,824 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-20 12:10:59,824 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-20 12:10:59,824 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-20 12:10:59,824 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:10:59,826 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-20 12:10:59,828 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-20 12:10:59,828 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-20 12:10:59,828 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-20 12:10:59,828 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:10:59,828 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-20 12:10:59,829 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-20 12:10:59,830 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-20 12:10:59,828 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:10:59,830 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43611,1689855028889' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-20 12:10:59,829 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-20 12:10:59,831 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-20 12:10:59,831 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-20 12:10:59,831 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41865,1689855028765' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-20 12:10:59,831 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39003,1689855028825' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-20 12:10:59,832 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 12:10:59,835 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:59,835 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 12:10:59,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:59,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:10:59,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:10:59,835 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:59,835 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 12:10:59,835 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 12:10:59,835 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 12:10:59,836 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 12:10:59,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:10:59,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:10:59,837 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 12:10:59,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 12:10:59,837 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 12:10:59,837 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 12:10:59,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:59,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:59,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:59,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:10:59,839 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39003,1689855028825' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-20 12:10:59,839 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13e00db5[Count = 1] remaining members to acquire global barrier 2023-07-20 12:10:59,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:59,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:10:59,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:10:59,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:10:59,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:10:59,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 12:10:59,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:59,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:10:59,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:59,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:10:59,842 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41865,1689855028765' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-20 12:10:59,842 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13e00db5[Count = 0] remaining members to acquire global barrier 2023-07-20 12:10:59,842 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-20 12:10:59,842 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 12:10:59,844 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 12:10:59,844 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 12:10:59,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 12:10:59,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 12:10:59,844 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 12:10:59,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 12:10:59,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 12:10:59,844 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-20 12:10:59,844 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-20 12:10:59,844 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:10:59,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 12:10:59,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 12:10:59,845 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 12:10:59,845 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 12:10:59,845 DEBUG [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689855058735.562c9643fc58e63cd931b7b833c7e986. 2023-07-20 12:10:59,845 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-20 12:10:59,845 DEBUG [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689855058735.562c9643fc58e63cd931b7b833c7e986. started... 2023-07-20 12:10:59,845 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689855058735.6be381d452f8e9a5a4c335cfcfde0718. 2023-07-20 12:10:59,845 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 12:10:59,845 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689855058735.6be381d452f8e9a5a4c335cfcfde0718. started... 2023-07-20 12:10:59,845 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 12:10:59,845 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-20 12:10:59,845 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:10:59,845 INFO [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6be381d452f8e9a5a4c335cfcfde0718 1/1 column families, dataSize=467 B heapSize=1.23 KB 2023-07-20 12:10:59,845 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43611,1689855028889' in zk 2023-07-20 12:10:59,845 INFO [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 562c9643fc58e63cd931b7b833c7e986 1/1 column families, dataSize=2.80 KB heapSize=6.30 KB 2023-07-20 12:10:59,845 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 12:10:59,847 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-20 12:10:59,847 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:10:59,847 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-20 12:10:59,894 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 12:10:59,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 12:10:59,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 12:10:59,895 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 12:10:59,929 INFO [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230720157e28256e1b41c2866ae31c236d9361 to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230720157e28256e1b41c2866ae31c236d9361 2023-07-20 12:10:59,936 INFO [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230720dbb319e73e1345eabfa8ca603dd608a1 to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230720dbb319e73e1345eabfa8ca603dd608a1 2023-07-20 12:10:59,967 INFO [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.8 K, hasBloomFilter=true, into tmp file hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemState/562c9643fc58e63cd931b7b833c7e986/.tmp/cf/a259021196f54e0f90921b0a635ac34a 2023-07-20 12:10:59,968 INFO [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=467, hasBloomFilter=true, into tmp file hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemState/6be381d452f8e9a5a4c335cfcfde0718/.tmp/cf/84ffb19fc70d486e881560a2b8aafbd6 2023-07-20 12:10:59,975 DEBUG [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemState/562c9643fc58e63cd931b7b833c7e986/.tmp/cf/a259021196f54e0f90921b0a635ac34a as hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemState/562c9643fc58e63cd931b7b833c7e986/cf/a259021196f54e0f90921b0a635ac34a 2023-07-20 12:10:59,976 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemState/6be381d452f8e9a5a4c335cfcfde0718/.tmp/cf/84ffb19fc70d486e881560a2b8aafbd6 as hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemState/6be381d452f8e9a5a4c335cfcfde0718/cf/84ffb19fc70d486e881560a2b8aafbd6 2023-07-20 12:10:59,989 INFO [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemState/562c9643fc58e63cd931b7b833c7e986/cf/a259021196f54e0f90921b0a635ac34a, entries=43, sequenceid=6, filesize=12.2 K 2023-07-20 12:10:59,989 INFO [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemState/6be381d452f8e9a5a4c335cfcfde0718/cf/84ffb19fc70d486e881560a2b8aafbd6, entries=7, sequenceid=6, filesize=6.1 K 2023-07-20 12:10:59,990 INFO [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~467 B/467, heapSize ~1.22 KB/1248, currentSize=0 B/0 for 6be381d452f8e9a5a4c335cfcfde0718 in 145ms, sequenceid=6, compaction requested=false 2023-07-20 12:10:59,990 INFO [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.80 KB/2869, heapSize ~6.28 KB/6432, currentSize=0 B/0 for 562c9643fc58e63cd931b7b833c7e986 in 145ms, sequenceid=6, compaction requested=false 2023-07-20 12:10:59,990 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-20 12:10:59,990 DEBUG [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-20 12:10:59,994 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6be381d452f8e9a5a4c335cfcfde0718: 2023-07-20 12:10:59,994 DEBUG [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 562c9643fc58e63cd931b7b833c7e986: 2023-07-20 12:10:59,994 DEBUG [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689855058735.562c9643fc58e63cd931b7b833c7e986.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-20 12:10:59,994 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689855058735.6be381d452f8e9a5a4c335cfcfde0718.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-20 12:10:59,994 DEBUG [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 12:10:59,994 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 12:10:59,994 DEBUG [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemState/562c9643fc58e63cd931b7b833c7e986/cf/a259021196f54e0f90921b0a635ac34a] hfiles 2023-07-20 12:10:59,994 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemState/6be381d452f8e9a5a4c335cfcfde0718/cf/84ffb19fc70d486e881560a2b8aafbd6] hfiles 2023-07-20 12:10:59,994 DEBUG [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemState/562c9643fc58e63cd931b7b833c7e986/cf/a259021196f54e0f90921b0a635ac34a for snapshot=snaptb0-testExportFileSystemState 2023-07-20 12:10:59,994 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemState/6be381d452f8e9a5a4c335cfcfde0718/cf/84ffb19fc70d486e881560a2b8aafbd6 for snapshot=snaptb0-testExportFileSystemState 2023-07-20 12:11:00,014 DEBUG [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689855058735.562c9643fc58e63cd931b7b833c7e986. completed. 2023-07-20 12:11:00,014 DEBUG [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689855058735.562c9643fc58e63cd931b7b833c7e986. 2023-07-20 12:11:00,014 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 12:11:00,014 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 12:11:00,014 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:00,014 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-20 12:11:00,014 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41865,1689855028765' in zk 2023-07-20 12:11:00,015 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689855058735.6be381d452f8e9a5a4c335cfcfde0718. completed. 2023-07-20 12:11:00,015 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689855058735.6be381d452f8e9a5a4c335cfcfde0718. 2023-07-20 12:11:00,016 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 12:11:00,016 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 12:11:00,016 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:00,016 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-20 12:11:00,016 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39003,1689855028825' in zk 2023-07-20 12:11:00,020 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-20 12:11:00,020 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:00,020 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:11:00,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:00,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:11:00,020 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-20 12:11:00,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:11:00,023 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:00,023 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-20 12:11:00,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:11:00,023 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:11:00,023 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-20 12:11:00,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:11:00,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 12:11:00,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:00,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:00,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:00,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:11:00,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 12:11:00,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:00,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:00,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:00,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,41865,1689855028765': 2023-07-20 12:11:00,029 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41865,1689855028765' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-20 12:11:00,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:00,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:11:00,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:11:00,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:11:00,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:11:00,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 12:11:00,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:00,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:00,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:00,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:11:00,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 12:11:00,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:00,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:00,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:00,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39003,1689855028825': 2023-07-20 12:11:00,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39003,1689855028825' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-20 12:11:00,036 INFO [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-20 12:11:00,036 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 12:11:00,036 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 12:11:00,036 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-20 12:11:00,036 INFO [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 12:11:00,038 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 12:11:00,038 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:11:00,038 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 12:11:00,038 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 12:11:00,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 12:11:00,038 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 12:11:00,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 12:11:00,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 12:11:00,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 12:11:00,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 12:11:00,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 12:11:00,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:11:00,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:11:00,038 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:11:00,039 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:11:00,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 12:11:00,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:11:00,040 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:00,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:11:00,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:11:00,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:11:00,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:11:00,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:11:00,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:11:00,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 12:11:00,040 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:00,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 12:11:00,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 12:11:00,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 12:11:00,041 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:00,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:11:00,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 12:11:00,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:00,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:00,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:00,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:11:00,043 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:00,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 12:11:00,043 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:00,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:00,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:00,044 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:00,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:00,049 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:00,049 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 12:11:00,049 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:11:00,049 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:00,049 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:00,049 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 12:11:00,049 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:00,049 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:11:00,049 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:11:00,049 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:11:00,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:11:00,049 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 12:11:00,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:11:00,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:11:00,049 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:11:00,049 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:11:00,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:11:00,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:11:00,049 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:00,049 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-20 12:11:00,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:11:00,050 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-20 12:11:00,049 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:00,049 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:11:00,050 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 12:11:00,052 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 12:11:00,050 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-20 12:11:00,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:11:00,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:11:00,052 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 12:11:00,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:11:00,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:11:00,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:11:00,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:11:00,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230720157e28256e1b41c2866ae31c236d9361, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230720dbb319e73e1345eabfa8ca603dd608a1] mob files 2023-07-20 12:11:00,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230720157e28256e1b41c2866ae31c236d9361 2023-07-20 12:11:00,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230720dbb319e73e1345eabfa8ca603dd608a1 2023-07-20 12:11:00,066 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-20 12:11:00,067 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-20 12:11:00,095 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 12:11:00,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 12:11:00,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 12:11:00,097 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 12:11:00,100 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-20 12:11:00,132 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-20 12:11:00,132 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-20 12:11:00,132 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-20 12:11:00,133 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689855059788Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689855060066 (+278 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689855060066Loading Region manifests for snaptb0-testExportFileSystemState at 1689855060066Writing data manifest for snaptb0-testExportFileSystemState at 1689855060073 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689855060092 (+19 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689855060132 (+40 ms) 2023-07-20 12:11:00,136 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-20 12:11:00,144 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 346 msec 2023-07-20 12:11:00,397 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 12:11:00,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 12:11:00,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 12:11:00,399 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855060399 2023-07-20 12:11:00,399 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37499, tgtDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855060399, rawTgtDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855060399, srcFsUri=hdfs://localhost:37499, srcDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc 2023-07-20 12:11:00,428 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37499, inputRoot=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc 2023-07-20 12:11:00,428 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2137357673_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855060399, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855060399/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-20 12:11:00,428 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37499, inputRoot=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc, snapshotDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-20 12:11:00,453 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855060399/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-20 12:11:00,482 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:00,483 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:00,483 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:00,484 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:01,475 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/hadoop-2448919676784338814.jar 2023-07-20 12:11:01,476 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:01,476 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:01,546 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/hadoop-4225988228012292176.jar 2023-07-20 12:11:01,547 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:01,548 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:01,548 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:01,549 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:01,549 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:01,550 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:01,551 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 12:11:01,551 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 12:11:01,552 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 12:11:01,552 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 12:11:01,552 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 12:11:01,553 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 12:11:01,553 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 12:11:01,554 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 12:11:01,554 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 12:11:01,555 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 12:11:01,555 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 12:11:01,556 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 12:11:01,556 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 12:11:01,557 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 12:11:01,557 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 12:11:01,557 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 12:11:01,558 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 12:11:02,047 WARN [Listener at jenkins-hbase4.apache.org/34263] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 12:11:02,050 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-20 12:11:02,056 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(671): export split=0 size=31.0 K 2023-07-20 12:11:02,455 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 12:11:02,455 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 12:11:02,462 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689855037970_0001_000001 (auth:SIMPLE) 2023-07-20 12:11:03,346 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689855037970_0002_000001 (auth:SIMPLE) 2023-07-20 12:11:04,011 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 12:11:08,522 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689855037970_0002_000001 (auth:SIMPLE) 2023-07-20 12:11:10,763 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689855037970_0002_000001 (auth:SIMPLE) 2023-07-20 12:11:13,927 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689855037970_0002_000001 (auth:SIMPLE) 2023-07-20 12:11:15,293 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 12:11:15,296 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 12:11:15,306 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-20 12:11:15,306 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 12:11:15,307 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 12:11:15,307 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1891902696_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-20 12:11:15,308 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(367): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-20 12:11:15,308 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(367): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-20 12:11:15,308 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1891902696_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855060399/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855060399/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-20 12:11:15,308 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(367): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855060399/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-20 12:11:15,308 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(367): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855060399/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-20 12:11:15,316 INFO [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-20 12:11:15,317 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-20 12:11:15,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-20 12:11:15,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-20 12:11:15,325 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689855075325"}]},"ts":"1689855075325"} 2023-07-20 12:11:15,327 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-20 12:11:15,329 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-20 12:11:15,330 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6be381d452f8e9a5a4c335cfcfde0718, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=562c9643fc58e63cd931b7b833c7e986, UNASSIGN}] 2023-07-20 12:11:15,332 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6be381d452f8e9a5a4c335cfcfde0718, UNASSIGN 2023-07-20 12:11:15,332 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=562c9643fc58e63cd931b7b833c7e986, UNASSIGN 2023-07-20 12:11:15,333 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=6be381d452f8e9a5a4c335cfcfde0718, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:15,333 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=562c9643fc58e63cd931b7b833c7e986, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:15,333 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689855058735.6be381d452f8e9a5a4c335cfcfde0718.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689855075333"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689855075333"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689855075333"}]},"ts":"1689855075333"} 2023-07-20 12:11:15,333 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689855058735.562c9643fc58e63cd931b7b833c7e986.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689855075333"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689855075333"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689855075333"}]},"ts":"1689855075333"} 2023-07-20 12:11:15,335 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 562c9643fc58e63cd931b7b833c7e986, server=jenkins-hbase4.apache.org,41865,1689855028765}] 2023-07-20 12:11:15,336 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 6be381d452f8e9a5a4c335cfcfde0718, server=jenkins-hbase4.apache.org,39003,1689855028825}] 2023-07-20 12:11:15,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-20 12:11:15,488 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 562c9643fc58e63cd931b7b833c7e986 2023-07-20 12:11:15,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 562c9643fc58e63cd931b7b833c7e986, disabling compactions & flushes 2023-07-20 12:11:15,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689855058735.562c9643fc58e63cd931b7b833c7e986. 2023-07-20 12:11:15,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689855058735.562c9643fc58e63cd931b7b833c7e986. 2023-07-20 12:11:15,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689855058735.562c9643fc58e63cd931b7b833c7e986. after waiting 0 ms 2023-07-20 12:11:15,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689855058735.562c9643fc58e63cd931b7b833c7e986. 2023-07-20 12:11:15,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6be381d452f8e9a5a4c335cfcfde0718 2023-07-20 12:11:15,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6be381d452f8e9a5a4c335cfcfde0718, disabling compactions & flushes 2023-07-20 12:11:15,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689855058735.6be381d452f8e9a5a4c335cfcfde0718. 2023-07-20 12:11:15,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689855058735.6be381d452f8e9a5a4c335cfcfde0718. 2023-07-20 12:11:15,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689855058735.6be381d452f8e9a5a4c335cfcfde0718. after waiting 0 ms 2023-07-20 12:11:15,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689855058735.6be381d452f8e9a5a4c335cfcfde0718. 2023-07-20 12:11:15,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemState/562c9643fc58e63cd931b7b833c7e986/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 12:11:15,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemState/6be381d452f8e9a5a4c335cfcfde0718/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 12:11:15,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 12:11:15,508 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689855058735.562c9643fc58e63cd931b7b833c7e986. 2023-07-20 12:11:15,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 562c9643fc58e63cd931b7b833c7e986: 2023-07-20 12:11:15,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 12:11:15,509 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689855058735.6be381d452f8e9a5a4c335cfcfde0718. 2023-07-20 12:11:15,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6be381d452f8e9a5a4c335cfcfde0718: 2023-07-20 12:11:15,511 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 562c9643fc58e63cd931b7b833c7e986 2023-07-20 12:11:15,512 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=562c9643fc58e63cd931b7b833c7e986, regionState=CLOSED 2023-07-20 12:11:15,512 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6be381d452f8e9a5a4c335cfcfde0718 2023-07-20 12:11:15,512 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689855058735.562c9643fc58e63cd931b7b833c7e986.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689855075512"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689855075512"}]},"ts":"1689855075512"} 2023-07-20 12:11:15,514 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=6be381d452f8e9a5a4c335cfcfde0718, regionState=CLOSED 2023-07-20 12:11:15,514 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689855058735.6be381d452f8e9a5a4c335cfcfde0718.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689855075514"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689855075514"}]},"ts":"1689855075514"} 2023-07-20 12:11:15,522 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-20 12:11:15,522 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 562c9643fc58e63cd931b7b833c7e986, server=jenkins-hbase4.apache.org,41865,1689855028765 in 180 msec 2023-07-20 12:11:15,523 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-20 12:11:15,523 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 6be381d452f8e9a5a4c335cfcfde0718, server=jenkins-hbase4.apache.org,39003,1689855028825 in 180 msec 2023-07-20 12:11:15,524 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=562c9643fc58e63cd931b7b833c7e986, UNASSIGN in 192 msec 2023-07-20 12:11:15,525 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-20 12:11:15,525 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6be381d452f8e9a5a4c335cfcfde0718, UNASSIGN in 193 msec 2023-07-20 12:11:15,526 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689855075526"}]},"ts":"1689855075526"} 2023-07-20 12:11:15,528 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-20 12:11:15,530 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-20 12:11:15,532 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 213 msec 2023-07-20 12:11:15,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-20 12:11:15,627 INFO [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-20 12:11:15,629 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-20 12:11:15,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-20 12:11:15,633 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-20 12:11:15,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-20 12:11:15,634 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-20 12:11:15,636 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43611] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-20 12:11:15,640 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 12:11:15,640 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 12:11:15,640 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 12:11:15,640 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 12:11:15,641 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-20 12:11:15,641 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-20 12:11:15,641 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-20 12:11:15,641 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemState/6be381d452f8e9a5a4c335cfcfde0718 2023-07-20 12:11:15,641 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemState/562c9643fc58e63cd931b7b833c7e986 2023-07-20 12:11:15,642 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 12:11:15,642 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 12:11:15,642 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:11:15,643 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:11:15,642 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-20 12:11:15,643 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:11:15,643 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 12:11:15,643 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-20 12:11:15,643 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:11:15,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-20 12:11:15,644 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemState/6be381d452f8e9a5a4c335cfcfde0718/cf, FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemState/6be381d452f8e9a5a4c335cfcfde0718/recovered.edits] 2023-07-20 12:11:15,645 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemState/562c9643fc58e63cd931b7b833c7e986/cf, FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemState/562c9643fc58e63cd931b7b833c7e986/recovered.edits] 2023-07-20 12:11:15,653 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemState/562c9643fc58e63cd931b7b833c7e986/cf/a259021196f54e0f90921b0a635ac34a to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testExportFileSystemState/562c9643fc58e63cd931b7b833c7e986/cf/a259021196f54e0f90921b0a635ac34a 2023-07-20 12:11:15,655 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemState/6be381d452f8e9a5a4c335cfcfde0718/cf/84ffb19fc70d486e881560a2b8aafbd6 to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testExportFileSystemState/6be381d452f8e9a5a4c335cfcfde0718/cf/84ffb19fc70d486e881560a2b8aafbd6 2023-07-20 12:11:15,659 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemState/562c9643fc58e63cd931b7b833c7e986/recovered.edits/9.seqid to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testExportFileSystemState/562c9643fc58e63cd931b7b833c7e986/recovered.edits/9.seqid 2023-07-20 12:11:15,660 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemState/6be381d452f8e9a5a4c335cfcfde0718/recovered.edits/9.seqid to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testExportFileSystemState/6be381d452f8e9a5a4c335cfcfde0718/recovered.edits/9.seqid 2023-07-20 12:11:15,660 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemState/562c9643fc58e63cd931b7b833c7e986 2023-07-20 12:11:15,660 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemState/6be381d452f8e9a5a4c335cfcfde0718 2023-07-20 12:11:15,660 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-20 12:11:15,661 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-20 12:11:15,662 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-20 12:11:15,667 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230720157e28256e1b41c2866ae31c236d9361 to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230720157e28256e1b41c2866ae31c236d9361 2023-07-20 12:11:15,669 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230720dbb319e73e1345eabfa8ca603dd608a1 to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230720dbb319e73e1345eabfa8ca603dd608a1 2023-07-20 12:11:15,670 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-20 12:11:15,673 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-20 12:11:15,676 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-20 12:11:15,679 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-20 12:11:15,680 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-20 12:11:15,680 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-20 12:11:15,680 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689855058735.6be381d452f8e9a5a4c335cfcfde0718.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689855075680"}]},"ts":"9223372036854775807"} 2023-07-20 12:11:15,680 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689855058735.562c9643fc58e63cd931b7b833c7e986.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689855075680"}]},"ts":"9223372036854775807"} 2023-07-20 12:11:15,684 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-20 12:11:15,684 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6be381d452f8e9a5a4c335cfcfde0718, NAME => 'testtb-testExportFileSystemState,,1689855058735.6be381d452f8e9a5a4c335cfcfde0718.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 562c9643fc58e63cd931b7b833c7e986, NAME => 'testtb-testExportFileSystemState,1,1689855058735.562c9643fc58e63cd931b7b833c7e986.', STARTKEY => '1', ENDKEY => ''}] 2023-07-20 12:11:15,684 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-20 12:11:15,685 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689855075684"}]},"ts":"9223372036854775807"} 2023-07-20 12:11:15,686 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-20 12:11:15,689 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-20 12:11:15,690 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 60 msec 2023-07-20 12:11:15,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-20 12:11:15,746 INFO [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-20 12:11:15,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-20 12:11:15,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-20 12:11:15,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-20 12:11:15,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-20 12:11:15,794 INFO [Listener at jenkins-hbase4.apache.org/34263] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=766 (was 754) Potentially hanging thread: IPC Client (1753867629) connection to jenkins-hbase4.apache.org/172.31.14.131:38227 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1891902696_17 at /127.0.0.1:36230 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-903830939_1 at /127.0.0.1:46968 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18f07d5b-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18f07d5b-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-903830939_1 at /127.0.0.1:34266 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18f07d5b-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1891902696_17 at /127.0.0.1:34288 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18f07d5b-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2029 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1891902696_17 at /127.0.0.1:47008 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=925 (was 923) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=360 (was 412), ProcessCount=188 (was 188), AvailableMemoryMB=3130 (was 3273) 2023-07-20 12:11:15,794 WARN [Listener at jenkins-hbase4.apache.org/34263] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-20 12:11:15,819 INFO [Listener at jenkins-hbase4.apache.org/34263] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=766, OpenFileDescriptor=925, MaxFileDescriptor=60000, SystemLoadAverage=360, ProcessCount=188, AvailableMemoryMB=3129 2023-07-20 12:11:15,819 WARN [Listener at jenkins-hbase4.apache.org/34263] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-20 12:11:15,821 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-20 12:11:15,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-20 12:11:15,826 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 12:11:15,826 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-20 12:11:15,827 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 12:11:15,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-20 12:11:15,830 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testConsecutiveExports/d921ec44da35070655973313c7840c56 2023-07-20 12:11:15,830 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testConsecutiveExports/1e533b9ac05b76fbf5b1f96b9af3160a 2023-07-20 12:11:15,831 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testConsecutiveExports/d921ec44da35070655973313c7840c56 empty. 2023-07-20 12:11:15,831 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testConsecutiveExports/1e533b9ac05b76fbf5b1f96b9af3160a empty. 2023-07-20 12:11:15,831 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testConsecutiveExports/d921ec44da35070655973313c7840c56 2023-07-20 12:11:15,831 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testConsecutiveExports/1e533b9ac05b76fbf5b1f96b9af3160a 2023-07-20 12:11:15,831 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-20 12:11:15,846 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-20 12:11:15,847 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => d921ec44da35070655973313c7840c56, NAME => 'testtb-testConsecutiveExports,,1689855075821.d921ec44da35070655973313c7840c56.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp 2023-07-20 12:11:15,848 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 1e533b9ac05b76fbf5b1f96b9af3160a, NAME => 'testtb-testConsecutiveExports,1,1689855075821.1e533b9ac05b76fbf5b1f96b9af3160a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp 2023-07-20 12:11:15,871 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689855075821.d921ec44da35070655973313c7840c56.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 12:11:15,871 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing d921ec44da35070655973313c7840c56, disabling compactions & flushes 2023-07-20 12:11:15,872 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689855075821.d921ec44da35070655973313c7840c56. 2023-07-20 12:11:15,872 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689855075821.d921ec44da35070655973313c7840c56. 2023-07-20 12:11:15,872 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689855075821.d921ec44da35070655973313c7840c56. after waiting 0 ms 2023-07-20 12:11:15,872 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689855075821.d921ec44da35070655973313c7840c56. 2023-07-20 12:11:15,872 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689855075821.d921ec44da35070655973313c7840c56. 2023-07-20 12:11:15,872 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for d921ec44da35070655973313c7840c56: 2023-07-20 12:11:15,872 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689855075821.1e533b9ac05b76fbf5b1f96b9af3160a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 12:11:15,872 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 1e533b9ac05b76fbf5b1f96b9af3160a, disabling compactions & flushes 2023-07-20 12:11:15,872 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689855075821.1e533b9ac05b76fbf5b1f96b9af3160a. 2023-07-20 12:11:15,872 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689855075821.1e533b9ac05b76fbf5b1f96b9af3160a. 2023-07-20 12:11:15,872 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689855075821.1e533b9ac05b76fbf5b1f96b9af3160a. after waiting 0 ms 2023-07-20 12:11:15,872 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689855075821.1e533b9ac05b76fbf5b1f96b9af3160a. 2023-07-20 12:11:15,872 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689855075821.1e533b9ac05b76fbf5b1f96b9af3160a. 2023-07-20 12:11:15,872 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 1e533b9ac05b76fbf5b1f96b9af3160a: 2023-07-20 12:11:15,875 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 12:11:15,876 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689855075821.d921ec44da35070655973313c7840c56.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689855075875"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689855075875"}]},"ts":"1689855075875"} 2023-07-20 12:11:15,876 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689855075821.1e533b9ac05b76fbf5b1f96b9af3160a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689855075875"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689855075875"}]},"ts":"1689855075875"} 2023-07-20 12:11:15,878 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 12:11:15,879 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 12:11:15,879 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689855075879"}]},"ts":"1689855075879"} 2023-07-20 12:11:15,880 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-20 12:11:15,884 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 12:11:15,886 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 12:11:15,886 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 12:11:15,886 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 12:11:15,886 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 12:11:15,886 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d921ec44da35070655973313c7840c56, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=1e533b9ac05b76fbf5b1f96b9af3160a, ASSIGN}] 2023-07-20 12:11:15,889 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d921ec44da35070655973313c7840c56, ASSIGN 2023-07-20 12:11:15,889 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=1e533b9ac05b76fbf5b1f96b9af3160a, ASSIGN 2023-07-20 12:11:15,890 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d921ec44da35070655973313c7840c56, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43611,1689855028889; forceNewPlan=false, retain=false 2023-07-20 12:11:15,890 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=1e533b9ac05b76fbf5b1f96b9af3160a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39003,1689855028825; forceNewPlan=false, retain=false 2023-07-20 12:11:15,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-20 12:11:16,040 INFO [jenkins-hbase4:46247] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 12:11:16,043 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=d921ec44da35070655973313c7840c56, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:16,044 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=1e533b9ac05b76fbf5b1f96b9af3160a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:16,044 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689855075821.d921ec44da35070655973313c7840c56.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689855076043"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689855076043"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689855076043"}]},"ts":"1689855076043"} 2023-07-20 12:11:16,044 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689855075821.1e533b9ac05b76fbf5b1f96b9af3160a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689855076043"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689855076043"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689855076043"}]},"ts":"1689855076043"} 2023-07-20 12:11:16,046 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure d921ec44da35070655973313c7840c56, server=jenkins-hbase4.apache.org,43611,1689855028889}] 2023-07-20 12:11:16,048 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 1e533b9ac05b76fbf5b1f96b9af3160a, server=jenkins-hbase4.apache.org,39003,1689855028825}] 2023-07-20 12:11:16,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-20 12:11:16,207 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689855075821.1e533b9ac05b76fbf5b1f96b9af3160a. 2023-07-20 12:11:16,207 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689855075821.d921ec44da35070655973313c7840c56. 2023-07-20 12:11:16,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1e533b9ac05b76fbf5b1f96b9af3160a, NAME => 'testtb-testConsecutiveExports,1,1689855075821.1e533b9ac05b76fbf5b1f96b9af3160a.', STARTKEY => '1', ENDKEY => ''} 2023-07-20 12:11:16,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d921ec44da35070655973313c7840c56, NAME => 'testtb-testConsecutiveExports,,1689855075821.d921ec44da35070655973313c7840c56.', STARTKEY => '', ENDKEY => '1'} 2023-07-20 12:11:16,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689855075821.d921ec44da35070655973313c7840c56. service=AccessControlService 2023-07-20 12:11:16,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689855075821.1e533b9ac05b76fbf5b1f96b9af3160a. service=AccessControlService 2023-07-20 12:11:16,207 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 12:11:16,207 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 12:11:16,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports d921ec44da35070655973313c7840c56 2023-07-20 12:11:16,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 1e533b9ac05b76fbf5b1f96b9af3160a 2023-07-20 12:11:16,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689855075821.d921ec44da35070655973313c7840c56.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 12:11:16,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689855075821.1e533b9ac05b76fbf5b1f96b9af3160a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 12:11:16,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d921ec44da35070655973313c7840c56 2023-07-20 12:11:16,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1e533b9ac05b76fbf5b1f96b9af3160a 2023-07-20 12:11:16,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d921ec44da35070655973313c7840c56 2023-07-20 12:11:16,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1e533b9ac05b76fbf5b1f96b9af3160a 2023-07-20 12:11:16,211 INFO [StoreOpener-d921ec44da35070655973313c7840c56-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d921ec44da35070655973313c7840c56 2023-07-20 12:11:16,213 INFO [StoreOpener-1e533b9ac05b76fbf5b1f96b9af3160a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1e533b9ac05b76fbf5b1f96b9af3160a 2023-07-20 12:11:16,214 DEBUG [StoreOpener-d921ec44da35070655973313c7840c56-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testConsecutiveExports/d921ec44da35070655973313c7840c56/cf 2023-07-20 12:11:16,214 DEBUG [StoreOpener-d921ec44da35070655973313c7840c56-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testConsecutiveExports/d921ec44da35070655973313c7840c56/cf 2023-07-20 12:11:16,214 DEBUG [StoreOpener-1e533b9ac05b76fbf5b1f96b9af3160a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testConsecutiveExports/1e533b9ac05b76fbf5b1f96b9af3160a/cf 2023-07-20 12:11:16,214 DEBUG [StoreOpener-1e533b9ac05b76fbf5b1f96b9af3160a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testConsecutiveExports/1e533b9ac05b76fbf5b1f96b9af3160a/cf 2023-07-20 12:11:16,214 INFO [StoreOpener-d921ec44da35070655973313c7840c56-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d921ec44da35070655973313c7840c56 columnFamilyName cf 2023-07-20 12:11:16,214 INFO [StoreOpener-1e533b9ac05b76fbf5b1f96b9af3160a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e533b9ac05b76fbf5b1f96b9af3160a columnFamilyName cf 2023-07-20 12:11:16,216 INFO [StoreOpener-d921ec44da35070655973313c7840c56-1] regionserver.HStore(310): Store=d921ec44da35070655973313c7840c56/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 12:11:16,216 INFO [StoreOpener-1e533b9ac05b76fbf5b1f96b9af3160a-1] regionserver.HStore(310): Store=1e533b9ac05b76fbf5b1f96b9af3160a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 12:11:16,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testConsecutiveExports/1e533b9ac05b76fbf5b1f96b9af3160a 2023-07-20 12:11:16,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testConsecutiveExports/d921ec44da35070655973313c7840c56 2023-07-20 12:11:16,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testConsecutiveExports/1e533b9ac05b76fbf5b1f96b9af3160a 2023-07-20 12:11:16,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testConsecutiveExports/d921ec44da35070655973313c7840c56 2023-07-20 12:11:16,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1e533b9ac05b76fbf5b1f96b9af3160a 2023-07-20 12:11:16,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d921ec44da35070655973313c7840c56 2023-07-20 12:11:16,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testConsecutiveExports/1e533b9ac05b76fbf5b1f96b9af3160a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 12:11:16,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testConsecutiveExports/d921ec44da35070655973313c7840c56/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 12:11:16,224 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1e533b9ac05b76fbf5b1f96b9af3160a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69876738, jitterRate=0.04124453663825989}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 12:11:16,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1e533b9ac05b76fbf5b1f96b9af3160a: 2023-07-20 12:11:16,224 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d921ec44da35070655973313c7840c56; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68744534, jitterRate=0.024373382329940796}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 12:11:16,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d921ec44da35070655973313c7840c56: 2023-07-20 12:11:16,225 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689855075821.1e533b9ac05b76fbf5b1f96b9af3160a., pid=46, masterSystemTime=1689855076199 2023-07-20 12:11:16,225 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689855075821.d921ec44da35070655973313c7840c56., pid=45, masterSystemTime=1689855076198 2023-07-20 12:11:16,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689855075821.1e533b9ac05b76fbf5b1f96b9af3160a. 2023-07-20 12:11:16,227 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689855075821.1e533b9ac05b76fbf5b1f96b9af3160a. 2023-07-20 12:11:16,227 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=1e533b9ac05b76fbf5b1f96b9af3160a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:16,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689855075821.d921ec44da35070655973313c7840c56. 2023-07-20 12:11:16,227 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689855075821.d921ec44da35070655973313c7840c56. 2023-07-20 12:11:16,228 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689855075821.1e533b9ac05b76fbf5b1f96b9af3160a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689855076227"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689855076227"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689855076227"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689855076227"}]},"ts":"1689855076227"} 2023-07-20 12:11:16,228 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=d921ec44da35070655973313c7840c56, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:16,228 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689855075821.d921ec44da35070655973313c7840c56.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689855076228"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689855076228"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689855076228"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689855076228"}]},"ts":"1689855076228"} 2023-07-20 12:11:16,232 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-20 12:11:16,232 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 1e533b9ac05b76fbf5b1f96b9af3160a, server=jenkins-hbase4.apache.org,39003,1689855028825 in 181 msec 2023-07-20 12:11:16,233 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-20 12:11:16,233 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=1e533b9ac05b76fbf5b1f96b9af3160a, ASSIGN in 346 msec 2023-07-20 12:11:16,233 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure d921ec44da35070655973313c7840c56, server=jenkins-hbase4.apache.org,43611,1689855028889 in 184 msec 2023-07-20 12:11:16,236 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-20 12:11:16,236 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d921ec44da35070655973313c7840c56, ASSIGN in 347 msec 2023-07-20 12:11:16,237 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 12:11:16,237 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689855076237"}]},"ts":"1689855076237"} 2023-07-20 12:11:16,239 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-20 12:11:16,241 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 12:11:16,241 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-20 12:11:16,244 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43611] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-20 12:11:16,245 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:11:16,245 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:11:16,245 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:11:16,245 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:11:16,247 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-20 12:11:16,247 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-20 12:11:16,249 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 426 msec 2023-07-20 12:11:16,250 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-20 12:11:16,250 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-20 12:11:16,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-20 12:11:16,432 INFO [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-20 12:11:16,434 DEBUG [Listener at jenkins-hbase4.apache.org/34263] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-20 12:11:16,434 DEBUG [Listener at jenkins-hbase4.apache.org/34263] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689855075821.d921ec44da35070655973313c7840c56. 2023-07-20 12:11:16,438 INFO [Listener at jenkins-hbase4.apache.org/34263] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 12:11:16,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-20 12:11:16,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689855076453 (current time:1689855076453). 2023-07-20 12:11:16,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 12:11:16,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(139): Connect 0x66c222c4 to 127.0.0.1:59849 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 12:11:16,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f0478e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 12:11:16,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:11:16,474 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58362, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:11:16,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66c222c4 to 127.0.0.1:59849 2023-07-20 12:11:16,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 12:11:16,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(139): Connect 0x768dfceb to 127.0.0.1:59849 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 12:11:16,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6012c479, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 12:11:16,488 DEBUG [hconnection-0x779c1ec4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:11:16,492 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58370, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:11:16,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:11:16,498 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41808, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:11:16,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x768dfceb to 127.0.0.1:59849 2023-07-20 12:11:16,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 12:11:16,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-20 12:11:16,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 12:11:16,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-20 12:11:16,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-20 12:11:16,504 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-20 12:11:16,504 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689855676504 2023-07-20 12:11:16,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-20 12:11:16,504 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-20 12:11:16,506 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 12:11:16,506 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 12:11:16,511 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-20 12:11:16,515 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-20 12:11:16,517 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 15 msec 2023-07-20 12:11:16,518 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-20 12:11:16,519 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689855676519 2023-07-20 12:11:16,541 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,541 INFO [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-20 12:11:16,541 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:11:16,543 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-20 12:11:16,543 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-20 12:11:16,544 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,544 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,546 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:11:16,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:11:16,547 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:16,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:11:16,546 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:11:16,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:11:16,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:11:16,548 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:11:16,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:11:16,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:11:16,548 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:16,548 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:16,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,549 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,549 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,549 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:16,549 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 12:11:16,549 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-20 12:11:16,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-20 12:11:16,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,550 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-20 12:11:16,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-20 12:11:16,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,550 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-20 12:11:16,550 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-20 12:11:16,550 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,551 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-20 12:11:16,551 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:11:16,558 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,560 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,560 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-20 12:11:16,560 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-20 12:11:16,560 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-20 12:11:16,560 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:11:16,560 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41865,1689855028765' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-20 12:11:16,560 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-20 12:11:16,562 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:11:16,562 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-20 12:11:16,566 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-20 12:11:16,566 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-20 12:11:16,566 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-20 12:11:16,566 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43611,1689855028889' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-20 12:11:16,566 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39003,1689855028825' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-20 12:11:16,568 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,568 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:16,568 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,568 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,568 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,569 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 12:11:16,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:16,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:11:16,568 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:16,569 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,569 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 12:11:16,569 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,569 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 12:11:16,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:11:16,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:11:16,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:11:16,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:16,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:16,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:16,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:11:16,572 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39003,1689855028825' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-20 12:11:16,572 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e9292e1[Count = 1] remaining members to acquire global barrier 2023-07-20 12:11:16,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:16,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:11:16,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:11:16,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:11:16,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:11:16,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:16,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:16,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:16,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:11:16,575 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43611,1689855028889' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-20 12:11:16,575 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e9292e1[Count = 0] remaining members to acquire global barrier 2023-07-20 12:11:16,575 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-20 12:11:16,575 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,577 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,577 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,577 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:16,577 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-20 12:11:16,577 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,577 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689855075821.d921ec44da35070655973313c7840c56. 2023-07-20 12:11:16,577 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:16,579 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689855075821.d921ec44da35070655973313c7840c56. started... 2023-07-20 12:11:16,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,577 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-20 12:11:16,579 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-20 12:11:16,577 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 12:11:16,579 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d921ec44da35070655973313c7840c56: 2023-07-20 12:11:16,579 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 12:11:16,579 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 12:11:16,579 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-20 12:11:16,579 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 12:11:16,580 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689855075821.d921ec44da35070655973313c7840c56.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,580 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41865,1689855028765' in zk 2023-07-20 12:11:16,580 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689855075821.1e533b9ac05b76fbf5b1f96b9af3160a. 2023-07-20 12:11:16,579 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 12:11:16,580 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689855075821.1e533b9ac05b76fbf5b1f96b9af3160a. started... 2023-07-20 12:11:16,580 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 12:11:16,580 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 12:11:16,581 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1e533b9ac05b76fbf5b1f96b9af3160a: 2023-07-20 12:11:16,581 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689855075821.1e533b9ac05b76fbf5b1f96b9af3160a.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,584 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 12:11:16,584 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 12:11:16,591 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-20 12:11:16,591 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:11:16,591 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-20 12:11:16,599 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689855075821.d921ec44da35070655973313c7840c56. completed. 2023-07-20 12:11:16,600 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689855075821.d921ec44da35070655973313c7840c56. 2023-07-20 12:11:16,600 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 12:11:16,600 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 12:11:16,600 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:16,600 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-20 12:11:16,600 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43611,1689855028889' in zk 2023-07-20 12:11:16,601 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689855075821.1e533b9ac05b76fbf5b1f96b9af3160a. completed. 2023-07-20 12:11:16,601 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689855075821.1e533b9ac05b76fbf5b1f96b9af3160a. 2023-07-20 12:11:16,601 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 12:11:16,601 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 12:11:16,601 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:16,601 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-20 12:11:16,601 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39003,1689855028825' in zk 2023-07-20 12:11:16,602 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:16,602 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-20 12:11:16,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:16,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:11:16,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:11:16,602 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:11:16,602 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-20 12:11:16,605 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-20 12:11:16,605 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:16,605 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:11:16,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:11:16,605 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-20 12:11:16,606 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 12:11:16,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:11:16,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:16,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-20 12:11:16,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-20 12:11:16,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:16,607 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 12:11:16,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:16,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:11:16,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:16,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:16,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:16,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43611,1689855028889': 2023-07-20 12:11:16,610 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43611,1689855028889' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-20 12:11:16,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:16,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:11:16,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:11:16,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:11:16,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:11:16,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:16,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:16,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:16,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:11:16,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:16,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:16,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:16,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39003,1689855028825': 2023-07-20 12:11:16,614 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39003,1689855028825' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-20 12:11:16,614 INFO [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-20 12:11:16,614 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 12:11:16,614 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 12:11:16,614 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,614 INFO [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 12:11:16,616 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,616 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,616 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,616 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:11:16,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,616 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,616 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:11:16,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:11:16,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:11:16,616 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:11:16,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:11:16,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:11:16,617 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:16,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:11:16,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:11:16,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:11:16,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:11:16,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,617 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:16,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:11:16,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,618 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:16,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:11:16,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:16,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:16,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:16,620 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:16,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:11:16,620 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:16,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,620 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:16,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:16,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:16,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:16,625 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:16,625 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,625 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:11:16,625 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:16,625 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:11:16,625 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:16,625 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:11:16,625 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,625 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:11:16,625 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-20 12:11:16,625 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:11:16,627 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:11:16,627 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 12:11:16,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:11:16,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:11:16,627 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:11:16,625 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:11:16,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:11:16,625 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:11:16,627 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:16,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:11:16,627 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:11:16,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:11:16,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:11:16,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:11:16,628 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:16,628 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-20 12:11:16,628 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:16,628 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,628 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:11:16,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:11:16,636 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,636 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,653 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,671 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-20 12:11:16,671 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,672 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:16,672 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689855076505Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689855076636 (+131 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689855076636Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689855076636Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689855076640 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689855076647 (+7 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689855076671 (+24 ms) 2023-07-20 12:11:16,674 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-20 12:11:16,676 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 168 msec 2023-07-20 12:11:16,808 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 12:11:16,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-20 12:11:16,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 12:11:16,811 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43611] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689855075821.d921ec44da35070655973313c7840c56. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 12:11:16,812 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39003] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689855075821.1e533b9ac05b76fbf5b1f96b9af3160a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 12:11:16,816 DEBUG [Listener at jenkins-hbase4.apache.org/34263] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-20 12:11:16,816 DEBUG [Listener at jenkins-hbase4.apache.org/34263] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689855075821.d921ec44da35070655973313c7840c56. 2023-07-20 12:11:16,816 INFO [Listener at jenkins-hbase4.apache.org/34263] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 12:11:16,826 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-20 12:11:16,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689855076827 (current time:1689855076827). 2023-07-20 12:11:16,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 12:11:16,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(139): Connect 0x0219ca75 to 127.0.0.1:59849 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 12:11:16,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76a9b51b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 12:11:16,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:11:16,842 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58382, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:11:16,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0219ca75 to 127.0.0.1:59849 2023-07-20 12:11:16,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 12:11:16,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(139): Connect 0x0be84e92 to 127.0.0.1:59849 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 12:11:16,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@476e77f8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 12:11:16,859 DEBUG [hconnection-0x7cd41363-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:11:16,863 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58388, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:11:16,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:11:16,870 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41824, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:11:16,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0be84e92 to 127.0.0.1:59849 2023-07-20 12:11:16,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 12:11:16,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-20 12:11:16,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 12:11:16,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-20 12:11:16,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-20 12:11:16,877 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-20 12:11:16,878 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689855676878 2023-07-20 12:11:16,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-20 12:11:16,878 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-20 12:11:16,880 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 12:11:16,880 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 12:11:16,881 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-20 12:11:16,882 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-20 12:11:16,884 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-07-20 12:11:16,886 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-20 12:11:16,887 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689855676887 2023-07-20 12:11:16,900 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-20 12:11:16,900 INFO [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-20 12:11:16,900 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:11:16,902 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-20 12:11:16,902 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-20 12:11:16,903 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 12:11:16,903 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 12:11:16,904 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:11:16,904 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:11:16,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:11:16,904 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:11:16,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:11:16,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:11:16,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:11:16,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:11:16,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:11:16,904 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:16,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 12:11:16,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 12:11:16,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 12:11:16,905 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:16,905 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:16,905 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 12:11:16,905 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 12:11:16,906 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 12:11:16,906 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:16,906 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 12:11:16,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-20 12:11:16,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 12:11:16,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-20 12:11:16,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 12:11:16,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-20 12:11:16,906 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-20 12:11:16,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 12:11:16,906 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-20 12:11:16,906 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-20 12:11:16,906 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-20 12:11:16,906 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-20 12:11:16,906 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-20 12:11:16,907 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:11:16,906 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-20 12:11:16,907 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:11:16,908 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-20 12:11:16,910 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-20 12:11:16,910 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-20 12:11:16,908 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-20 12:11:16,910 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:11:16,910 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-20 12:11:16,910 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41865,1689855028765' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-20 12:11:16,911 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-20 12:11:16,911 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-20 12:11:16,911 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43611,1689855028889' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-20 12:11:16,910 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-20 12:11:16,911 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39003,1689855028825' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-20 12:11:16,913 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 12:11:16,913 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:16,913 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 12:11:16,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:16,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:11:16,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:11:16,914 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:16,914 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 12:11:16,914 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 12:11:16,914 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 12:11:16,914 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 12:11:16,914 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 12:11:16,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:11:16,914 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 12:11:16,914 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 12:11:16,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:11:16,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 12:11:16,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:16,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:16,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:16,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:11:16,916 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43611,1689855028889' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-20 12:11:16,916 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@113d2de8[Count = 1] remaining members to acquire global barrier 2023-07-20 12:11:16,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:16,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:11:16,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:11:16,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:11:16,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:11:16,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 12:11:16,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:16,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:16,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:16,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:11:16,918 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39003,1689855028825' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-20 12:11:16,919 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@113d2de8[Count = 0] remaining members to acquire global barrier 2023-07-20 12:11:16,919 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-20 12:11:16,919 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 12:11:16,921 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 12:11:16,921 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 12:11:16,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 12:11:16,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 12:11:16,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 12:11:16,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 12:11:16,921 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 12:11:16,921 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:16,921 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-20 12:11:16,921 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-20 12:11:16,922 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-20 12:11:16,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 12:11:16,922 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41865,1689855028765' in zk 2023-07-20 12:11:16,922 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 12:11:16,922 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 12:11:16,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 12:11:16,922 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689855075821.1e533b9ac05b76fbf5b1f96b9af3160a. 2023-07-20 12:11:16,922 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-20 12:11:16,922 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689855075821.1e533b9ac05b76fbf5b1f96b9af3160a. started... 2023-07-20 12:11:16,922 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:16,922 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 12:11:16,922 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 12:11:16,922 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 12:11:16,922 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689855075821.d921ec44da35070655973313c7840c56. 2023-07-20 12:11:16,923 INFO [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1e533b9ac05b76fbf5b1f96b9af3160a 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-20 12:11:16,923 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689855075821.d921ec44da35070655973313c7840c56. started... 2023-07-20 12:11:16,923 INFO [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d921ec44da35070655973313c7840c56 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-20 12:11:16,924 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-20 12:11:16,924 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:11:16,924 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-20 12:11:16,965 INFO [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307200b4fce9ad31e43a8818e40cfa6b8ff27 to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307200b4fce9ad31e43a8818e40cfa6b8ff27 2023-07-20 12:11:16,968 INFO [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230720b33a0aae25a5447082ea5510b9bb02e9 to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230720b33a0aae25a5447082ea5510b9bb02e9 2023-07-20 12:11:16,977 INFO [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testConsecutiveExports/1e533b9ac05b76fbf5b1f96b9af3160a/.tmp/cf/53eb11319d0249fc8b0ced4c72a0398d 2023-07-20 12:11:16,980 INFO [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testConsecutiveExports/d921ec44da35070655973313c7840c56/.tmp/cf/4f65481e1d1d41a083715dd03020427a 2023-07-20 12:11:16,981 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 12:11:16,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-20 12:11:16,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-20 12:11:16,982 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 12:11:16,984 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testConsecutiveExports/1e533b9ac05b76fbf5b1f96b9af3160a/.tmp/cf/53eb11319d0249fc8b0ced4c72a0398d as hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testConsecutiveExports/1e533b9ac05b76fbf5b1f96b9af3160a/cf/53eb11319d0249fc8b0ced4c72a0398d 2023-07-20 12:11:16,987 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testConsecutiveExports/d921ec44da35070655973313c7840c56/.tmp/cf/4f65481e1d1d41a083715dd03020427a as hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testConsecutiveExports/d921ec44da35070655973313c7840c56/cf/4f65481e1d1d41a083715dd03020427a 2023-07-20 12:11:16,990 INFO [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testConsecutiveExports/1e533b9ac05b76fbf5b1f96b9af3160a/cf/53eb11319d0249fc8b0ced4c72a0398d, entries=48, sequenceid=6, filesize=12.9 K 2023-07-20 12:11:16,991 INFO [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 1e533b9ac05b76fbf5b1f96b9af3160a in 69ms, sequenceid=6, compaction requested=false 2023-07-20 12:11:16,991 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-20 12:11:16,992 INFO [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testConsecutiveExports/d921ec44da35070655973313c7840c56/cf/4f65481e1d1d41a083715dd03020427a, entries=2, sequenceid=6, filesize=5.2 K 2023-07-20 12:11:16,992 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1e533b9ac05b76fbf5b1f96b9af3160a: 2023-07-20 12:11:16,992 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689855075821.1e533b9ac05b76fbf5b1f96b9af3160a.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-20 12:11:16,992 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 12:11:16,992 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testConsecutiveExports/1e533b9ac05b76fbf5b1f96b9af3160a/cf/53eb11319d0249fc8b0ced4c72a0398d] hfiles 2023-07-20 12:11:16,992 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testConsecutiveExports/1e533b9ac05b76fbf5b1f96b9af3160a/cf/53eb11319d0249fc8b0ced4c72a0398d for snapshot=snaptb0-testConsecutiveExports 2023-07-20 12:11:16,995 INFO [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for d921ec44da35070655973313c7840c56 in 72ms, sequenceid=6, compaction requested=false 2023-07-20 12:11:16,996 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d921ec44da35070655973313c7840c56: 2023-07-20 12:11:16,996 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689855075821.d921ec44da35070655973313c7840c56.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-20 12:11:16,996 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 12:11:16,996 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testConsecutiveExports/d921ec44da35070655973313c7840c56/cf/4f65481e1d1d41a083715dd03020427a] hfiles 2023-07-20 12:11:16,997 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testConsecutiveExports/d921ec44da35070655973313c7840c56/cf/4f65481e1d1d41a083715dd03020427a for snapshot=snaptb0-testConsecutiveExports 2023-07-20 12:11:17,011 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689855075821.1e533b9ac05b76fbf5b1f96b9af3160a. completed. 2023-07-20 12:11:17,011 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689855075821.1e533b9ac05b76fbf5b1f96b9af3160a. 2023-07-20 12:11:17,011 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 12:11:17,011 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 12:11:17,012 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:17,012 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-20 12:11:17,012 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39003,1689855028825' in zk 2023-07-20 12:11:17,012 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689855075821.d921ec44da35070655973313c7840c56. completed. 2023-07-20 12:11:17,012 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689855075821.d921ec44da35070655973313c7840c56. 2023-07-20 12:11:17,012 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 12:11:17,012 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 12:11:17,012 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:17,012 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-20 12:11:17,012 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43611,1689855028889' in zk 2023-07-20 12:11:17,013 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:17,013 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-20 12:11:17,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:17,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:11:17,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:11:17,013 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:11:17,014 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-20 12:11:17,015 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:17,015 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-20 12:11:17,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:11:17,015 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:11:17,015 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-20 12:11:17,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:11:17,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 12:11:17,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:17,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:17,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:17,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:11:17,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 12:11:17,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:17,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:17,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:17,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39003,1689855028825': 2023-07-20 12:11:17,019 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39003,1689855028825' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-20 12:11:17,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:17,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:11:17,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:11:17,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:11:17,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:11:17,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 12:11:17,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:17,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:17,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:17,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:11:17,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 12:11:17,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:17,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:17,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:17,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43611,1689855028889': 2023-07-20 12:11:17,023 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43611,1689855028889' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-20 12:11:17,023 INFO [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-20 12:11:17,023 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 12:11:17,023 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 12:11:17,023 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-20 12:11:17,023 INFO [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 12:11:17,025 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 12:11:17,025 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 12:11:17,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 12:11:17,026 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:11:17,025 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 12:11:17,025 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 12:11:17,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 12:11:17,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 12:11:17,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:11:17,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:11:17,026 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:11:17,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 12:11:17,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 12:11:17,026 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:11:17,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 12:11:17,026 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:17,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 12:11:17,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:11:17,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:11:17,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:11:17,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:11:17,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:11:17,027 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:17,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 12:11:17,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 12:11:17,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 12:11:17,027 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:17,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:11:17,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 12:11:17,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:17,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:17,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:11:17,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:11:17,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:17,030 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:17,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:11:17,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 12:11:17,030 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:17,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 12:11:17,031 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:17,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:17,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:17,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:17,037 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:17,037 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:11:17,037 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 12:11:17,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:11:17,038 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:11:17,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:11:17,038 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:17,037 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:11:17,037 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:11:17,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:11:17,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:11:17,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:11:17,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:11:17,038 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-20 12:11:17,038 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:11:17,038 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:11:17,038 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:11:17,038 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:17,040 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 12:11:17,040 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:17,040 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 12:11:17,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:11:17,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:11:17,038 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-20 12:11:17,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:11:17,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:11:17,040 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-20 12:11:17,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:11:17,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:11:17,040 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:17,040 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 12:11:17,041 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:17,041 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 12:11:17,041 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 12:11:17,042 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307200b4fce9ad31e43a8818e40cfa6b8ff27, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230720b33a0aae25a5447082ea5510b9bb02e9] mob files 2023-07-20 12:11:17,042 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307200b4fce9ad31e43a8818e40cfa6b8ff27 2023-07-20 12:11:17,042 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230720b33a0aae25a5447082ea5510b9bb02e9 2023-07-20 12:11:17,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-20 12:11:17,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 12:11:17,086 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-20 12:11:17,107 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-20 12:11:17,107 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 12:11:17,108 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 12:11:17,108 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689855076878Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689855077053 (+175 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689855077053Loading Region manifests for snaptb0-testConsecutiveExports at 1689855077053Writing data manifest for snaptb0-testConsecutiveExports at 1689855077061 (+8 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689855077078 (+17 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689855077107 (+29 ms) 2023-07-20 12:11:17,111 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-20 12:11:17,113 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 231 msec 2023-07-20 12:11:17,183 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 12:11:17,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-20 12:11:17,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 12:11:17,185 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/local-export-1689855077184 2023-07-20 12:11:17,185 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/local-export-1689855077184, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/local-export-1689855077184, srcFsUri=hdfs://localhost:37499, srcDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc 2023-07-20 12:11:17,208 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37499, inputRoot=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc 2023-07-20 12:11:17,208 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@31408727, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/local-export-1689855077184, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/local-export-1689855077184/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 12:11:17,208 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37499, inputRoot=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc, snapshotDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-20 12:11:17,217 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/local-export-1689855077184/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 12:11:17,231 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:17,232 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:17,232 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:17,232 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:18,206 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/hadoop-5545766886989399036.jar 2023-07-20 12:11:18,207 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:18,208 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:18,286 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/hadoop-8829026132248546871.jar 2023-07-20 12:11:18,287 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:18,287 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:18,288 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:18,288 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:18,288 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:18,289 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:18,289 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 12:11:18,290 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 12:11:18,290 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 12:11:18,291 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 12:11:18,291 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 12:11:18,292 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 12:11:18,293 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 12:11:18,293 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 12:11:18,294 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 12:11:18,295 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 12:11:18,295 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 12:11:18,296 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 12:11:18,297 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 12:11:18,297 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 12:11:18,298 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 12:11:18,298 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 12:11:18,299 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 12:11:18,708 WARN [Listener at jenkins-hbase4.apache.org/34263] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 12:11:18,710 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-20 12:11:18,713 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-20 12:11:20,101 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 12:11:20,101 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 12:11:20,104 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689855037970_0002_000001 (auth:SIMPLE) 2023-07-20 12:11:20,470 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689855037970_0003_000001 (auth:SIMPLE) 2023-07-20 12:11:21,110 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 12:11:25,307 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689855037970_0003_000001 (auth:SIMPLE) 2023-07-20 12:11:27,548 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689855037970_0003_000001 (auth:SIMPLE) 2023-07-20 12:11:30,494 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689855037970_0003_000001 (auth:SIMPLE) 2023-07-20 12:11:31,891 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 12:11:31,892 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 12:11:31,896 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-20 12:11:31,896 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 12:11:31,897 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 12:11:31,897 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1891902696_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-20 12:11:31,899 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(367): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-20 12:11:31,899 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(367): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-20 12:11:31,899 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@2005f26a in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/local-export-1689855077184/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/local-export-1689855077184/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-20 12:11:31,899 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/local-export-1689855077184/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-20 12:11:31,900 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/local-export-1689855077184/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-20 12:11:31,901 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/local-export-1689855077184, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/local-export-1689855077184, srcFsUri=hdfs://localhost:37499, srcDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc 2023-07-20 12:11:31,924 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37499, inputRoot=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc 2023-07-20 12:11:31,924 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@43ee94e5, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/local-export-1689855077184, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/local-export-1689855077184/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 12:11:31,925 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37499, inputRoot=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc, snapshotDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-20 12:11:31,935 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/local-export-1689855077184/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 12:11:31,949 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:31,950 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:31,950 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:31,950 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:32,884 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/hadoop-4083704865109695727.jar 2023-07-20 12:11:32,885 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:32,885 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:32,969 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/hadoop-940642387046457315.jar 2023-07-20 12:11:32,970 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:32,970 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:32,971 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:32,971 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:32,972 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:32,972 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:32,973 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 12:11:32,974 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 12:11:32,974 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 12:11:32,975 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 12:11:32,975 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 12:11:32,976 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 12:11:32,976 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 12:11:32,976 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 12:11:32,977 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 12:11:32,977 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 12:11:32,978 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 12:11:32,978 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 12:11:32,979 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 12:11:32,979 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 12:11:32,979 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 12:11:32,980 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 12:11:32,981 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 12:11:33,858 WARN [Listener at jenkins-hbase4.apache.org/34263] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 12:11:33,861 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-20 12:11:33,863 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-20 12:11:36,663 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 12:11:36,663 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 12:11:36,666 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689855037970_0003_000001 (auth:SIMPLE) 2023-07-20 12:11:37,117 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689855037970_0004_000001 (auth:SIMPLE) 2023-07-20 12:11:42,078 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689855037970_0004_000001 (auth:SIMPLE) 2023-07-20 12:11:44,345 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689855037970_0004_000001 (auth:SIMPLE) 2023-07-20 12:11:48,915 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689855037970_0004_000001 (auth:SIMPLE) 2023-07-20 12:11:50,082 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 12:11:50,082 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 12:11:50,093 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-20 12:11:50,093 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 12:11:50,093 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 12:11:50,094 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1891902696_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-20 12:11:50,101 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(367): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-20 12:11:50,101 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(367): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-20 12:11:50,102 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@2005f26a in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/local-export-1689855077184/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/local-export-1689855077184/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-20 12:11:50,102 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/local-export-1689855077184/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-20 12:11:50,102 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/local-export-1689855077184/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-20 12:11:50,122 INFO [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-20 12:11:50,123 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-20 12:11:50,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-20 12:11:50,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-20 12:11:50,129 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689855110129"}]},"ts":"1689855110129"} 2023-07-20 12:11:50,130 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-20 12:11:50,132 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-20 12:11:50,133 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d921ec44da35070655973313c7840c56, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=1e533b9ac05b76fbf5b1f96b9af3160a, UNASSIGN}] 2023-07-20 12:11:50,135 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d921ec44da35070655973313c7840c56, UNASSIGN 2023-07-20 12:11:50,136 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=1e533b9ac05b76fbf5b1f96b9af3160a, UNASSIGN 2023-07-20 12:11:50,136 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=d921ec44da35070655973313c7840c56, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:50,137 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=1e533b9ac05b76fbf5b1f96b9af3160a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:50,137 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689855075821.d921ec44da35070655973313c7840c56.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689855110136"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689855110136"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689855110136"}]},"ts":"1689855110136"} 2023-07-20 12:11:50,137 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689855075821.1e533b9ac05b76fbf5b1f96b9af3160a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689855110137"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689855110137"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689855110137"}]},"ts":"1689855110137"} 2023-07-20 12:11:50,138 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure d921ec44da35070655973313c7840c56, server=jenkins-hbase4.apache.org,43611,1689855028889}] 2023-07-20 12:11:50,140 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 1e533b9ac05b76fbf5b1f96b9af3160a, server=jenkins-hbase4.apache.org,39003,1689855028825}] 2023-07-20 12:11:50,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-20 12:11:50,294 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1e533b9ac05b76fbf5b1f96b9af3160a 2023-07-20 12:11:50,294 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d921ec44da35070655973313c7840c56 2023-07-20 12:11:50,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1e533b9ac05b76fbf5b1f96b9af3160a, disabling compactions & flushes 2023-07-20 12:11:50,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d921ec44da35070655973313c7840c56, disabling compactions & flushes 2023-07-20 12:11:50,294 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689855075821.1e533b9ac05b76fbf5b1f96b9af3160a. 2023-07-20 12:11:50,295 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689855075821.d921ec44da35070655973313c7840c56. 2023-07-20 12:11:50,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689855075821.d921ec44da35070655973313c7840c56. 2023-07-20 12:11:50,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689855075821.d921ec44da35070655973313c7840c56. after waiting 0 ms 2023-07-20 12:11:50,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689855075821.d921ec44da35070655973313c7840c56. 2023-07-20 12:11:50,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689855075821.1e533b9ac05b76fbf5b1f96b9af3160a. 2023-07-20 12:11:50,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689855075821.1e533b9ac05b76fbf5b1f96b9af3160a. after waiting 0 ms 2023-07-20 12:11:50,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689855075821.1e533b9ac05b76fbf5b1f96b9af3160a. 2023-07-20 12:11:50,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testConsecutiveExports/1e533b9ac05b76fbf5b1f96b9af3160a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 12:11:50,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testConsecutiveExports/d921ec44da35070655973313c7840c56/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 12:11:50,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 12:11:50,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 12:11:50,338 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689855075821.1e533b9ac05b76fbf5b1f96b9af3160a. 2023-07-20 12:11:50,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1e533b9ac05b76fbf5b1f96b9af3160a: 2023-07-20 12:11:50,342 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689855075821.d921ec44da35070655973313c7840c56. 2023-07-20 12:11:50,342 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d921ec44da35070655973313c7840c56: 2023-07-20 12:11:50,344 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1e533b9ac05b76fbf5b1f96b9af3160a 2023-07-20 12:11:50,345 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=1e533b9ac05b76fbf5b1f96b9af3160a, regionState=CLOSED 2023-07-20 12:11:50,345 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689855075821.1e533b9ac05b76fbf5b1f96b9af3160a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689855110345"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689855110345"}]},"ts":"1689855110345"} 2023-07-20 12:11:50,345 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d921ec44da35070655973313c7840c56 2023-07-20 12:11:50,346 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=d921ec44da35070655973313c7840c56, regionState=CLOSED 2023-07-20 12:11:50,346 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689855075821.d921ec44da35070655973313c7840c56.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689855110346"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689855110346"}]},"ts":"1689855110346"} 2023-07-20 12:11:50,350 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-20 12:11:50,350 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-20 12:11:50,350 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 1e533b9ac05b76fbf5b1f96b9af3160a, server=jenkins-hbase4.apache.org,39003,1689855028825 in 208 msec 2023-07-20 12:11:50,351 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure d921ec44da35070655973313c7840c56, server=jenkins-hbase4.apache.org,43611,1689855028889 in 210 msec 2023-07-20 12:11:50,352 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d921ec44da35070655973313c7840c56, UNASSIGN in 217 msec 2023-07-20 12:11:50,352 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-20 12:11:50,352 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=1e533b9ac05b76fbf5b1f96b9af3160a, UNASSIGN in 217 msec 2023-07-20 12:11:50,353 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689855110353"}]},"ts":"1689855110353"} 2023-07-20 12:11:50,354 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-20 12:11:50,356 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-20 12:11:50,358 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 234 msec 2023-07-20 12:11:50,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-20 12:11:50,431 INFO [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-20 12:11:50,432 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-20 12:11:50,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-20 12:11:50,448 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-20 12:11:50,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-20 12:11:50,450 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-20 12:11:50,451 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43611] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-20 12:11:50,459 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 12:11:50,459 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 12:11:50,459 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 12:11:50,460 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-20 12:11:50,460 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-20 12:11:50,460 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-20 12:11:50,463 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 12:11:50,464 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 12:11:50,464 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:11:50,464 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 12:11:50,464 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-20 12:11:50,464 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 12:11:50,464 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:11:50,464 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-20 12:11:50,464 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:11:50,464 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:11:50,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-20 12:11:50,466 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testConsecutiveExports/d921ec44da35070655973313c7840c56 2023-07-20 12:11:50,472 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testConsecutiveExports/1e533b9ac05b76fbf5b1f96b9af3160a 2023-07-20 12:11:50,476 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testConsecutiveExports/1e533b9ac05b76fbf5b1f96b9af3160a/cf, FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testConsecutiveExports/1e533b9ac05b76fbf5b1f96b9af3160a/recovered.edits] 2023-07-20 12:11:50,477 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testConsecutiveExports/d921ec44da35070655973313c7840c56/cf, FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testConsecutiveExports/d921ec44da35070655973313c7840c56/recovered.edits] 2023-07-20 12:11:50,494 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testConsecutiveExports/1e533b9ac05b76fbf5b1f96b9af3160a/cf/53eb11319d0249fc8b0ced4c72a0398d to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testConsecutiveExports/1e533b9ac05b76fbf5b1f96b9af3160a/cf/53eb11319d0249fc8b0ced4c72a0398d 2023-07-20 12:11:50,495 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testConsecutiveExports/d921ec44da35070655973313c7840c56/cf/4f65481e1d1d41a083715dd03020427a to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testConsecutiveExports/d921ec44da35070655973313c7840c56/cf/4f65481e1d1d41a083715dd03020427a 2023-07-20 12:11:50,499 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testConsecutiveExports/d921ec44da35070655973313c7840c56/recovered.edits/9.seqid to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testConsecutiveExports/d921ec44da35070655973313c7840c56/recovered.edits/9.seqid 2023-07-20 12:11:50,500 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testConsecutiveExports/d921ec44da35070655973313c7840c56 2023-07-20 12:11:50,502 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testConsecutiveExports/1e533b9ac05b76fbf5b1f96b9af3160a/recovered.edits/9.seqid to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testConsecutiveExports/1e533b9ac05b76fbf5b1f96b9af3160a/recovered.edits/9.seqid 2023-07-20 12:11:50,502 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testConsecutiveExports/1e533b9ac05b76fbf5b1f96b9af3160a 2023-07-20 12:11:50,503 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-20 12:11:50,503 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-20 12:11:50,505 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-20 12:11:50,510 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307200b4fce9ad31e43a8818e40cfa6b8ff27 to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307200b4fce9ad31e43a8818e40cfa6b8ff27 2023-07-20 12:11:50,511 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230720b33a0aae25a5447082ea5510b9bb02e9 to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230720b33a0aae25a5447082ea5510b9bb02e9 2023-07-20 12:11:50,512 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-20 12:11:50,515 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-20 12:11:50,529 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-20 12:11:50,534 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-20 12:11:50,536 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-20 12:11:50,536 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-20 12:11:50,536 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689855075821.d921ec44da35070655973313c7840c56.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689855110536"}]},"ts":"9223372036854775807"} 2023-07-20 12:11:50,536 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689855075821.1e533b9ac05b76fbf5b1f96b9af3160a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689855110536"}]},"ts":"9223372036854775807"} 2023-07-20 12:11:50,547 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-20 12:11:50,547 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d921ec44da35070655973313c7840c56, NAME => 'testtb-testConsecutiveExports,,1689855075821.d921ec44da35070655973313c7840c56.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 1e533b9ac05b76fbf5b1f96b9af3160a, NAME => 'testtb-testConsecutiveExports,1,1689855075821.1e533b9ac05b76fbf5b1f96b9af3160a.', STARTKEY => '1', ENDKEY => ''}] 2023-07-20 12:11:50,547 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-20 12:11:50,547 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689855110547"}]},"ts":"9223372036854775807"} 2023-07-20 12:11:50,549 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-20 12:11:50,552 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-20 12:11:50,554 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 120 msec 2023-07-20 12:11:50,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-20 12:11:50,567 INFO [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-20 12:11:50,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-20 12:11:50,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-20 12:11:50,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-20 12:11:50,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-20 12:11:50,630 INFO [Listener at jenkins-hbase4.apache.org/34263] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=746 (was 766), OpenFileDescriptor=910 (was 925), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=361 (was 360) - SystemLoadAverage LEAK? -, ProcessCount=190 (was 188) - ProcessCount LEAK? -, AvailableMemoryMB=2911 (was 3129) 2023-07-20 12:11:50,630 WARN [Listener at jenkins-hbase4.apache.org/34263] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-07-20 12:11:50,657 INFO [Listener at jenkins-hbase4.apache.org/34263] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=746, OpenFileDescriptor=910, MaxFileDescriptor=60000, SystemLoadAverage=361, ProcessCount=190, AvailableMemoryMB=2908 2023-07-20 12:11:50,657 WARN [Listener at jenkins-hbase4.apache.org/34263] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-07-20 12:11:50,659 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-20 12:11:50,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:50,664 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 12:11:50,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-20 12:11:50,665 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 12:11:50,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-20 12:11:50,668 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2a7f8945e8e71c5fda6e6687065958ee 2023-07-20 12:11:50,669 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2a7f8945e8e71c5fda6e6687065958ee empty. 2023-07-20 12:11:50,669 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c06e9951077e3a3aad467134f69a717d 2023-07-20 12:11:50,669 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2a7f8945e8e71c5fda6e6687065958ee 2023-07-20 12:11:50,669 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c06e9951077e3a3aad467134f69a717d empty. 2023-07-20 12:11:50,670 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c06e9951077e3a3aad467134f69a717d 2023-07-20 12:11:50,670 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-20 12:11:50,688 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-20 12:11:50,690 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2a7f8945e8e71c5fda6e6687065958ee, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689855110659.2a7f8945e8e71c5fda6e6687065958ee.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp 2023-07-20 12:11:50,690 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => c06e9951077e3a3aad467134f69a717d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689855110659.c06e9951077e3a3aad467134f69a717d.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp 2023-07-20 12:11:50,742 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689855110659.2a7f8945e8e71c5fda6e6687065958ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 12:11:50,743 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689855110659.c06e9951077e3a3aad467134f69a717d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 12:11:50,743 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 2a7f8945e8e71c5fda6e6687065958ee, disabling compactions & flushes 2023-07-20 12:11:50,743 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing c06e9951077e3a3aad467134f69a717d, disabling compactions & flushes 2023-07-20 12:11:50,743 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689855110659.2a7f8945e8e71c5fda6e6687065958ee. 2023-07-20 12:11:50,743 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689855110659.c06e9951077e3a3aad467134f69a717d. 2023-07-20 12:11:50,743 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689855110659.2a7f8945e8e71c5fda6e6687065958ee. 2023-07-20 12:11:50,743 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689855110659.c06e9951077e3a3aad467134f69a717d. 2023-07-20 12:11:50,743 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689855110659.2a7f8945e8e71c5fda6e6687065958ee. after waiting 0 ms 2023-07-20 12:11:50,743 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689855110659.2a7f8945e8e71c5fda6e6687065958ee. 2023-07-20 12:11:50,743 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689855110659.c06e9951077e3a3aad467134f69a717d. after waiting 0 ms 2023-07-20 12:11:50,743 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689855110659.2a7f8945e8e71c5fda6e6687065958ee. 2023-07-20 12:11:50,743 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689855110659.c06e9951077e3a3aad467134f69a717d. 2023-07-20 12:11:50,743 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 2a7f8945e8e71c5fda6e6687065958ee: 2023-07-20 12:11:50,743 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689855110659.c06e9951077e3a3aad467134f69a717d. 2023-07-20 12:11:50,743 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for c06e9951077e3a3aad467134f69a717d: 2023-07-20 12:11:50,747 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 12:11:50,748 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689855110659.2a7f8945e8e71c5fda6e6687065958ee.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689855110748"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689855110748"}]},"ts":"1689855110748"} 2023-07-20 12:11:50,748 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689855110659.c06e9951077e3a3aad467134f69a717d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689855110748"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689855110748"}]},"ts":"1689855110748"} 2023-07-20 12:11:50,762 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 12:11:50,763 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 12:11:50,764 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689855110764"}]},"ts":"1689855110764"} 2023-07-20 12:11:50,765 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-20 12:11:50,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-20 12:11:50,770 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 12:11:50,772 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 12:11:50,772 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 12:11:50,772 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 12:11:50,772 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 12:11:50,772 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2a7f8945e8e71c5fda6e6687065958ee, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c06e9951077e3a3aad467134f69a717d, ASSIGN}] 2023-07-20 12:11:50,790 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2a7f8945e8e71c5fda6e6687065958ee, ASSIGN 2023-07-20 12:11:50,791 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c06e9951077e3a3aad467134f69a717d, ASSIGN 2023-07-20 12:11:50,796 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2a7f8945e8e71c5fda6e6687065958ee, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43611,1689855028889; forceNewPlan=false, retain=false 2023-07-20 12:11:50,796 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c06e9951077e3a3aad467134f69a717d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39003,1689855028825; forceNewPlan=false, retain=false 2023-07-20 12:11:50,947 INFO [jenkins-hbase4:46247] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 12:11:50,950 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=2a7f8945e8e71c5fda6e6687065958ee, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:50,950 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=c06e9951077e3a3aad467134f69a717d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:50,950 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689855110659.c06e9951077e3a3aad467134f69a717d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689855110950"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689855110950"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689855110950"}]},"ts":"1689855110950"} 2023-07-20 12:11:50,950 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689855110659.2a7f8945e8e71c5fda6e6687065958ee.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689855110950"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689855110950"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689855110950"}]},"ts":"1689855110950"} 2023-07-20 12:11:50,957 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 2a7f8945e8e71c5fda6e6687065958ee, server=jenkins-hbase4.apache.org,43611,1689855028889}] 2023-07-20 12:11:50,958 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure c06e9951077e3a3aad467134f69a717d, server=jenkins-hbase4.apache.org,39003,1689855028825}] 2023-07-20 12:11:50,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-20 12:11:51,113 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689855110659.2a7f8945e8e71c5fda6e6687065958ee. 2023-07-20 12:11:51,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2a7f8945e8e71c5fda6e6687065958ee, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689855110659.2a7f8945e8e71c5fda6e6687065958ee.', STARTKEY => '', ENDKEY => '1'} 2023-07-20 12:11:51,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689855110659.2a7f8945e8e71c5fda6e6687065958ee. service=AccessControlService 2023-07-20 12:11:51,113 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 12:11:51,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 2a7f8945e8e71c5fda6e6687065958ee 2023-07-20 12:11:51,114 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689855110659.c06e9951077e3a3aad467134f69a717d. 2023-07-20 12:11:51,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689855110659.2a7f8945e8e71c5fda6e6687065958ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 12:11:51,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c06e9951077e3a3aad467134f69a717d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689855110659.c06e9951077e3a3aad467134f69a717d.', STARTKEY => '1', ENDKEY => ''} 2023-07-20 12:11:51,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2a7f8945e8e71c5fda6e6687065958ee 2023-07-20 12:11:51,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2a7f8945e8e71c5fda6e6687065958ee 2023-07-20 12:11:51,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689855110659.c06e9951077e3a3aad467134f69a717d. service=AccessControlService 2023-07-20 12:11:51,114 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 12:11:51,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion c06e9951077e3a3aad467134f69a717d 2023-07-20 12:11:51,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689855110659.c06e9951077e3a3aad467134f69a717d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 12:11:51,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c06e9951077e3a3aad467134f69a717d 2023-07-20 12:11:51,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c06e9951077e3a3aad467134f69a717d 2023-07-20 12:11:51,119 INFO [StoreOpener-c06e9951077e3a3aad467134f69a717d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c06e9951077e3a3aad467134f69a717d 2023-07-20 12:11:51,119 INFO [StoreOpener-2a7f8945e8e71c5fda6e6687065958ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2a7f8945e8e71c5fda6e6687065958ee 2023-07-20 12:11:51,121 DEBUG [StoreOpener-c06e9951077e3a3aad467134f69a717d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion/c06e9951077e3a3aad467134f69a717d/cf 2023-07-20 12:11:51,121 DEBUG [StoreOpener-c06e9951077e3a3aad467134f69a717d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion/c06e9951077e3a3aad467134f69a717d/cf 2023-07-20 12:11:51,121 DEBUG [StoreOpener-2a7f8945e8e71c5fda6e6687065958ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion/2a7f8945e8e71c5fda6e6687065958ee/cf 2023-07-20 12:11:51,121 DEBUG [StoreOpener-2a7f8945e8e71c5fda6e6687065958ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion/2a7f8945e8e71c5fda6e6687065958ee/cf 2023-07-20 12:11:51,122 INFO [StoreOpener-c06e9951077e3a3aad467134f69a717d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c06e9951077e3a3aad467134f69a717d columnFamilyName cf 2023-07-20 12:11:51,122 INFO [StoreOpener-2a7f8945e8e71c5fda6e6687065958ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2a7f8945e8e71c5fda6e6687065958ee columnFamilyName cf 2023-07-20 12:11:51,124 INFO [StoreOpener-2a7f8945e8e71c5fda6e6687065958ee-1] regionserver.HStore(310): Store=2a7f8945e8e71c5fda6e6687065958ee/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 12:11:51,124 INFO [StoreOpener-c06e9951077e3a3aad467134f69a717d-1] regionserver.HStore(310): Store=c06e9951077e3a3aad467134f69a717d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 12:11:51,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion/c06e9951077e3a3aad467134f69a717d 2023-07-20 12:11:51,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion/c06e9951077e3a3aad467134f69a717d 2023-07-20 12:11:51,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion/2a7f8945e8e71c5fda6e6687065958ee 2023-07-20 12:11:51,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion/2a7f8945e8e71c5fda6e6687065958ee 2023-07-20 12:11:51,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c06e9951077e3a3aad467134f69a717d 2023-07-20 12:11:51,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2a7f8945e8e71c5fda6e6687065958ee 2023-07-20 12:11:51,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion/c06e9951077e3a3aad467134f69a717d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 12:11:51,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion/2a7f8945e8e71c5fda6e6687065958ee/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 12:11:51,140 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2a7f8945e8e71c5fda6e6687065958ee; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60905979, jitterRate=-0.09243018925189972}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 12:11:51,140 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c06e9951077e3a3aad467134f69a717d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62021721, jitterRate=-0.07580433785915375}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 12:11:51,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2a7f8945e8e71c5fda6e6687065958ee: 2023-07-20 12:11:51,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c06e9951077e3a3aad467134f69a717d: 2023-07-20 12:11:51,141 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689855110659.c06e9951077e3a3aad467134f69a717d., pid=61, masterSystemTime=1689855111110 2023-07-20 12:11:51,141 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689855110659.2a7f8945e8e71c5fda6e6687065958ee., pid=60, masterSystemTime=1689855111109 2023-07-20 12:11:51,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689855110659.2a7f8945e8e71c5fda6e6687065958ee. 2023-07-20 12:11:51,144 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689855110659.2a7f8945e8e71c5fda6e6687065958ee. 2023-07-20 12:11:51,145 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=2a7f8945e8e71c5fda6e6687065958ee, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:51,145 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689855110659.2a7f8945e8e71c5fda6e6687065958ee.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689855111145"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689855111145"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689855111145"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689855111145"}]},"ts":"1689855111145"} 2023-07-20 12:11:51,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689855110659.c06e9951077e3a3aad467134f69a717d. 2023-07-20 12:11:51,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689855110659.c06e9951077e3a3aad467134f69a717d. 2023-07-20 12:11:51,146 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=c06e9951077e3a3aad467134f69a717d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:51,146 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689855110659.c06e9951077e3a3aad467134f69a717d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689855111146"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689855111146"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689855111146"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689855111146"}]},"ts":"1689855111146"} 2023-07-20 12:11:51,160 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-20 12:11:51,160 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 2a7f8945e8e71c5fda6e6687065958ee, server=jenkins-hbase4.apache.org,43611,1689855028889 in 199 msec 2023-07-20 12:11:51,162 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-20 12:11:51,162 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure c06e9951077e3a3aad467134f69a717d, server=jenkins-hbase4.apache.org,39003,1689855028825 in 200 msec 2023-07-20 12:11:51,162 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2a7f8945e8e71c5fda6e6687065958ee, ASSIGN in 388 msec 2023-07-20 12:11:51,164 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-20 12:11:51,164 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c06e9951077e3a3aad467134f69a717d, ASSIGN in 390 msec 2023-07-20 12:11:51,171 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 12:11:51,171 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689855111171"}]},"ts":"1689855111171"} 2023-07-20 12:11:51,173 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-20 12:11:51,181 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 12:11:51,181 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-20 12:11:51,183 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43611] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-20 12:11:51,185 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:11:51,185 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:11:51,185 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:11:51,185 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:11:51,188 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 12:11:51,188 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 12:11:51,188 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 12:11:51,188 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 12:11:51,191 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 530 msec 2023-07-20 12:11:51,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-20 12:11:51,271 INFO [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-20 12:11:51,278 DEBUG [Listener at jenkins-hbase4.apache.org/34263] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,278 DEBUG [Listener at jenkins-hbase4.apache.org/34263] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689855110659.2a7f8945e8e71c5fda6e6687065958ee. 2023-07-20 12:11:51,280 INFO [Listener at jenkins-hbase4.apache.org/34263] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 12:11:51,311 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-20 12:11:51,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689855111311 (current time:1689855111311). 2023-07-20 12:11:51,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 12:11:51,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(139): Connect 0x6a42f8f6 to 127.0.0.1:59849 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 12:11:51,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79d2e9eb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 12:11:51,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:11:51,328 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34376, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:11:51,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a42f8f6 to 127.0.0.1:59849 2023-07-20 12:11:51,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 12:11:51,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(139): Connect 0x778721ff to 127.0.0.1:59849 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 12:11:51,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@affe2b1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 12:11:51,451 DEBUG [hconnection-0x648cdfb4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:11:51,453 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34378, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:11:51,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:11:51,468 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55806, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:11:51,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x778721ff to 127.0.0.1:59849 2023-07-20 12:11:51,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 12:11:51,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-20 12:11:51,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 12:11:51,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-20 12:11:51,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-20 12:11:51,478 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-20 12:11:51,479 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689855711479 2023-07-20 12:11:51,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-20 12:11:51,480 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,483 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-20 12:11:51,483 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 12:11:51,483 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 12:11:51,485 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-20 12:11:51,486 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 10 msec 2023-07-20 12:11:51,487 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-20 12:11:51,489 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689855711489 2023-07-20 12:11:51,526 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,526 INFO [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-20 12:11:51,527 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:11:51,528 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-20 12:11:51,528 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-20 12:11:51,529 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,529 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,530 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:11:51,530 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:11:51,530 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:51,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:11:51,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:11:51,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:11:51,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:11:51,530 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:11:51,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:11:51,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:11:51,531 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:51,531 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:51,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,532 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:51,532 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,532 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 12:11:51,532 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,532 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-20 12:11:51,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,532 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-20 12:11:51,533 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,533 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-20 12:11:51,533 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:11:51,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-20 12:11:51,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,535 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-20 12:11:51,535 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-20 12:11:51,535 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-20 12:11:51,535 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39003,1689855028825' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-20 12:11:51,536 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,536 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-20 12:11:51,536 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:11:51,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-20 12:11:51,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,538 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-20 12:11:51,538 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-20 12:11:51,538 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-20 12:11:51,539 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41865,1689855028765' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-20 12:11:51,539 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,539 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-20 12:11:51,539 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:11:51,541 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-20 12:11:51,541 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-20 12:11:51,541 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43611,1689855028889' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-20 12:11:51,541 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:51,541 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:51,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:11:51,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:11:51,543 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,543 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,543 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 12:11:51,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:11:51,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:11:51,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:51,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:51,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:11:51,545 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,546 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 12:11:51,546 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:51,546 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39003,1689855028825' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-20 12:11:51,546 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e9a3d0a[Count = 1] remaining members to acquire global barrier 2023-07-20 12:11:51,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:51,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:11:51,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:11:51,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:11:51,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:11:51,549 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,549 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,549 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 12:11:51,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:51,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:51,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:51,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:11:51,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43611,1689855028889' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-20 12:11:51,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e9a3d0a[Count = 0] remaining members to acquire global barrier 2023-07-20 12:11:51,551 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-20 12:11:51,551 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,552 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,552 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-20 12:11:51,552 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:51,553 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 12:11:51,553 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 12:11:51,553 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689855110659.c06e9951077e3a3aad467134f69a717d. 2023-07-20 12:11:51,553 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,553 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,553 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689855110659.c06e9951077e3a3aad467134f69a717d. started... 2023-07-20 12:11:51,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,553 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:51,555 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 12:11:51,555 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-20 12:11:51,555 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-20 12:11:51,555 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-20 12:11:51,555 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41865,1689855028765' in zk 2023-07-20 12:11:51,555 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 12:11:51,555 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 12:11:51,555 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689855110659.2a7f8945e8e71c5fda6e6687065958ee. 2023-07-20 12:11:51,556 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c06e9951077e3a3aad467134f69a717d: 2023-07-20 12:11:51,556 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689855110659.2a7f8945e8e71c5fda6e6687065958ee. started... 2023-07-20 12:11:51,556 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2a7f8945e8e71c5fda6e6687065958ee: 2023-07-20 12:11:51,556 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689855110659.c06e9951077e3a3aad467134f69a717d.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,556 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 12:11:51,556 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689855110659.2a7f8945e8e71c5fda6e6687065958ee.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,556 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 12:11:51,556 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 12:11:51,557 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 12:11:51,561 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-20 12:11:51,561 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:11:51,561 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-20 12:11:51,584 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 12:11:51,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-20 12:11:51,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-20 12:11:51,585 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 12:11:51,591 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689855110659.2a7f8945e8e71c5fda6e6687065958ee. completed. 2023-07-20 12:11:51,591 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689855110659.2a7f8945e8e71c5fda6e6687065958ee. 2023-07-20 12:11:51,592 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 12:11:51,592 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 12:11:51,592 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:51,592 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-20 12:11:51,592 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43611,1689855028889' in zk 2023-07-20 12:11:51,594 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:51,594 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-20 12:11:51,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:51,594 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:11:51,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:11:51,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:11:51,594 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-20 12:11:51,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:11:51,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:11:51,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:51,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:51,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:51,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:11:51,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:51,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:51,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43611,1689855028889': 2023-07-20 12:11:51,602 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43611,1689855028889' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-20 12:11:51,603 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689855110659.c06e9951077e3a3aad467134f69a717d. completed. 2023-07-20 12:11:51,603 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689855110659.c06e9951077e3a3aad467134f69a717d. 2023-07-20 12:11:51,603 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 12:11:51,603 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 12:11:51,603 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:51,603 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-20 12:11:51,603 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39003,1689855028825' in zk 2023-07-20 12:11:51,605 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:51,605 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-20 12:11:51,605 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:11:51,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:51,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:11:51,605 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-20 12:11:51,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:11:51,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:11:51,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:11:51,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:51,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:51,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:51,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:11:51,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:51,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:51,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:51,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39003,1689855028825': 2023-07-20 12:11:51,616 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39003,1689855028825' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-20 12:11:51,616 INFO [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-20 12:11:51,616 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 12:11:51,616 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 12:11:51,616 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,616 INFO [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 12:11:51,618 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,618 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,618 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,618 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,618 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:11:51,618 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:11:51,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:11:51,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:11:51,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,618 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:11:51,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:11:51,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:11:51,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:11:51,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:11:51,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,620 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:51,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:11:51,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:11:51,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:11:51,621 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:51,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,624 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:51,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:11:51,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:51,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:51,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:51,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:11:51,637 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:51,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,638 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:51,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:51,638 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:51,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:51,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:51,643 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:51,643 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,643 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:51,643 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:11:51,643 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:11:51,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:11:51,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:11:51,644 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:11:51,644 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,645 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:51,645 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,646 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,646 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,646 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:51,646 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,646 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:51,646 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:51,646 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,646 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,646 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 12:11:51,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:11:51,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:11:51,647 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-20 12:11:51,647 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:11:51,648 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:11:51,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:11:51,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:11:51,647 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:11:51,648 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:11:51,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:11:51,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:11:51,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:11:51,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:11:51,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:11:51,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:11:51,672 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,672 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,729 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,785 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 12:11:51,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-20 12:11:51,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-20 12:11:51,787 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 12:11:51,792 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-20 12:11:51,792 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,793 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:51,793 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689855111480Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689855111672 (+192 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689855111672Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689855111672Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689855111677 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689855111716 (+39 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689855111792 (+76 ms) 2023-07-20 12:11:51,797 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-20 12:11:51,799 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 316 msec 2023-07-20 12:11:52,087 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 12:11:52,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-20 12:11:52,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 12:11:52,092 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43611] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689855110659.2a7f8945e8e71c5fda6e6687065958ee. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 12:11:52,092 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39003] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689855110659.c06e9951077e3a3aad467134f69a717d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 12:11:52,096 DEBUG [Listener at jenkins-hbase4.apache.org/34263] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,096 DEBUG [Listener at jenkins-hbase4.apache.org/34263] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689855110659.2a7f8945e8e71c5fda6e6687065958ee. 2023-07-20 12:11:52,096 INFO [Listener at jenkins-hbase4.apache.org/34263] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 12:11:52,108 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-20 12:11:52,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689855112108 (current time:1689855112108). 2023-07-20 12:11:52,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 12:11:52,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(139): Connect 0x2e12b409 to 127.0.0.1:59849 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 12:11:52,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ac50d8f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 12:11:52,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:11:52,123 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34394, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:11:52,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2e12b409 to 127.0.0.1:59849 2023-07-20 12:11:52,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 12:11:52,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(139): Connect 0x730cf3de to 127.0.0.1:59849 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 12:11:52,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4885b34a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 12:11:52,133 DEBUG [hconnection-0x1afe66a0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:11:52,137 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34410, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:11:52,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:11:52,142 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55818, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:11:52,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x730cf3de to 127.0.0.1:59849 2023-07-20 12:11:52,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 12:11:52,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-20 12:11:52,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 12:11:52,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-20 12:11:52,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-20 12:11:52,148 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-20 12:11:52,149 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689855712149 2023-07-20 12:11:52,149 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-20 12:11:52,151 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 12:11:52,151 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 12:11:52,152 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-20 12:11:52,152 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-20 12:11:52,153 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-20 12:11:52,154 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-20 12:11:52,155 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689855712155 2023-07-20 12:11:52,167 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,167 INFO [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-20 12:11:52,167 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:11:52,168 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-20 12:11:52,168 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-20 12:11:52,169 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,169 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,170 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:11:52,170 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:11:52,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:11:52,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:11:52,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:11:52,170 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:52,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:11:52,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,170 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:11:52,171 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:52,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:11:52,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:11:52,171 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:52,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,171 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,171 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-20 12:11:52,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-20 12:11:52,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,171 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:52,172 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 12:11:52,172 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-20 12:11:52,172 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-20 12:11:52,172 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,172 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,172 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,172 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-20 12:11:52,172 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-20 12:11:52,172 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:11:52,172 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:11:52,174 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-20 12:11:52,175 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-20 12:11:52,175 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-20 12:11:52,175 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-20 12:11:52,176 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41865,1689855028765' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-20 12:11:52,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-20 12:11:52,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,176 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-20 12:11:52,175 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39003,1689855028825' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-20 12:11:52,176 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,176 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-20 12:11:52,176 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:11:52,177 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-20 12:11:52,177 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-20 12:11:52,177 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43611,1689855028889' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-20 12:11:52,178 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,180 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:52,180 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:52,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:11:52,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:11:52,183 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,183 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:52,183 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,183 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 12:11:52,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:11:52,183 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,183 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 12:11:52,183 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,183 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 12:11:52,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:11:52,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:52,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:52,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:52,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:11:52,185 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39003,1689855028825' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-20 12:11:52,185 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d841ec9[Count = 1] remaining members to acquire global barrier 2023-07-20 12:11:52,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:52,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:11:52,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:11:52,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:11:52,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:11:52,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:52,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:52,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:52,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:11:52,188 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43611,1689855028889' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-20 12:11:52,188 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d841ec9[Count = 0] remaining members to acquire global barrier 2023-07-20 12:11:52,188 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-20 12:11:52,188 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,191 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,191 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,191 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,191 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-20 12:11:52,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,191 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:52,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,191 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-20 12:11:52,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,191 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-20 12:11:52,191 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-20 12:11:52,191 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:52,192 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 12:11:52,192 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41865,1689855028765' in zk 2023-07-20 12:11:52,193 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-20 12:11:52,193 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:11:52,193 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-20 12:11:52,201 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 12:11:52,203 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689855110659.c06e9951077e3a3aad467134f69a717d. 2023-07-20 12:11:52,203 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689855110659.2a7f8945e8e71c5fda6e6687065958ee. 2023-07-20 12:11:52,203 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 12:11:52,203 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 12:11:52,203 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 12:11:52,203 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689855110659.2a7f8945e8e71c5fda6e6687065958ee. started... 2023-07-20 12:11:52,203 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689855110659.c06e9951077e3a3aad467134f69a717d. started... 2023-07-20 12:11:52,203 INFO [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2a7f8945e8e71c5fda6e6687065958ee 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-20 12:11:52,204 INFO [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c06e9951077e3a3aad467134f69a717d 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-20 12:11:52,245 INFO [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230720347fa2499b674667864c9659d3ac91bd to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230720347fa2499b674667864c9659d3ac91bd 2023-07-20 12:11:52,250 INFO [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230720b0403b2135104ef3a72612400008b8b8 to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230720b0403b2135104ef3a72612400008b8b8 2023-07-20 12:11:52,251 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 12:11:52,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-20 12:11:52,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-20 12:11:52,252 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 12:11:52,267 INFO [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion/2a7f8945e8e71c5fda6e6687065958ee/.tmp/cf/0a186cb3fc8a413a8e784dddf914439d 2023-07-20 12:11:52,274 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion/2a7f8945e8e71c5fda6e6687065958ee/.tmp/cf/0a186cb3fc8a413a8e784dddf914439d as hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion/2a7f8945e8e71c5fda6e6687065958ee/cf/0a186cb3fc8a413a8e784dddf914439d 2023-07-20 12:11:52,279 INFO [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion/c06e9951077e3a3aad467134f69a717d/.tmp/cf/798b9cd08a0c407e9ad0f97cebdc3966 2023-07-20 12:11:52,280 INFO [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion/2a7f8945e8e71c5fda6e6687065958ee/cf/0a186cb3fc8a413a8e784dddf914439d, entries=3, sequenceid=6, filesize=5.4 K 2023-07-20 12:11:52,281 INFO [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 2a7f8945e8e71c5fda6e6687065958ee in 78ms, sequenceid=6, compaction requested=false 2023-07-20 12:11:52,282 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-20 12:11:52,282 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2a7f8945e8e71c5fda6e6687065958ee: 2023-07-20 12:11:52,282 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689855110659.2a7f8945e8e71c5fda6e6687065958ee.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,282 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 12:11:52,282 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion/2a7f8945e8e71c5fda6e6687065958ee/cf/0a186cb3fc8a413a8e784dddf914439d] hfiles 2023-07-20 12:11:52,282 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion/2a7f8945e8e71c5fda6e6687065958ee/cf/0a186cb3fc8a413a8e784dddf914439d for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,286 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion/c06e9951077e3a3aad467134f69a717d/.tmp/cf/798b9cd08a0c407e9ad0f97cebdc3966 as hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion/c06e9951077e3a3aad467134f69a717d/cf/798b9cd08a0c407e9ad0f97cebdc3966 2023-07-20 12:11:52,293 INFO [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion/c06e9951077e3a3aad467134f69a717d/cf/798b9cd08a0c407e9ad0f97cebdc3966, entries=47, sequenceid=6, filesize=13.5 K 2023-07-20 12:11:52,296 INFO [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for c06e9951077e3a3aad467134f69a717d in 92ms, sequenceid=6, compaction requested=false 2023-07-20 12:11:52,301 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c06e9951077e3a3aad467134f69a717d: 2023-07-20 12:11:52,301 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689855110659.c06e9951077e3a3aad467134f69a717d.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,301 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 12:11:52,301 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion/c06e9951077e3a3aad467134f69a717d/cf/798b9cd08a0c407e9ad0f97cebdc3966] hfiles 2023-07-20 12:11:52,301 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion/c06e9951077e3a3aad467134f69a717d/cf/798b9cd08a0c407e9ad0f97cebdc3966 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,304 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689855110659.2a7f8945e8e71c5fda6e6687065958ee. completed. 2023-07-20 12:11:52,304 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689855110659.2a7f8945e8e71c5fda6e6687065958ee. 2023-07-20 12:11:52,304 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 12:11:52,304 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 12:11:52,304 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:52,304 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-20 12:11:52,304 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43611,1689855028889' in zk 2023-07-20 12:11:52,306 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:52,306 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-20 12:11:52,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:52,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:11:52,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:11:52,306 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:11:52,307 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-20 12:11:52,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:11:52,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:11:52,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:52,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:52,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:52,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:11:52,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:52,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:52,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43611,1689855028889': 2023-07-20 12:11:52,313 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43611,1689855028889' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-20 12:11:52,317 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689855110659.c06e9951077e3a3aad467134f69a717d. completed. 2023-07-20 12:11:52,317 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689855110659.c06e9951077e3a3aad467134f69a717d. 2023-07-20 12:11:52,317 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 12:11:52,317 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 12:11:52,317 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:52,317 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-20 12:11:52,317 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39003,1689855028825' in zk 2023-07-20 12:11:52,319 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:52,319 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-20 12:11:52,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:52,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:11:52,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:11:52,319 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:11:52,320 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-20 12:11:52,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:11:52,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:11:52,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:52,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:52,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:52,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:11:52,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:52,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:52,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:52,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39003,1689855028825': 2023-07-20 12:11:52,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39003,1689855028825' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-20 12:11:52,325 INFO [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-20 12:11:52,325 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 12:11:52,326 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 12:11:52,326 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,326 INFO [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 12:11:52,332 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,332 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,332 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:11:52,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:11:52,332 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:11:52,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,332 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,332 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:11:52,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:11:52,333 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:52,333 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:11:52,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:11:52,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:11:52,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:11:52,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:11:52,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:11:52,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:11:52,333 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:52,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:11:52,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,334 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:52,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:52,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:52,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:52,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:11:52,336 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:52,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,336 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:52,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:52,336 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:52,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:52,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:52,340 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:11:52,340 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:52,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:11:52,340 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,340 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:11:52,340 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:52,340 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:11:52,340 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:11:52,340 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:11:52,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:11:52,340 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:11:52,340 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:52,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:11:52,342 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:11:52,340 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:11:52,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:11:52,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:11:52,340 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,342 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:52,342 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,342 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,342 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:52,342 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,342 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:52,342 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 12:11:52,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:11:52,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:11:52,342 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:11:52,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:11:52,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:11:52,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:11:52,342 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,343 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230720b0403b2135104ef3a72612400008b8b8, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230720347fa2499b674667864c9659d3ac91bd] mob files 2023-07-20 12:11:52,343 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230720b0403b2135104ef3a72612400008b8b8 2023-07-20 12:11:52,343 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230720347fa2499b674667864c9659d3ac91bd 2023-07-20 12:11:52,353 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,353 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,377 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,453 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 12:11:52,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-20 12:11:52,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-20 12:11:52,454 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 12:11:52,754 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 12:11:52,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-20 12:11:52,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-20 12:11:52,756 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-20 12:11:52,809 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-20 12:11:52,809 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,809 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:11:52,809 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689855112149Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689855112353 (+204 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689855112353Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689855112353Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689855112356 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689855112370 (+14 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689855112809 (+439 ms) 2023-07-20 12:11:52,813 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-20 12:11:52,814 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 663 msec 2023-07-20 12:11:53,256 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 12:11:53,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-20 12:11:53,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 12:11:53,291 DEBUG [Listener at jenkins-hbase4.apache.org/34263] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-20 12:11:53,297 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46842, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-20 12:11:53,299 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39003] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-20 12:11:53,300 DEBUG [Listener at jenkins-hbase4.apache.org/34263] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-20 12:11:53,306 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34420, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-20 12:11:53,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41865] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-20 12:11:53,307 DEBUG [Listener at jenkins-hbase4.apache.org/34263] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-20 12:11:53,311 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55832, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-20 12:11:53,311 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43611] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-20 12:11:53,313 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-20 12:11:53,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:53,316 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 12:11:53,317 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-20 12:11:53,317 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 12:11:53,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-20 12:11:53,320 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07d48750580add700211dd7dd997b2d2 2023-07-20 12:11:53,320 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95565c4ae49236899c53e6b6be93c9bf 2023-07-20 12:11:53,320 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95565c4ae49236899c53e6b6be93c9bf empty. 2023-07-20 12:11:53,321 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07d48750580add700211dd7dd997b2d2 empty. 2023-07-20 12:11:53,321 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95565c4ae49236899c53e6b6be93c9bf 2023-07-20 12:11:53,321 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07d48750580add700211dd7dd997b2d2 2023-07-20 12:11:53,321 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-20 12:11:53,335 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-20 12:11:53,336 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 07d48750580add700211dd7dd997b2d2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113313.07d48750580add700211dd7dd997b2d2.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp 2023-07-20 12:11:53,336 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 95565c4ae49236899c53e6b6be93c9bf, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689855113313.95565c4ae49236899c53e6b6be93c9bf.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp 2023-07-20 12:11:53,380 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113313.07d48750580add700211dd7dd997b2d2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 12:11:53,381 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689855113313.95565c4ae49236899c53e6b6be93c9bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 12:11:53,381 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 07d48750580add700211dd7dd997b2d2, disabling compactions & flushes 2023-07-20 12:11:53,381 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 95565c4ae49236899c53e6b6be93c9bf, disabling compactions & flushes 2023-07-20 12:11:53,381 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689855113313.95565c4ae49236899c53e6b6be93c9bf. 2023-07-20 12:11:53,381 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689855113313.95565c4ae49236899c53e6b6be93c9bf. 2023-07-20 12:11:53,381 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689855113313.95565c4ae49236899c53e6b6be93c9bf. after waiting 0 ms 2023-07-20 12:11:53,381 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689855113313.95565c4ae49236899c53e6b6be93c9bf. 2023-07-20 12:11:53,381 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689855113313.95565c4ae49236899c53e6b6be93c9bf. 2023-07-20 12:11:53,381 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 95565c4ae49236899c53e6b6be93c9bf: 2023-07-20 12:11:53,381 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113313.07d48750580add700211dd7dd997b2d2. 2023-07-20 12:11:53,381 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113313.07d48750580add700211dd7dd997b2d2. 2023-07-20 12:11:53,381 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113313.07d48750580add700211dd7dd997b2d2. after waiting 0 ms 2023-07-20 12:11:53,382 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113313.07d48750580add700211dd7dd997b2d2. 2023-07-20 12:11:53,382 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113313.07d48750580add700211dd7dd997b2d2. 2023-07-20 12:11:53,382 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 07d48750580add700211dd7dd997b2d2: 2023-07-20 12:11:53,384 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 12:11:53,385 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689855113313.95565c4ae49236899c53e6b6be93c9bf.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689855113385"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689855113385"}]},"ts":"1689855113385"} 2023-07-20 12:11:53,385 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113313.07d48750580add700211dd7dd997b2d2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689855113385"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689855113385"}]},"ts":"1689855113385"} 2023-07-20 12:11:53,388 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 12:11:53,389 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 12:11:53,389 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689855113389"}]},"ts":"1689855113389"} 2023-07-20 12:11:53,392 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-20 12:11:53,396 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 12:11:53,402 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 12:11:53,402 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 12:11:53,402 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 12:11:53,402 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 12:11:53,402 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=07d48750580add700211dd7dd997b2d2, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=95565c4ae49236899c53e6b6be93c9bf, ASSIGN}] 2023-07-20 12:11:53,406 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=07d48750580add700211dd7dd997b2d2, ASSIGN 2023-07-20 12:11:53,406 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=95565c4ae49236899c53e6b6be93c9bf, ASSIGN 2023-07-20 12:11:53,407 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=95565c4ae49236899c53e6b6be93c9bf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43611,1689855028889; forceNewPlan=false, retain=false 2023-07-20 12:11:53,407 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=07d48750580add700211dd7dd997b2d2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39003,1689855028825; forceNewPlan=false, retain=false 2023-07-20 12:11:53,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-20 12:11:53,557 INFO [jenkins-hbase4:46247] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 12:11:53,561 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=95565c4ae49236899c53e6b6be93c9bf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:53,561 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=07d48750580add700211dd7dd997b2d2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:53,561 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689855113313.95565c4ae49236899c53e6b6be93c9bf.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689855113560"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689855113560"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689855113560"}]},"ts":"1689855113560"} 2023-07-20 12:11:53,561 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113313.07d48750580add700211dd7dd997b2d2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689855113560"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689855113560"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689855113560"}]},"ts":"1689855113560"} 2023-07-20 12:11:53,563 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 95565c4ae49236899c53e6b6be93c9bf, server=jenkins-hbase4.apache.org,43611,1689855028889}] 2023-07-20 12:11:53,564 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure 07d48750580add700211dd7dd997b2d2, server=jenkins-hbase4.apache.org,39003,1689855028825}] 2023-07-20 12:11:53,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-20 12:11:53,719 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689855113313.95565c4ae49236899c53e6b6be93c9bf. 2023-07-20 12:11:53,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 95565c4ae49236899c53e6b6be93c9bf, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689855113313.95565c4ae49236899c53e6b6be93c9bf.', STARTKEY => '2', ENDKEY => ''} 2023-07-20 12:11:53,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689855113313.95565c4ae49236899c53e6b6be93c9bf. service=AccessControlService 2023-07-20 12:11:53,720 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113313.07d48750580add700211dd7dd997b2d2. 2023-07-20 12:11:53,720 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 12:11:53,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 07d48750580add700211dd7dd997b2d2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113313.07d48750580add700211dd7dd997b2d2.', STARTKEY => '', ENDKEY => '2'} 2023-07-20 12:11:53,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 95565c4ae49236899c53e6b6be93c9bf 2023-07-20 12:11:53,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689855113313.95565c4ae49236899c53e6b6be93c9bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 12:11:53,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 95565c4ae49236899c53e6b6be93c9bf 2023-07-20 12:11:53,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 95565c4ae49236899c53e6b6be93c9bf 2023-07-20 12:11:53,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113313.07d48750580add700211dd7dd997b2d2. service=AccessControlService 2023-07-20 12:11:53,721 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 12:11:53,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 07d48750580add700211dd7dd997b2d2 2023-07-20 12:11:53,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113313.07d48750580add700211dd7dd997b2d2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 12:11:53,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 07d48750580add700211dd7dd997b2d2 2023-07-20 12:11:53,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 07d48750580add700211dd7dd997b2d2 2023-07-20 12:11:53,722 INFO [StoreOpener-95565c4ae49236899c53e6b6be93c9bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 95565c4ae49236899c53e6b6be93c9bf 2023-07-20 12:11:53,724 INFO [StoreOpener-07d48750580add700211dd7dd997b2d2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 07d48750580add700211dd7dd997b2d2 2023-07-20 12:11:53,725 DEBUG [StoreOpener-95565c4ae49236899c53e6b6be93c9bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95565c4ae49236899c53e6b6be93c9bf/cf 2023-07-20 12:11:53,725 DEBUG [StoreOpener-95565c4ae49236899c53e6b6be93c9bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95565c4ae49236899c53e6b6be93c9bf/cf 2023-07-20 12:11:53,725 INFO [StoreOpener-95565c4ae49236899c53e6b6be93c9bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 95565c4ae49236899c53e6b6be93c9bf columnFamilyName cf 2023-07-20 12:11:53,726 INFO [StoreOpener-95565c4ae49236899c53e6b6be93c9bf-1] regionserver.HStore(310): Store=95565c4ae49236899c53e6b6be93c9bf/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 12:11:53,727 DEBUG [StoreOpener-07d48750580add700211dd7dd997b2d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07d48750580add700211dd7dd997b2d2/cf 2023-07-20 12:11:53,727 DEBUG [StoreOpener-07d48750580add700211dd7dd997b2d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07d48750580add700211dd7dd997b2d2/cf 2023-07-20 12:11:53,728 INFO [StoreOpener-07d48750580add700211dd7dd997b2d2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 07d48750580add700211dd7dd997b2d2 columnFamilyName cf 2023-07-20 12:11:53,728 INFO [StoreOpener-07d48750580add700211dd7dd997b2d2-1] regionserver.HStore(310): Store=07d48750580add700211dd7dd997b2d2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 12:11:53,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95565c4ae49236899c53e6b6be93c9bf 2023-07-20 12:11:53,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07d48750580add700211dd7dd997b2d2 2023-07-20 12:11:53,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95565c4ae49236899c53e6b6be93c9bf 2023-07-20 12:11:53,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07d48750580add700211dd7dd997b2d2 2023-07-20 12:11:53,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 95565c4ae49236899c53e6b6be93c9bf 2023-07-20 12:11:53,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 07d48750580add700211dd7dd997b2d2 2023-07-20 12:11:53,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95565c4ae49236899c53e6b6be93c9bf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 12:11:53,739 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 95565c4ae49236899c53e6b6be93c9bf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63770092, jitterRate=-0.04975157976150513}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 12:11:53,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 95565c4ae49236899c53e6b6be93c9bf: 2023-07-20 12:11:53,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07d48750580add700211dd7dd997b2d2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 12:11:53,746 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689855113313.95565c4ae49236899c53e6b6be93c9bf., pid=69, masterSystemTime=1689855113715 2023-07-20 12:11:53,747 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 07d48750580add700211dd7dd997b2d2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63285809, jitterRate=-0.05696795880794525}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 12:11:53,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 07d48750580add700211dd7dd997b2d2: 2023-07-20 12:11:53,747 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113313.07d48750580add700211dd7dd997b2d2., pid=70, masterSystemTime=1689855113716 2023-07-20 12:11:53,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689855113313.95565c4ae49236899c53e6b6be93c9bf. 2023-07-20 12:11:53,748 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689855113313.95565c4ae49236899c53e6b6be93c9bf. 2023-07-20 12:11:53,749 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=95565c4ae49236899c53e6b6be93c9bf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:53,749 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689855113313.95565c4ae49236899c53e6b6be93c9bf.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689855113749"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689855113749"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689855113749"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689855113749"}]},"ts":"1689855113749"} 2023-07-20 12:11:53,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113313.07d48750580add700211dd7dd997b2d2. 2023-07-20 12:11:53,750 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113313.07d48750580add700211dd7dd997b2d2. 2023-07-20 12:11:53,751 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=07d48750580add700211dd7dd997b2d2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:53,751 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113313.07d48750580add700211dd7dd997b2d2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689855113751"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689855113751"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689855113751"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689855113751"}]},"ts":"1689855113751"} 2023-07-20 12:11:53,767 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-20 12:11:53,767 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 95565c4ae49236899c53e6b6be93c9bf, server=jenkins-hbase4.apache.org,43611,1689855028889 in 189 msec 2023-07-20 12:11:53,767 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-20 12:11:53,767 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure 07d48750580add700211dd7dd997b2d2, server=jenkins-hbase4.apache.org,39003,1689855028825 in 189 msec 2023-07-20 12:11:53,770 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=95565c4ae49236899c53e6b6be93c9bf, ASSIGN in 365 msec 2023-07-20 12:11:53,771 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-20 12:11:53,772 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=07d48750580add700211dd7dd997b2d2, ASSIGN in 365 msec 2023-07-20 12:11:53,773 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 12:11:53,773 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689855113773"}]},"ts":"1689855113773"} 2023-07-20 12:11:53,775 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-20 12:11:53,815 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 12:11:53,816 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-20 12:11:53,818 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43611] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-20 12:11:53,859 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:11:53,860 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:11:53,859 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:11:53,860 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:11:53,907 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 12:11:53,907 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-20 12:11:53,908 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 593 msec 2023-07-20 12:11:53,910 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 12:11:53,910 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 12:11:53,910 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 12:11:53,910 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-20 12:11:53,911 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-20 12:11:53,911 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-20 12:11:53,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-20 12:11:53,922 INFO [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-20 12:11:53,963 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 07d48750580add700211dd7dd997b2d2, 95565c4ae49236899c53e6b6be93c9bf 2023-07-20 12:11:53,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[07d48750580add700211dd7dd997b2d2, 95565c4ae49236899c53e6b6be93c9bf], force=true 2023-07-20 12:11:53,978 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[07d48750580add700211dd7dd997b2d2, 95565c4ae49236899c53e6b6be93c9bf], force=true 2023-07-20 12:11:53,979 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[07d48750580add700211dd7dd997b2d2, 95565c4ae49236899c53e6b6be93c9bf], force=true 2023-07-20 12:11:53,979 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[07d48750580add700211dd7dd997b2d2, 95565c4ae49236899c53e6b6be93c9bf], force=true 2023-07-20 12:11:53,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-20 12:11:54,008 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=07d48750580add700211dd7dd997b2d2, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=95565c4ae49236899c53e6b6be93c9bf, UNASSIGN}] 2023-07-20 12:11:54,011 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=07d48750580add700211dd7dd997b2d2, UNASSIGN 2023-07-20 12:11:54,013 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=95565c4ae49236899c53e6b6be93c9bf, UNASSIGN 2023-07-20 12:11:54,014 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=07d48750580add700211dd7dd997b2d2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:54,014 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=95565c4ae49236899c53e6b6be93c9bf, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:54,014 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113313.07d48750580add700211dd7dd997b2d2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689855114014"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689855114014"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689855114014"}]},"ts":"1689855114014"} 2023-07-20 12:11:54,014 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689855113313.95565c4ae49236899c53e6b6be93c9bf.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689855114014"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689855114014"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689855114014"}]},"ts":"1689855114014"} 2023-07-20 12:11:54,016 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 07d48750580add700211dd7dd997b2d2, server=jenkins-hbase4.apache.org,39003,1689855028825}] 2023-07-20 12:11:54,017 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 95565c4ae49236899c53e6b6be93c9bf, server=jenkins-hbase4.apache.org,43611,1689855028889}] 2023-07-20 12:11:54,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-20 12:11:54,168 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 07d48750580add700211dd7dd997b2d2 2023-07-20 12:11:54,170 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 07d48750580add700211dd7dd997b2d2, disabling compactions & flushes 2023-07-20 12:11:54,170 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113313.07d48750580add700211dd7dd997b2d2. 2023-07-20 12:11:54,170 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113313.07d48750580add700211dd7dd997b2d2. 2023-07-20 12:11:54,170 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113313.07d48750580add700211dd7dd997b2d2. after waiting 0 ms 2023-07-20 12:11:54,170 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113313.07d48750580add700211dd7dd997b2d2. 2023-07-20 12:11:54,170 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 07d48750580add700211dd7dd997b2d2 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-20 12:11:54,170 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 95565c4ae49236899c53e6b6be93c9bf 2023-07-20 12:11:54,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 95565c4ae49236899c53e6b6be93c9bf, disabling compactions & flushes 2023-07-20 12:11:54,172 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689855113313.95565c4ae49236899c53e6b6be93c9bf. 2023-07-20 12:11:54,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689855113313.95565c4ae49236899c53e6b6be93c9bf. 2023-07-20 12:11:54,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689855113313.95565c4ae49236899c53e6b6be93c9bf. after waiting 0 ms 2023-07-20 12:11:54,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689855113313.95565c4ae49236899c53e6b6be93c9bf. 2023-07-20 12:11:54,172 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 95565c4ae49236899c53e6b6be93c9bf 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-20 12:11:54,203 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95565c4ae49236899c53e6b6be93c9bf/.tmp/cf/a37835d184984726bd96631244c7576c 2023-07-20 12:11:54,203 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07d48750580add700211dd7dd997b2d2/.tmp/cf/a598b61d002b4fdbb7580de93c182d58 2023-07-20 12:11:54,209 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95565c4ae49236899c53e6b6be93c9bf/.tmp/cf/a37835d184984726bd96631244c7576c as hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95565c4ae49236899c53e6b6be93c9bf/cf/a37835d184984726bd96631244c7576c 2023-07-20 12:11:54,213 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07d48750580add700211dd7dd997b2d2/.tmp/cf/a598b61d002b4fdbb7580de93c182d58 as hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07d48750580add700211dd7dd997b2d2/cf/a598b61d002b4fdbb7580de93c182d58 2023-07-20 12:11:54,220 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07d48750580add700211dd7dd997b2d2/cf/a598b61d002b4fdbb7580de93c182d58, entries=1, sequenceid=5, filesize=4.7 K 2023-07-20 12:11:54,221 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 07d48750580add700211dd7dd997b2d2 in 51ms, sequenceid=5, compaction requested=false 2023-07-20 12:11:54,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-20 12:11:54,223 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95565c4ae49236899c53e6b6be93c9bf/cf/a37835d184984726bd96631244c7576c, entries=1, sequenceid=5, filesize=4.7 K 2023-07-20 12:11:54,224 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 95565c4ae49236899c53e6b6be93c9bf in 52ms, sequenceid=5, compaction requested=false 2023-07-20 12:11:54,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95565c4ae49236899c53e6b6be93c9bf/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-20 12:11:54,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 12:11:54,246 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689855113313.95565c4ae49236899c53e6b6be93c9bf. 2023-07-20 12:11:54,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 95565c4ae49236899c53e6b6be93c9bf: 2023-07-20 12:11:54,248 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 95565c4ae49236899c53e6b6be93c9bf 2023-07-20 12:11:54,249 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=95565c4ae49236899c53e6b6be93c9bf, regionState=CLOSED 2023-07-20 12:11:54,249 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689855113313.95565c4ae49236899c53e6b6be93c9bf.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689855114249"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689855114249"}]},"ts":"1689855114249"} 2023-07-20 12:11:54,251 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07d48750580add700211dd7dd997b2d2/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-20 12:11:54,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 12:11:54,252 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113313.07d48750580add700211dd7dd997b2d2. 2023-07-20 12:11:54,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 07d48750580add700211dd7dd997b2d2: 2023-07-20 12:11:54,253 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-20 12:11:54,253 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 95565c4ae49236899c53e6b6be93c9bf, server=jenkins-hbase4.apache.org,43611,1689855028889 in 234 msec 2023-07-20 12:11:54,254 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 07d48750580add700211dd7dd997b2d2 2023-07-20 12:11:54,257 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=07d48750580add700211dd7dd997b2d2, regionState=CLOSED 2023-07-20 12:11:54,257 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113313.07d48750580add700211dd7dd997b2d2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689855114257"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689855114257"}]},"ts":"1689855114257"} 2023-07-20 12:11:54,260 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=95565c4ae49236899c53e6b6be93c9bf, UNASSIGN in 245 msec 2023-07-20 12:11:54,264 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-20 12:11:54,264 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 07d48750580add700211dd7dd997b2d2, server=jenkins-hbase4.apache.org,39003,1689855028825 in 246 msec 2023-07-20 12:11:54,267 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-20 12:11:54,267 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=07d48750580add700211dd7dd997b2d2, UNASSIGN in 260 msec 2023-07-20 12:11:54,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-20 12:11:54,451 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3af095cc065d1ed5327a1413ea53977/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-20 12:11:54,455 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113313.07d48750580add700211dd7dd997b2d2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-20 12:11:54,455 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689855113313.95565c4ae49236899c53e6b6be93c9bf.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-20 12:11:54,456 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113314.f3af095cc065d1ed5327a1413ea53977.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-20 12:11:54,528 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f3af095cc065d1ed5327a1413ea53977, ASSIGN}] 2023-07-20 12:11:54,530 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f3af095cc065d1ed5327a1413ea53977, ASSIGN 2023-07-20 12:11:54,531 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f3af095cc065d1ed5327a1413ea53977, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,39003,1689855028825; forceNewPlan=false, retain=false 2023-07-20 12:11:54,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-20 12:11:54,681 INFO [jenkins-hbase4:46247] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-20 12:11:54,687 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=f3af095cc065d1ed5327a1413ea53977, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:54,687 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113314.f3af095cc065d1ed5327a1413ea53977.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689855114687"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689855114687"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689855114687"}]},"ts":"1689855114687"} 2023-07-20 12:11:54,696 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure f3af095cc065d1ed5327a1413ea53977, server=jenkins-hbase4.apache.org,39003,1689855028825}] 2023-07-20 12:11:54,852 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113314.f3af095cc065d1ed5327a1413ea53977. 2023-07-20 12:11:54,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f3af095cc065d1ed5327a1413ea53977, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113314.f3af095cc065d1ed5327a1413ea53977.', STARTKEY => '', ENDKEY => ''} 2023-07-20 12:11:54,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113314.f3af095cc065d1ed5327a1413ea53977. service=AccessControlService 2023-07-20 12:11:54,853 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 12:11:54,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 f3af095cc065d1ed5327a1413ea53977 2023-07-20 12:11:54,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113314.f3af095cc065d1ed5327a1413ea53977.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 12:11:54,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f3af095cc065d1ed5327a1413ea53977 2023-07-20 12:11:54,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f3af095cc065d1ed5327a1413ea53977 2023-07-20 12:11:54,855 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3af095cc065d1ed5327a1413ea53977/.regioninfo 2023-07-20 12:11:54,869 INFO [StoreOpener-f3af095cc065d1ed5327a1413ea53977-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f3af095cc065d1ed5327a1413ea53977 2023-07-20 12:11:54,870 DEBUG [StoreOpener-f3af095cc065d1ed5327a1413ea53977-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3af095cc065d1ed5327a1413ea53977/cf 2023-07-20 12:11:54,870 DEBUG [StoreOpener-f3af095cc065d1ed5327a1413ea53977-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3af095cc065d1ed5327a1413ea53977/cf 2023-07-20 12:11:54,871 INFO [StoreOpener-f3af095cc065d1ed5327a1413ea53977-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f3af095cc065d1ed5327a1413ea53977 columnFamilyName cf 2023-07-20 12:11:54,906 DEBUG [StoreOpener-f3af095cc065d1ed5327a1413ea53977-1] regionserver.HStore(539): loaded hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3af095cc065d1ed5327a1413ea53977/cf/a37835d184984726bd96631244c7576c.95565c4ae49236899c53e6b6be93c9bf->hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95565c4ae49236899c53e6b6be93c9bf/cf/a37835d184984726bd96631244c7576c-top 2023-07-20 12:11:54,912 DEBUG [StoreOpener-f3af095cc065d1ed5327a1413ea53977-1] regionserver.HStore(539): loaded hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3af095cc065d1ed5327a1413ea53977/cf/a598b61d002b4fdbb7580de93c182d58.07d48750580add700211dd7dd997b2d2->hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07d48750580add700211dd7dd997b2d2/cf/a598b61d002b4fdbb7580de93c182d58-top 2023-07-20 12:11:54,913 INFO [StoreOpener-f3af095cc065d1ed5327a1413ea53977-1] regionserver.HStore(310): Store=f3af095cc065d1ed5327a1413ea53977/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 12:11:54,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3af095cc065d1ed5327a1413ea53977 2023-07-20 12:11:54,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3af095cc065d1ed5327a1413ea53977 2023-07-20 12:11:54,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f3af095cc065d1ed5327a1413ea53977 2023-07-20 12:11:54,919 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f3af095cc065d1ed5327a1413ea53977; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70106769, jitterRate=0.04467226564884186}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 12:11:54,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f3af095cc065d1ed5327a1413ea53977: 2023-07-20 12:11:54,920 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113314.f3af095cc065d1ed5327a1413ea53977., pid=77, masterSystemTime=1689855114848 2023-07-20 12:11:54,921 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113314.f3af095cc065d1ed5327a1413ea53977.,because compaction is disabled. 2023-07-20 12:11:54,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113314.f3af095cc065d1ed5327a1413ea53977. 2023-07-20 12:11:54,922 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113314.f3af095cc065d1ed5327a1413ea53977. 2023-07-20 12:11:54,923 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=f3af095cc065d1ed5327a1413ea53977, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:54,923 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113314.f3af095cc065d1ed5327a1413ea53977.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689855114923"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689855114923"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689855114923"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689855114923"}]},"ts":"1689855114923"} 2023-07-20 12:11:54,928 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-20 12:11:54,928 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure f3af095cc065d1ed5327a1413ea53977, server=jenkins-hbase4.apache.org,39003,1689855028825 in 230 msec 2023-07-20 12:11:54,931 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-20 12:11:54,931 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f3af095cc065d1ed5327a1413ea53977, ASSIGN in 400 msec 2023-07-20 12:11:54,935 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[07d48750580add700211dd7dd997b2d2, 95565c4ae49236899c53e6b6be93c9bf], force=true in 963 msec 2023-07-20 12:11:55,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-20 12:11:55,087 INFO [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-20 12:11:55,088 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-20 12:11:55,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689855115088 (current time:1689855115088). 2023-07-20 12:11:55,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 12:11:55,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(139): Connect 0x2590b40d to 127.0.0.1:59849 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 12:11:55,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71334e54, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 12:11:55,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:11:55,103 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34434, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:11:55,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2590b40d to 127.0.0.1:59849 2023-07-20 12:11:55,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 12:11:55,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(139): Connect 0x7be928c3 to 127.0.0.1:59849 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 12:11:55,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5bf9cb6f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 12:11:55,165 DEBUG [hconnection-0x30d36faa-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:11:55,170 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34446, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:11:55,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:11:55,179 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55836, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:11:55,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7be928c3 to 127.0.0.1:59849 2023-07-20 12:11:55,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 12:11:55,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-20 12:11:55,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 12:11:55,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-20 12:11:55,183 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689855037970_0004_000001 (auth:SIMPLE) 2023-07-20 12:11:55,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-20 12:11:55,192 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-20 12:11:55,195 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689855715195 2023-07-20 12:11:55,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-20 12:11:55,201 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,201 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 12:11:55,202 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 12:11:55,209 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-20 12:11:55,211 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-20 12:11:55,212 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 27 msec 2023-07-20 12:11:55,214 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-20 12:11:55,216 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689855715216 2023-07-20 12:11:55,287 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,287 INFO [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-20 12:11:55,287 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:11:55,288 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-20 12:11:55,289 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-20 12:11:55,295 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,295 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,296 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:11:55,296 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:11:55,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:11:55,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:11:55,297 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:55,296 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:11:55,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:11:55,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:11:55,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:11:55,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:11:55,297 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:55,297 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 12:11:55,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,298 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,298 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,298 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-20 12:11:55,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-20 12:11:55,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-20 12:11:55,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,298 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-20 12:11:55,298 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-20 12:11:55,298 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-20 12:11:55,302 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 12:11:55,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-20 12:11:55,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-20 12:11:55,303 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 12:11:55,311 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,311 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-20 12:11:55,311 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:11:55,316 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,317 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-20 12:11:55,318 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-20 12:11:55,318 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:11:55,318 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,320 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-20 12:11:55,320 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-20 12:11:55,318 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-20 12:11:55,320 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43611,1689855028889' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-20 12:11:55,320 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-20 12:11:55,320 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:11:55,320 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41865,1689855028765' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-20 12:11:55,322 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-20 12:11:55,322 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-20 12:11:55,322 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39003,1689855028825' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-20 12:11:55,324 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,325 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:55,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:55,325 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,325 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:11:55,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:11:55,325 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,325 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 12:11:55,326 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:11:55,326 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 12:11:55,330 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:11:55,330 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 12:11:55,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:55,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:55,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:55,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:11:55,333 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39003,1689855028825' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-20 12:11:55,333 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@773b9802[Count = 0] remaining members to acquire global barrier 2023-07-20 12:11:55,333 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-20 12:11:55,333 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,334 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,334 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,335 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-20 12:11:55,335 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:55,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,334 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,335 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-20 12:11:55,335 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-20 12:11:55,335 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,41865,1689855028765' in zk 2023-07-20 12:11:55,335 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 12:11:55,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,335 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-20 12:11:55,335 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-20 12:11:55,335 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,43611,1689855028889' in zk 2023-07-20 12:11:55,337 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-20 12:11:55,337 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:11:55,337 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-20 12:11:55,339 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-20 12:11:55,339 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 12:11:55,340 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113314.f3af095cc065d1ed5327a1413ea53977. 2023-07-20 12:11:55,340 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 12:11:55,340 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113314.f3af095cc065d1ed5327a1413ea53977. started... 2023-07-20 12:11:55,340 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:11:55,340 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-20 12:11:55,345 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f3af095cc065d1ed5327a1413ea53977: 2023-07-20 12:11:55,345 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113314.f3af095cc065d1ed5327a1413ea53977.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,345 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 12:11:55,345 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3af095cc065d1ed5327a1413ea53977/cf/a37835d184984726bd96631244c7576c.95565c4ae49236899c53e6b6be93c9bf->hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95565c4ae49236899c53e6b6be93c9bf/cf/a37835d184984726bd96631244c7576c-top, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3af095cc065d1ed5327a1413ea53977/cf/a598b61d002b4fdbb7580de93c182d58.07d48750580add700211dd7dd997b2d2->hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07d48750580add700211dd7dd997b2d2/cf/a598b61d002b4fdbb7580de93c182d58-top] hfiles 2023-07-20 12:11:55,345 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3af095cc065d1ed5327a1413ea53977/cf/a37835d184984726bd96631244c7576c.95565c4ae49236899c53e6b6be93c9bf for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,346 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3af095cc065d1ed5327a1413ea53977/cf/a598b61d002b4fdbb7580de93c182d58.07d48750580add700211dd7dd997b2d2 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,401 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113314.f3af095cc065d1ed5327a1413ea53977. completed. 2023-07-20 12:11:55,402 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113314.f3af095cc065d1ed5327a1413ea53977. 2023-07-20 12:11:55,402 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 12:11:55,402 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 12:11:55,402 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:55,402 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-20 12:11:55,402 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39003,1689855028825' in zk 2023-07-20 12:11:55,408 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:55,408 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-20 12:11:55,408 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:11:55,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:55,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:11:55,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:11:55,408 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-20 12:11:55,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:11:55,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:11:55,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:55,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:55,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:55,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:11:55,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:55,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:55,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:55,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,39003,1689855028825': 2023-07-20 12:11:55,414 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39003,1689855028825' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-20 12:11:55,414 INFO [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-20 12:11:55,414 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 12:11:55,414 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 12:11:55,414 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,414 INFO [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 12:11:55,416 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,416 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,416 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,416 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:11:55,416 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:11:55,416 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,416 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:11:55,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:11:55,417 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:55,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:11:55,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:11:55,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:11:55,417 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:55,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:11:55,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,418 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:55,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:11:55,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:11:55,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:11:55,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:11:55,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:11:55,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:55,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:55,421 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:55,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:55,422 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:55,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:11:55,422 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:55,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:55,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:55,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:55,426 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:11:55,426 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:11:55,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:11:55,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:11:55,426 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:11:55,427 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:55,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:11:55,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:11:55,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:11:55,427 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,427 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:55,427 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:55,427 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,427 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:11:55,427 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,427 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:11:55,427 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:11:55,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:11:55,427 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:11:55,427 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:11:55,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:11:55,427 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:11:55,427 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,427 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:11:55,428 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:11:55,428 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,428 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,429 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:11:55,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:11:55,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:11:55,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:11:55,496 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,503 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 12:11:55,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-20 12:11:55,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-20 12:11:55,505 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 12:11:55,552 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-20 12:11:55,552 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,552 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,553 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689855115201Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689855115428 (+227 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689855115428Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689855115434 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689855115479 (+45 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689855115552 (+73 ms) 2023-07-20 12:11:55,556 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-20 12:11:55,558 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 348 msec 2023-07-20 12:11:55,805 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 12:11:55,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-20 12:11:55,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 12:11:55,807 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855115807 2023-07-20 12:11:55,807 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37499, tgtDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855115807, rawTgtDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855115807, srcFsUri=hdfs://localhost:37499, srcDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc 2023-07-20 12:11:55,834 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37499, inputRoot=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc 2023-07-20 12:11:55,834 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-831471530_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855115807, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855115807/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,834 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37499, inputRoot=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc, snapshotDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-20 12:11:55,844 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855115807/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:11:55,891 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:55,892 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:55,892 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:55,892 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:55,965 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 12:11:57,057 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/hadoop-5415520984905794970.jar 2023-07-20 12:11:57,057 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:57,058 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:57,146 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/hadoop-6557247692402650578.jar 2023-07-20 12:11:57,147 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:57,147 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:57,148 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:57,148 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:57,149 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:57,150 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 12:11:57,150 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 12:11:57,151 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 12:11:57,151 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 12:11:57,152 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 12:11:57,153 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 12:11:57,153 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 12:11:57,154 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 12:11:57,154 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 12:11:57,155 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 12:11:57,156 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 12:11:57,156 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 12:11:57,157 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 12:11:57,158 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 12:11:57,158 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 12:11:57,159 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 12:11:57,159 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 12:11:57,160 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 12:11:58,106 WARN [Listener at jenkins-hbase4.apache.org/34263] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 12:11:58,109 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-20 12:11:58,111 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-20 12:11:58,208 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 12:11:58,209 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 12:11:58,818 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689855037970_0005_000001 (auth:SIMPLE) 2023-07-20 12:12:05,342 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689855037970_0005_000001 (auth:SIMPLE) 2023-07-20 12:12:07,733 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689855037970_0005_000001 (auth:SIMPLE) 2023-07-20 12:12:12,145 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689855037970_0005_000001 (auth:SIMPLE) 2023-07-20 12:12:13,361 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 12:12:13,364 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 12:12:13,375 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:12:13,375 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 12:12:13,376 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 12:12:13,376 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1891902696_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:12:13,376 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(367): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-20 12:12:13,377 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(367): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-20 12:12:13,377 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1891902696_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855115807/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855115807/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:12:13,377 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(367): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855115807/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-20 12:12:13,377 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(367): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855115807/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-20 12:12:13,389 INFO [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:12:13,389 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:12:13,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:12:13,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-20 12:12:13,395 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689855133395"}]},"ts":"1689855133395"} 2023-07-20 12:12:13,396 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-20 12:12:13,400 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-20 12:12:13,400 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f3af095cc065d1ed5327a1413ea53977, UNASSIGN}] 2023-07-20 12:12:13,402 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f3af095cc065d1ed5327a1413ea53977, UNASSIGN 2023-07-20 12:12:13,403 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=f3af095cc065d1ed5327a1413ea53977, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:13,403 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113314.f3af095cc065d1ed5327a1413ea53977.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689855133402"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689855133402"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689855133402"}]},"ts":"1689855133402"} 2023-07-20 12:12:13,404 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure f3af095cc065d1ed5327a1413ea53977, server=jenkins-hbase4.apache.org,39003,1689855028825}] 2023-07-20 12:12:13,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-20 12:12:13,558 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f3af095cc065d1ed5327a1413ea53977 2023-07-20 12:12:13,559 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f3af095cc065d1ed5327a1413ea53977, disabling compactions & flushes 2023-07-20 12:12:13,559 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113314.f3af095cc065d1ed5327a1413ea53977. 2023-07-20 12:12:13,559 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113314.f3af095cc065d1ed5327a1413ea53977. 2023-07-20 12:12:13,559 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113314.f3af095cc065d1ed5327a1413ea53977. after waiting 0 ms 2023-07-20 12:12:13,559 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113314.f3af095cc065d1ed5327a1413ea53977. 2023-07-20 12:12:13,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3af095cc065d1ed5327a1413ea53977/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-20 12:12:13,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 12:12:13,572 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113314.f3af095cc065d1ed5327a1413ea53977. 2023-07-20 12:12:13,572 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f3af095cc065d1ed5327a1413ea53977: 2023-07-20 12:12:13,574 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f3af095cc065d1ed5327a1413ea53977 2023-07-20 12:12:13,574 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=f3af095cc065d1ed5327a1413ea53977, regionState=CLOSED 2023-07-20 12:12:13,574 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113314.f3af095cc065d1ed5327a1413ea53977.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689855133574"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689855133574"}]},"ts":"1689855133574"} 2023-07-20 12:12:13,579 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-20 12:12:13,579 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure f3af095cc065d1ed5327a1413ea53977, server=jenkins-hbase4.apache.org,39003,1689855028825 in 172 msec 2023-07-20 12:12:13,582 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-20 12:12:13,582 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f3af095cc065d1ed5327a1413ea53977, UNASSIGN in 179 msec 2023-07-20 12:12:13,583 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689855133583"}]},"ts":"1689855133583"} 2023-07-20 12:12:13,585 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-20 12:12:13,586 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-20 12:12:13,589 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 198 msec 2023-07-20 12:12:13,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-20 12:12:13,697 INFO [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-20 12:12:13,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:12:13,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:12:13,701 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:12:13,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:12:13,702 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:12:13,703 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43611] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:12:13,706 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95565c4ae49236899c53e6b6be93c9bf 2023-07-20 12:12:13,706 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3af095cc065d1ed5327a1413ea53977 2023-07-20 12:12:13,706 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07d48750580add700211dd7dd997b2d2 2023-07-20 12:12:13,706 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:12:13,706 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:12:13,706 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:12:13,706 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:12:13,707 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-20 12:12:13,707 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-20 12:12:13,707 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-20 12:12:13,707 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-20 12:12:13,709 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95565c4ae49236899c53e6b6be93c9bf/cf, FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95565c4ae49236899c53e6b6be93c9bf/recovered.edits] 2023-07-20 12:12:13,709 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3af095cc065d1ed5327a1413ea53977/cf, FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3af095cc065d1ed5327a1413ea53977/recovered.edits] 2023-07-20 12:12:13,709 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07d48750580add700211dd7dd997b2d2/cf, FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07d48750580add700211dd7dd997b2d2/recovered.edits] 2023-07-20 12:12:13,710 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:12:13,710 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:12:13,710 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:12:13,710 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:12:13,710 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:12:13,710 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:12:13,710 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:12:13,710 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:12:13,711 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 12:12:13,711 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 12:12:13,711 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 12:12:13,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-20 12:12:13,712 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 12:12:13,714 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95565c4ae49236899c53e6b6be93c9bf/cf/a37835d184984726bd96631244c7576c to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95565c4ae49236899c53e6b6be93c9bf/cf/a37835d184984726bd96631244c7576c 2023-07-20 12:12:13,715 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07d48750580add700211dd7dd997b2d2/cf/a598b61d002b4fdbb7580de93c182d58 to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07d48750580add700211dd7dd997b2d2/cf/a598b61d002b4fdbb7580de93c182d58 2023-07-20 12:12:13,716 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3af095cc065d1ed5327a1413ea53977/cf/a37835d184984726bd96631244c7576c.95565c4ae49236899c53e6b6be93c9bf to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3af095cc065d1ed5327a1413ea53977/cf/a37835d184984726bd96631244c7576c.95565c4ae49236899c53e6b6be93c9bf 2023-07-20 12:12:13,717 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3af095cc065d1ed5327a1413ea53977/cf/a598b61d002b4fdbb7580de93c182d58.07d48750580add700211dd7dd997b2d2 to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3af095cc065d1ed5327a1413ea53977/cf/a598b61d002b4fdbb7580de93c182d58.07d48750580add700211dd7dd997b2d2 2023-07-20 12:12:13,720 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95565c4ae49236899c53e6b6be93c9bf/recovered.edits/8.seqid to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95565c4ae49236899c53e6b6be93c9bf/recovered.edits/8.seqid 2023-07-20 12:12:13,720 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07d48750580add700211dd7dd997b2d2/recovered.edits/8.seqid to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07d48750580add700211dd7dd997b2d2/recovered.edits/8.seqid 2023-07-20 12:12:13,721 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/95565c4ae49236899c53e6b6be93c9bf 2023-07-20 12:12:13,721 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/07d48750580add700211dd7dd997b2d2 2023-07-20 12:12:13,722 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3af095cc065d1ed5327a1413ea53977/recovered.edits/12.seqid to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3af095cc065d1ed5327a1413ea53977/recovered.edits/12.seqid 2023-07-20 12:12:13,722 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f3af095cc065d1ed5327a1413ea53977 2023-07-20 12:12:13,722 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-20 12:12:13,724 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:12:13,728 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-20 12:12:13,730 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-20 12:12:13,731 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:12:13,731 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-20 12:12:13,731 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113314.f3af095cc065d1ed5327a1413ea53977.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689855133731"}]},"ts":"9223372036854775807"} 2023-07-20 12:12:13,737 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-20 12:12:13,737 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f3af095cc065d1ed5327a1413ea53977, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689855113314.f3af095cc065d1ed5327a1413ea53977.', STARTKEY => '', ENDKEY => ''}] 2023-07-20 12:12:13,737 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-20 12:12:13,737 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689855133737"}]},"ts":"9223372036854775807"} 2023-07-20 12:12:13,740 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-20 12:12:13,742 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:12:13,743 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 44 msec 2023-07-20 12:12:13,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-20 12:12:13,814 INFO [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-20 12:12:13,814 INFO [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 12:12:13,814 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 12:12:13,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 12:12:13,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-20 12:12:13,822 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689855133822"}]},"ts":"1689855133822"} 2023-07-20 12:12:13,833 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-20 12:12:13,835 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-20 12:12:13,836 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2a7f8945e8e71c5fda6e6687065958ee, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c06e9951077e3a3aad467134f69a717d, UNASSIGN}] 2023-07-20 12:12:13,838 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c06e9951077e3a3aad467134f69a717d, UNASSIGN 2023-07-20 12:12:13,841 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2a7f8945e8e71c5fda6e6687065958ee, UNASSIGN 2023-07-20 12:12:13,842 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=2a7f8945e8e71c5fda6e6687065958ee, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:13,842 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689855110659.2a7f8945e8e71c5fda6e6687065958ee.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689855133842"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689855133842"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689855133842"}]},"ts":"1689855133842"} 2023-07-20 12:12:13,841 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=c06e9951077e3a3aad467134f69a717d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:13,843 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689855110659.c06e9951077e3a3aad467134f69a717d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689855133839"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689855133839"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689855133839"}]},"ts":"1689855133839"} 2023-07-20 12:12:13,845 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 2a7f8945e8e71c5fda6e6687065958ee, server=jenkins-hbase4.apache.org,43611,1689855028889}] 2023-07-20 12:12:13,846 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure c06e9951077e3a3aad467134f69a717d, server=jenkins-hbase4.apache.org,39003,1689855028825}] 2023-07-20 12:12:13,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-20 12:12:14,002 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2a7f8945e8e71c5fda6e6687065958ee 2023-07-20 12:12:14,002 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c06e9951077e3a3aad467134f69a717d 2023-07-20 12:12:14,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2a7f8945e8e71c5fda6e6687065958ee, disabling compactions & flushes 2023-07-20 12:12:14,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c06e9951077e3a3aad467134f69a717d, disabling compactions & flushes 2023-07-20 12:12:14,002 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689855110659.c06e9951077e3a3aad467134f69a717d. 2023-07-20 12:12:14,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689855110659.c06e9951077e3a3aad467134f69a717d. 2023-07-20 12:12:14,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689855110659.c06e9951077e3a3aad467134f69a717d. after waiting 0 ms 2023-07-20 12:12:14,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689855110659.c06e9951077e3a3aad467134f69a717d. 2023-07-20 12:12:14,002 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689855110659.2a7f8945e8e71c5fda6e6687065958ee. 2023-07-20 12:12:14,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689855110659.2a7f8945e8e71c5fda6e6687065958ee. 2023-07-20 12:12:14,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689855110659.2a7f8945e8e71c5fda6e6687065958ee. after waiting 0 ms 2023-07-20 12:12:14,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689855110659.2a7f8945e8e71c5fda6e6687065958ee. 2023-07-20 12:12:14,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion/c06e9951077e3a3aad467134f69a717d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 12:12:14,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 12:12:14,024 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689855110659.c06e9951077e3a3aad467134f69a717d. 2023-07-20 12:12:14,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c06e9951077e3a3aad467134f69a717d: 2023-07-20 12:12:14,025 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithMergeRegion/2a7f8945e8e71c5fda6e6687065958ee/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 12:12:14,026 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 12:12:14,027 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c06e9951077e3a3aad467134f69a717d 2023-07-20 12:12:14,027 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689855110659.2a7f8945e8e71c5fda6e6687065958ee. 2023-07-20 12:12:14,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2a7f8945e8e71c5fda6e6687065958ee: 2023-07-20 12:12:14,028 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=c06e9951077e3a3aad467134f69a717d, regionState=CLOSED 2023-07-20 12:12:14,028 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689855110659.c06e9951077e3a3aad467134f69a717d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689855134027"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689855134027"}]},"ts":"1689855134027"} 2023-07-20 12:12:14,029 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2a7f8945e8e71c5fda6e6687065958ee 2023-07-20 12:12:14,029 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=2a7f8945e8e71c5fda6e6687065958ee, regionState=CLOSED 2023-07-20 12:12:14,030 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689855110659.2a7f8945e8e71c5fda6e6687065958ee.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689855134029"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689855134029"}]},"ts":"1689855134029"} 2023-07-20 12:12:14,032 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-20 12:12:14,032 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure c06e9951077e3a3aad467134f69a717d, server=jenkins-hbase4.apache.org,39003,1689855028825 in 184 msec 2023-07-20 12:12:14,033 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c06e9951077e3a3aad467134f69a717d, UNASSIGN in 196 msec 2023-07-20 12:12:14,034 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-20 12:12:14,034 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 2a7f8945e8e71c5fda6e6687065958ee, server=jenkins-hbase4.apache.org,43611,1689855028889 in 187 msec 2023-07-20 12:12:14,036 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-20 12:12:14,036 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2a7f8945e8e71c5fda6e6687065958ee, UNASSIGN in 198 msec 2023-07-20 12:12:14,036 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689855134036"}]},"ts":"1689855134036"} 2023-07-20 12:12:14,038 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-20 12:12:14,039 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-20 12:12:14,041 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 225 msec 2023-07-20 12:12:14,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-20 12:12:14,124 INFO [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-20 12:12:14,125 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 12:12:14,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 12:12:14,129 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 12:12:14,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 12:12:14,130 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 12:12:14,131 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43611] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 12:12:14,137 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2a7f8945e8e71c5fda6e6687065958ee 2023-07-20 12:12:14,137 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c06e9951077e3a3aad467134f69a717d 2023-07-20 12:12:14,139 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 12:12:14,139 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 12:12:14,139 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 12:12:14,139 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 12:12:14,139 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-20 12:12:14,139 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-20 12:12:14,141 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2a7f8945e8e71c5fda6e6687065958ee/cf, FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2a7f8945e8e71c5fda6e6687065958ee/recovered.edits] 2023-07-20 12:12:14,141 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c06e9951077e3a3aad467134f69a717d/cf, FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c06e9951077e3a3aad467134f69a717d/recovered.edits] 2023-07-20 12:12:14,142 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 12:12:14,142 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-20 12:12:14,142 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-20 12:12:14,142 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 12:12:14,142 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:12:14,142 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:12:14,142 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:12:14,142 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:12:14,142 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-20 12:12:14,142 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-20 12:12:14,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-20 12:12:14,147 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2a7f8945e8e71c5fda6e6687065958ee/cf/0a186cb3fc8a413a8e784dddf914439d to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/2a7f8945e8e71c5fda6e6687065958ee/cf/0a186cb3fc8a413a8e784dddf914439d 2023-07-20 12:12:14,148 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c06e9951077e3a3aad467134f69a717d/cf/798b9cd08a0c407e9ad0f97cebdc3966 to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/c06e9951077e3a3aad467134f69a717d/cf/798b9cd08a0c407e9ad0f97cebdc3966 2023-07-20 12:12:14,155 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2a7f8945e8e71c5fda6e6687065958ee/recovered.edits/9.seqid to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/2a7f8945e8e71c5fda6e6687065958ee/recovered.edits/9.seqid 2023-07-20 12:12:14,156 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2a7f8945e8e71c5fda6e6687065958ee 2023-07-20 12:12:14,156 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c06e9951077e3a3aad467134f69a717d/recovered.edits/9.seqid to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/c06e9951077e3a3aad467134f69a717d/recovered.edits/9.seqid 2023-07-20 12:12:14,157 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c06e9951077e3a3aad467134f69a717d 2023-07-20 12:12:14,157 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-20 12:12:14,157 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-20 12:12:14,158 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-20 12:12:14,163 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230720b0403b2135104ef3a72612400008b8b8 to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230720b0403b2135104ef3a72612400008b8b8 2023-07-20 12:12:14,165 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230720347fa2499b674667864c9659d3ac91bd to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230720347fa2499b674667864c9659d3ac91bd 2023-07-20 12:12:14,165 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-20 12:12:14,168 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 12:12:14,170 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-20 12:12:14,173 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-20 12:12:14,174 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 12:12:14,174 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-20 12:12:14,174 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689855110659.2a7f8945e8e71c5fda6e6687065958ee.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689855134174"}]},"ts":"9223372036854775807"} 2023-07-20 12:12:14,174 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689855110659.c06e9951077e3a3aad467134f69a717d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689855134174"}]},"ts":"9223372036854775807"} 2023-07-20 12:12:14,176 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-20 12:12:14,176 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2a7f8945e8e71c5fda6e6687065958ee, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689855110659.2a7f8945e8e71c5fda6e6687065958ee.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c06e9951077e3a3aad467134f69a717d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689855110659.c06e9951077e3a3aad467134f69a717d.', STARTKEY => '1', ENDKEY => ''}] 2023-07-20 12:12:14,176 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-20 12:12:14,176 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689855134176"}]},"ts":"9223372036854775807"} 2023-07-20 12:12:14,178 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-20 12:12:14,180 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 12:12:14,181 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 55 msec 2023-07-20 12:12:14,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-20 12:12:14,245 INFO [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-20 12:12:14,259 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-20 12:12:14,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:12:14,264 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-20 12:12:14,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 12:12:14,270 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-20 12:12:14,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 12:12:14,307 INFO [Listener at jenkins-hbase4.apache.org/34263] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=757 (was 746) Potentially hanging thread: Thread-4108 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1803374792_1 at /127.0.0.1:45008 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18f07d5b-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1891902696_17 at /127.0.0.1:50710 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18f07d5b-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1803374792_1 at /127.0.0.1:50684 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18f07d5b-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1891902696_17 at /127.0.0.1:45044 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18f07d5b-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1891902696_17 at /127.0.0.1:38566 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1753867629) connection to jenkins-hbase4.apache.org/172.31.14.131:42361 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x18f07d5b-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18f07d5b-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=904 (was 910), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=484 (was 361) - SystemLoadAverage LEAK? -, ProcessCount=190 (was 190), AvailableMemoryMB=2217 (was 2908) 2023-07-20 12:12:14,307 WARN [Listener at jenkins-hbase4.apache.org/34263] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-20 12:12:14,342 INFO [Listener at jenkins-hbase4.apache.org/34263] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=757, OpenFileDescriptor=904, MaxFileDescriptor=60000, SystemLoadAverage=484, ProcessCount=190, AvailableMemoryMB=2215 2023-07-20 12:12:14,342 WARN [Listener at jenkins-hbase4.apache.org/34263] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-20 12:12:14,344 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-20 12:12:14,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 12:12:14,348 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 12:12:14,349 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-20 12:12:14,349 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 12:12:14,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-20 12:12:14,356 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testEmptyExportFileSystemState/b83af764f940c552bf73f48a701e3f05 2023-07-20 12:12:14,356 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testEmptyExportFileSystemState/4b29d2d6d87999cd5bb22bfb5f131788 2023-07-20 12:12:14,357 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testEmptyExportFileSystemState/4b29d2d6d87999cd5bb22bfb5f131788 empty. 2023-07-20 12:12:14,357 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testEmptyExportFileSystemState/b83af764f940c552bf73f48a701e3f05 empty. 2023-07-20 12:12:14,358 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testEmptyExportFileSystemState/4b29d2d6d87999cd5bb22bfb5f131788 2023-07-20 12:12:14,358 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testEmptyExportFileSystemState/b83af764f940c552bf73f48a701e3f05 2023-07-20 12:12:14,358 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-20 12:12:14,389 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-20 12:12:14,391 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4b29d2d6d87999cd5bb22bfb5f131788, NAME => 'testtb-testEmptyExportFileSystemState,,1689855134344.4b29d2d6d87999cd5bb22bfb5f131788.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp 2023-07-20 12:12:14,393 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => b83af764f940c552bf73f48a701e3f05, NAME => 'testtb-testEmptyExportFileSystemState,1,1689855134344.b83af764f940c552bf73f48a701e3f05.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp 2023-07-20 12:12:14,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-20 12:12:14,469 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689855134344.b83af764f940c552bf73f48a701e3f05.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 12:12:14,469 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689855134344.4b29d2d6d87999cd5bb22bfb5f131788.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 12:12:14,469 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing b83af764f940c552bf73f48a701e3f05, disabling compactions & flushes 2023-07-20 12:12:14,469 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 4b29d2d6d87999cd5bb22bfb5f131788, disabling compactions & flushes 2023-07-20 12:12:14,469 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689855134344.b83af764f940c552bf73f48a701e3f05. 2023-07-20 12:12:14,469 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689855134344.4b29d2d6d87999cd5bb22bfb5f131788. 2023-07-20 12:12:14,469 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689855134344.4b29d2d6d87999cd5bb22bfb5f131788. 2023-07-20 12:12:14,469 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689855134344.b83af764f940c552bf73f48a701e3f05. 2023-07-20 12:12:14,469 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689855134344.4b29d2d6d87999cd5bb22bfb5f131788. after waiting 0 ms 2023-07-20 12:12:14,469 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689855134344.4b29d2d6d87999cd5bb22bfb5f131788. 2023-07-20 12:12:14,469 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689855134344.b83af764f940c552bf73f48a701e3f05. after waiting 0 ms 2023-07-20 12:12:14,469 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689855134344.4b29d2d6d87999cd5bb22bfb5f131788. 2023-07-20 12:12:14,470 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689855134344.b83af764f940c552bf73f48a701e3f05. 2023-07-20 12:12:14,470 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 4b29d2d6d87999cd5bb22bfb5f131788: 2023-07-20 12:12:14,470 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689855134344.b83af764f940c552bf73f48a701e3f05. 2023-07-20 12:12:14,470 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for b83af764f940c552bf73f48a701e3f05: 2023-07-20 12:12:14,472 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 12:12:14,473 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689855134344.4b29d2d6d87999cd5bb22bfb5f131788.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689855134473"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689855134473"}]},"ts":"1689855134473"} 2023-07-20 12:12:14,473 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689855134344.b83af764f940c552bf73f48a701e3f05.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689855134473"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689855134473"}]},"ts":"1689855134473"} 2023-07-20 12:12:14,479 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 12:12:14,480 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 12:12:14,480 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689855134480"}]},"ts":"1689855134480"} 2023-07-20 12:12:14,482 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-20 12:12:14,486 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 12:12:14,488 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 12:12:14,488 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 12:12:14,488 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 12:12:14,488 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 12:12:14,488 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4b29d2d6d87999cd5bb22bfb5f131788, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b83af764f940c552bf73f48a701e3f05, ASSIGN}] 2023-07-20 12:12:14,494 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4b29d2d6d87999cd5bb22bfb5f131788, ASSIGN 2023-07-20 12:12:14,494 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b83af764f940c552bf73f48a701e3f05, ASSIGN 2023-07-20 12:12:14,495 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4b29d2d6d87999cd5bb22bfb5f131788, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41865,1689855028765; forceNewPlan=false, retain=false 2023-07-20 12:12:14,495 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b83af764f940c552bf73f48a701e3f05, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43611,1689855028889; forceNewPlan=false, retain=false 2023-07-20 12:12:14,645 INFO [jenkins-hbase4:46247] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 12:12:14,649 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=4b29d2d6d87999cd5bb22bfb5f131788, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:14,649 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=b83af764f940c552bf73f48a701e3f05, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:14,649 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689855134344.4b29d2d6d87999cd5bb22bfb5f131788.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689855134649"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689855134649"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689855134649"}]},"ts":"1689855134649"} 2023-07-20 12:12:14,649 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689855134344.b83af764f940c552bf73f48a701e3f05.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689855134649"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689855134649"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689855134649"}]},"ts":"1689855134649"} 2023-07-20 12:12:14,651 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 4b29d2d6d87999cd5bb22bfb5f131788, server=jenkins-hbase4.apache.org,41865,1689855028765}] 2023-07-20 12:12:14,652 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure b83af764f940c552bf73f48a701e3f05, server=jenkins-hbase4.apache.org,43611,1689855028889}] 2023-07-20 12:12:14,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-20 12:12:14,810 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689855134344.4b29d2d6d87999cd5bb22bfb5f131788. 2023-07-20 12:12:14,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4b29d2d6d87999cd5bb22bfb5f131788, NAME => 'testtb-testEmptyExportFileSystemState,,1689855134344.4b29d2d6d87999cd5bb22bfb5f131788.', STARTKEY => '', ENDKEY => '1'} 2023-07-20 12:12:14,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689855134344.4b29d2d6d87999cd5bb22bfb5f131788. service=AccessControlService 2023-07-20 12:12:14,811 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 12:12:14,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 4b29d2d6d87999cd5bb22bfb5f131788 2023-07-20 12:12:14,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689855134344.4b29d2d6d87999cd5bb22bfb5f131788.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 12:12:14,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4b29d2d6d87999cd5bb22bfb5f131788 2023-07-20 12:12:14,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4b29d2d6d87999cd5bb22bfb5f131788 2023-07-20 12:12:14,810 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689855134344.b83af764f940c552bf73f48a701e3f05. 2023-07-20 12:12:14,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b83af764f940c552bf73f48a701e3f05, NAME => 'testtb-testEmptyExportFileSystemState,1,1689855134344.b83af764f940c552bf73f48a701e3f05.', STARTKEY => '1', ENDKEY => ''} 2023-07-20 12:12:14,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689855134344.b83af764f940c552bf73f48a701e3f05. service=AccessControlService 2023-07-20 12:12:14,812 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 12:12:14,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState b83af764f940c552bf73f48a701e3f05 2023-07-20 12:12:14,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689855134344.b83af764f940c552bf73f48a701e3f05.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 12:12:14,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b83af764f940c552bf73f48a701e3f05 2023-07-20 12:12:14,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b83af764f940c552bf73f48a701e3f05 2023-07-20 12:12:14,814 INFO [StoreOpener-4b29d2d6d87999cd5bb22bfb5f131788-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4b29d2d6d87999cd5bb22bfb5f131788 2023-07-20 12:12:14,814 INFO [StoreOpener-b83af764f940c552bf73f48a701e3f05-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b83af764f940c552bf73f48a701e3f05 2023-07-20 12:12:14,816 DEBUG [StoreOpener-4b29d2d6d87999cd5bb22bfb5f131788-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testEmptyExportFileSystemState/4b29d2d6d87999cd5bb22bfb5f131788/cf 2023-07-20 12:12:14,816 DEBUG [StoreOpener-4b29d2d6d87999cd5bb22bfb5f131788-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testEmptyExportFileSystemState/4b29d2d6d87999cd5bb22bfb5f131788/cf 2023-07-20 12:12:14,816 DEBUG [StoreOpener-b83af764f940c552bf73f48a701e3f05-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testEmptyExportFileSystemState/b83af764f940c552bf73f48a701e3f05/cf 2023-07-20 12:12:14,816 DEBUG [StoreOpener-b83af764f940c552bf73f48a701e3f05-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testEmptyExportFileSystemState/b83af764f940c552bf73f48a701e3f05/cf 2023-07-20 12:12:14,816 INFO [StoreOpener-4b29d2d6d87999cd5bb22bfb5f131788-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4b29d2d6d87999cd5bb22bfb5f131788 columnFamilyName cf 2023-07-20 12:12:14,817 INFO [StoreOpener-b83af764f940c552bf73f48a701e3f05-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b83af764f940c552bf73f48a701e3f05 columnFamilyName cf 2023-07-20 12:12:14,818 INFO [StoreOpener-4b29d2d6d87999cd5bb22bfb5f131788-1] regionserver.HStore(310): Store=4b29d2d6d87999cd5bb22bfb5f131788/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 12:12:14,819 INFO [StoreOpener-b83af764f940c552bf73f48a701e3f05-1] regionserver.HStore(310): Store=b83af764f940c552bf73f48a701e3f05/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 12:12:14,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testEmptyExportFileSystemState/b83af764f940c552bf73f48a701e3f05 2023-07-20 12:12:14,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testEmptyExportFileSystemState/4b29d2d6d87999cd5bb22bfb5f131788 2023-07-20 12:12:14,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testEmptyExportFileSystemState/b83af764f940c552bf73f48a701e3f05 2023-07-20 12:12:14,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testEmptyExportFileSystemState/4b29d2d6d87999cd5bb22bfb5f131788 2023-07-20 12:12:14,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4b29d2d6d87999cd5bb22bfb5f131788 2023-07-20 12:12:14,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b83af764f940c552bf73f48a701e3f05 2023-07-20 12:12:14,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testEmptyExportFileSystemState/4b29d2d6d87999cd5bb22bfb5f131788/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 12:12:14,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testEmptyExportFileSystemState/b83af764f940c552bf73f48a701e3f05/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 12:12:14,827 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4b29d2d6d87999cd5bb22bfb5f131788; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72858216, jitterRate=0.08567202091217041}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 12:12:14,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4b29d2d6d87999cd5bb22bfb5f131788: 2023-07-20 12:12:14,828 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689855134344.4b29d2d6d87999cd5bb22bfb5f131788., pid=93, masterSystemTime=1689855134803 2023-07-20 12:12:14,829 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b83af764f940c552bf73f48a701e3f05; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63450809, jitterRate=-0.05450926721096039}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 12:12:14,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b83af764f940c552bf73f48a701e3f05: 2023-07-20 12:12:14,830 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689855134344.b83af764f940c552bf73f48a701e3f05., pid=94, masterSystemTime=1689855134804 2023-07-20 12:12:14,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689855134344.4b29d2d6d87999cd5bb22bfb5f131788. 2023-07-20 12:12:14,831 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=4b29d2d6d87999cd5bb22bfb5f131788, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:14,831 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689855134344.4b29d2d6d87999cd5bb22bfb5f131788.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689855134831"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689855134831"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689855134831"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689855134831"}]},"ts":"1689855134831"} 2023-07-20 12:12:14,831 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689855134344.4b29d2d6d87999cd5bb22bfb5f131788. 2023-07-20 12:12:14,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689855134344.b83af764f940c552bf73f48a701e3f05. 2023-07-20 12:12:14,832 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689855134344.b83af764f940c552bf73f48a701e3f05. 2023-07-20 12:12:14,833 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=b83af764f940c552bf73f48a701e3f05, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:14,833 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689855134344.b83af764f940c552bf73f48a701e3f05.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689855134832"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689855134832"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689855134832"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689855134832"}]},"ts":"1689855134832"} 2023-07-20 12:12:14,835 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-20 12:12:14,835 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 4b29d2d6d87999cd5bb22bfb5f131788, server=jenkins-hbase4.apache.org,41865,1689855028765 in 182 msec 2023-07-20 12:12:14,836 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4b29d2d6d87999cd5bb22bfb5f131788, ASSIGN in 347 msec 2023-07-20 12:12:14,836 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-20 12:12:14,836 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure b83af764f940c552bf73f48a701e3f05, server=jenkins-hbase4.apache.org,43611,1689855028889 in 182 msec 2023-07-20 12:12:14,838 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-20 12:12:14,838 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b83af764f940c552bf73f48a701e3f05, ASSIGN in 348 msec 2023-07-20 12:12:14,839 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 12:12:14,839 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689855134839"}]},"ts":"1689855134839"} 2023-07-20 12:12:14,840 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-20 12:12:14,842 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 12:12:14,843 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-20 12:12:14,844 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43611] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-20 12:12:14,850 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:12:14,850 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:12:14,850 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:12:14,850 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:12:14,851 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 12:12:14,851 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 12:12:14,852 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 12:12:14,852 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 12:12:14,853 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 507 msec 2023-07-20 12:12:14,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-20 12:12:14,962 INFO [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-20 12:12:14,969 DEBUG [Listener at jenkins-hbase4.apache.org/34263] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-20 12:12:14,969 DEBUG [Listener at jenkins-hbase4.apache.org/34263] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689855134344.4b29d2d6d87999cd5bb22bfb5f131788. 2023-07-20 12:12:14,972 INFO [Listener at jenkins-hbase4.apache.org/34263] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 12:12:15,005 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 12:12:15,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689855135005 (current time:1689855135005). 2023-07-20 12:12:15,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 12:12:15,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(139): Connect 0x7a897edf to 127.0.0.1:59849 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 12:12:15,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64393598, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 12:12:15,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:12:15,061 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58916, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:12:15,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a897edf to 127.0.0.1:59849 2023-07-20 12:12:15,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 12:12:15,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(139): Connect 0x64f5999a to 127.0.0.1:59849 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 12:12:15,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@55bb6c5d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 12:12:15,138 DEBUG [hconnection-0x78030687-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:12:15,143 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58932, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:12:15,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:12:15,149 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42400, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:12:15,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x64f5999a to 127.0.0.1:59849 2023-07-20 12:12:15,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 12:12:15,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-20 12:12:15,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 12:12:15,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 12:12:15,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-20 12:12:15,156 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-20 12:12:15,157 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689855735157 2023-07-20 12:12:15,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 12:12:15,157 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-20 12:12:15,158 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 12:12:15,158 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 12:12:15,168 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-20 12:12:15,170 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-20 12:12:15,171 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 17 msec 2023-07-20 12:12:15,177 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-20 12:12:15,178 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689855735178 2023-07-20 12:12:15,194 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,194 INFO [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-20 12:12:15,194 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:12:15,196 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-20 12:12:15,196 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-20 12:12:15,197 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,197 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,258 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 12:12:15,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 12:12:15,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 12:12:15,260 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 12:12:15,292 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:12:15,292 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:12:15,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:12:15,292 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:12:15,292 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:15,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:12:15,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:12:15,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:12:15,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:12:15,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:12:15,293 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:15,293 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:15,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,294 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:15,294 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 12:12:15,294 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,294 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,294 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-20 12:12:15,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-20 12:12:15,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,295 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-20 12:12:15,295 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-20 12:12:15,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-20 12:12:15,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,296 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-20 12:12:15,296 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,296 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-20 12:12:15,296 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:12:15,300 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,300 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-20 12:12:15,300 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:12:15,313 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,313 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-20 12:12:15,313 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:12:15,316 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-20 12:12:15,316 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-20 12:12:15,316 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-20 12:12:15,316 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43611,1689855028889' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-20 12:12:15,316 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-20 12:12:15,316 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41865,1689855028765' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-20 12:12:15,316 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-20 12:12:15,316 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-20 12:12:15,316 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39003,1689855028825' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-20 12:12:15,330 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:15,330 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:15,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:12:15,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:12:15,392 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,392 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:15,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:12:15,392 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,392 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,393 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 12:12:15,393 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,393 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 12:12:15,393 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:12:15,393 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 12:12:15,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:15,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:15,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:15,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:12:15,395 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43611,1689855028889' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-20 12:12:15,395 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f11a960[Count = 1] remaining members to acquire global barrier 2023-07-20 12:12:15,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:15,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:12:15,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:12:15,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:12:15,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:12:15,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:15,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:15,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:15,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:12:15,397 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41865,1689855028765' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-20 12:12:15,397 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f11a960[Count = 0] remaining members to acquire global barrier 2023-07-20 12:12:15,398 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-20 12:12:15,398 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,423 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,424 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-20 12:12:15,424 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,424 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-20 12:12:15,424 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-20 12:12:15,424 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39003,1689855028825' in zk 2023-07-20 12:12:15,425 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:15,426 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:15,426 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 12:12:15,426 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 12:12:15,426 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 12:12:15,426 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689855134344.b83af764f940c552bf73f48a701e3f05. 2023-07-20 12:12:15,426 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689855134344.b83af764f940c552bf73f48a701e3f05. started... 2023-07-20 12:12:15,429 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b83af764f940c552bf73f48a701e3f05: 2023-07-20 12:12:15,429 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689855134344.b83af764f940c552bf73f48a701e3f05.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,429 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 12:12:15,429 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 12:12:15,430 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,430 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-20 12:12:15,431 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 12:12:15,431 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 12:12:15,431 DEBUG [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689855134344.4b29d2d6d87999cd5bb22bfb5f131788. 2023-07-20 12:12:15,431 DEBUG [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689855134344.4b29d2d6d87999cd5bb22bfb5f131788. started... 2023-07-20 12:12:15,431 DEBUG [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4b29d2d6d87999cd5bb22bfb5f131788: 2023-07-20 12:12:15,431 DEBUG [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689855134344.4b29d2d6d87999cd5bb22bfb5f131788.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,432 DEBUG [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 12:12:15,432 DEBUG [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 12:12:15,453 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-20 12:12:15,453 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:12:15,453 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-20 12:12:15,467 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 12:12:15,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 12:12:15,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 12:12:15,471 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 12:12:15,472 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689855134344.b83af764f940c552bf73f48a701e3f05. completed. 2023-07-20 12:12:15,472 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689855134344.b83af764f940c552bf73f48a701e3f05. 2023-07-20 12:12:15,473 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 12:12:15,473 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 12:12:15,473 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:15,473 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-20 12:12:15,473 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43611,1689855028889' in zk 2023-07-20 12:12:15,474 DEBUG [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689855134344.4b29d2d6d87999cd5bb22bfb5f131788. completed. 2023-07-20 12:12:15,474 DEBUG [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689855134344.4b29d2d6d87999cd5bb22bfb5f131788. 2023-07-20 12:12:15,474 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 12:12:15,474 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 12:12:15,474 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:15,474 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-20 12:12:15,474 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41865,1689855028765' in zk 2023-07-20 12:12:15,553 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-20 12:12:15,553 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:15,553 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:12:15,554 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-20 12:12:15,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:15,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:12:15,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:12:15,630 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-20 12:12:15,630 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:12:15,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:12:15,630 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:15,630 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-20 12:12:15,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:12:15,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:15,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:15,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:15,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:12:15,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:15,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:15,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:15,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43611,1689855028889': 2023-07-20 12:12:15,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43611,1689855028889' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-20 12:12:15,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:15,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:12:15,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:12:15,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:12:15,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:12:15,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:15,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:15,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:15,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:12:15,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:15,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:15,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:15,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,41865,1689855028765': 2023-07-20 12:12:15,644 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41865,1689855028765' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-20 12:12:15,644 INFO [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-20 12:12:15,644 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 12:12:15,644 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 12:12:15,644 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,644 INFO [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 12:12:15,669 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,669 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,669 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,669 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,669 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:12:15,669 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:12:15,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,669 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:12:15,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:12:15,670 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:15,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:12:15,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:12:15,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:12:15,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:12:15,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:12:15,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:12:15,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:12:15,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,670 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:15,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:12:15,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,671 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:15,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:12:15,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:15,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:15,673 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:15,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:15,673 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:15,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:12:15,673 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:15,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:15,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:15,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:15,699 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:12:15,699 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:12:15,700 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:15,700 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:12:15,700 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:12:15,700 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:12:15,700 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:12:15,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:12:15,700 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:12:15,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:12:15,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:12:15,700 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,702 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-20 12:12:15,702 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,702 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 12:12:15,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:12:15,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:12:15,700 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:15,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:12:15,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:12:15,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:12:15,700 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:12:15,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:12:15,702 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:15,703 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,703 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:15,703 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-20 12:12:15,703 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,703 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:15,703 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:15,703 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,703 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:12:15,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:12:15,710 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,740 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,771 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 12:12:15,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 12:12:15,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 12:12:15,773 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-20 12:12:15,775 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-20 12:12:15,775 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,776 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:15,776 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689855135157Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689855135710 (+553 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689855135710Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689855135711 (+1 ms)Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689855135719 (+8 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689855135734 (+15 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689855135775 (+41 ms) 2023-07-20 12:12:15,779 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-20 12:12:15,780 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 619 msec 2023-07-20 12:12:16,273 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 12:12:16,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 12:12:16,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 12:12:16,277 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41865] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689855134344.4b29d2d6d87999cd5bb22bfb5f131788. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 12:12:16,278 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43611] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689855134344.b83af764f940c552bf73f48a701e3f05. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 12:12:16,282 DEBUG [Listener at jenkins-hbase4.apache.org/34263] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-20 12:12:16,282 DEBUG [Listener at jenkins-hbase4.apache.org/34263] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689855134344.4b29d2d6d87999cd5bb22bfb5f131788. 2023-07-20 12:12:16,282 INFO [Listener at jenkins-hbase4.apache.org/34263] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 12:12:16,298 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 12:12:16,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689855136298 (current time:1689855136298). 2023-07-20 12:12:16,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 12:12:16,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(139): Connect 0x19966f53 to 127.0.0.1:59849 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 12:12:16,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79c165d8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 12:12:16,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:12:16,340 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58942, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:12:16,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x19966f53 to 127.0.0.1:59849 2023-07-20 12:12:16,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 12:12:16,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(139): Connect 0x3aaa8598 to 127.0.0.1:59849 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 12:12:16,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10ec9969, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 12:12:16,364 DEBUG [hconnection-0x6271c109-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:12:16,365 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58946, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:12:16,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:12:16,380 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42408, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:12:16,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3aaa8598 to 127.0.0.1:59849 2023-07-20 12:12:16,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 12:12:16,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-20 12:12:16,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 12:12:16,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 12:12:16,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-20 12:12:16,391 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-20 12:12:16,392 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689855736392 2023-07-20 12:12:16,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 12:12:16,392 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-20 12:12:16,394 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 12:12:16,394 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 12:12:16,400 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-20 12:12:16,401 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-20 12:12:16,402 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 15 msec 2023-07-20 12:12:16,404 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-20 12:12:16,405 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689855736405 2023-07-20 12:12:16,418 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,418 INFO [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-20 12:12:16,418 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:12:16,420 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-20 12:12:16,420 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-20 12:12:16,484 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,487 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,488 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:12:16,488 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:12:16,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:12:16,488 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:12:16,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:12:16,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:12:16,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:12:16,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:12:16,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:12:16,489 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:16,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,490 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,490 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,490 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-20 12:12:16,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,491 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-20 12:12:16,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-20 12:12:16,492 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:16,492 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:16,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,492 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-20 12:12:16,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-20 12:12:16,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,492 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-20 12:12:16,492 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,493 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-20 12:12:16,493 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:12:16,495 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-20 12:12:16,495 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-20 12:12:16,495 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41865,1689855028765' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-20 12:12:16,501 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,501 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 12:12:16,501 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-20 12:12:16,501 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:12:16,503 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,503 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-20 12:12:16,503 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:12:16,504 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:16,504 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 12:12:16,504 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-20 12:12:16,504 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-20 12:12:16,504 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43611,1689855028889' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-20 12:12:16,509 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-20 12:12:16,509 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-20 12:12:16,509 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39003,1689855028825' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-20 12:12:16,512 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:16,512 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:16,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:12:16,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:12:16,513 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:12:16,513 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:16,513 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,513 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 12:12:16,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 12:12:16,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 12:12:16,514 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,514 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 12:12:16,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:12:16,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:16,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:16,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:16,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:12:16,517 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41865,1689855028765' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-20 12:12:16,517 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ecb7e5[Count = 1] remaining members to acquire global barrier 2023-07-20 12:12:16,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:16,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:12:16,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:12:16,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:12:16,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:12:16,518 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,518 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 12:12:16,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:16,519 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,519 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 12:12:16,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:16,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:16,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:12:16,521 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43611,1689855028889' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-20 12:12:16,521 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ecb7e5[Count = 0] remaining members to acquire global barrier 2023-07-20 12:12:16,521 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-20 12:12:16,521 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,526 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,526 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,526 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,526 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-20 12:12:16,526 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-20 12:12:16,527 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-20 12:12:16,527 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39003,1689855028825' in zk 2023-07-20 12:12:16,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,527 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-20 12:12:16,527 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:16,527 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:16,527 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 12:12:16,530 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 12:12:16,531 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 12:12:16,531 DEBUG [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689855134344.4b29d2d6d87999cd5bb22bfb5f131788. 2023-07-20 12:12:16,531 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689855134344.b83af764f940c552bf73f48a701e3f05. 2023-07-20 12:12:16,531 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689855134344.b83af764f940c552bf73f48a701e3f05. started... 2023-07-20 12:12:16,531 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-20 12:12:16,531 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:12:16,531 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-20 12:12:16,531 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 12:12:16,534 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 12:12:16,533 DEBUG [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689855134344.4b29d2d6d87999cd5bb22bfb5f131788. started... 2023-07-20 12:12:16,531 INFO [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b83af764f940c552bf73f48a701e3f05 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-20 12:12:16,534 INFO [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4b29d2d6d87999cd5bb22bfb5f131788 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-20 12:12:16,677 INFO [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230720d4af97745ee24e5babd8035813520fd1 to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230720d4af97745ee24e5babd8035813520fd1 2023-07-20 12:12:16,716 INFO [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230720d1246e8fda2c4a08aa3e3b5b2969fa07 to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230720d1246e8fda2c4a08aa3e3b5b2969fa07 2023-07-20 12:12:16,719 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 12:12:16,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 12:12:16,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 12:12:16,720 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 12:12:16,739 INFO [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testEmptyExportFileSystemState/4b29d2d6d87999cd5bb22bfb5f131788/.tmp/cf/881ed22251254c868d080abc71f27b39 2023-07-20 12:12:16,754 DEBUG [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testEmptyExportFileSystemState/4b29d2d6d87999cd5bb22bfb5f131788/.tmp/cf/881ed22251254c868d080abc71f27b39 as hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testEmptyExportFileSystemState/4b29d2d6d87999cd5bb22bfb5f131788/cf/881ed22251254c868d080abc71f27b39 2023-07-20 12:12:16,754 INFO [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testEmptyExportFileSystemState/b83af764f940c552bf73f48a701e3f05/.tmp/cf/22f85220769f49d986abafbe2d56838c 2023-07-20 12:12:16,760 INFO [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testEmptyExportFileSystemState/4b29d2d6d87999cd5bb22bfb5f131788/cf/881ed22251254c868d080abc71f27b39, entries=4, sequenceid=6, filesize=5.6 K 2023-07-20 12:12:16,761 INFO [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 4b29d2d6d87999cd5bb22bfb5f131788 in 227ms, sequenceid=6, compaction requested=false 2023-07-20 12:12:16,762 DEBUG [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-20 12:12:16,763 DEBUG [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4b29d2d6d87999cd5bb22bfb5f131788: 2023-07-20 12:12:16,763 DEBUG [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689855134344.4b29d2d6d87999cd5bb22bfb5f131788.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,763 DEBUG [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 12:12:16,763 DEBUG [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testEmptyExportFileSystemState/4b29d2d6d87999cd5bb22bfb5f131788/cf/881ed22251254c868d080abc71f27b39] hfiles 2023-07-20 12:12:16,763 DEBUG [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testEmptyExportFileSystemState/4b29d2d6d87999cd5bb22bfb5f131788/cf/881ed22251254c868d080abc71f27b39 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,766 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testEmptyExportFileSystemState/b83af764f940c552bf73f48a701e3f05/.tmp/cf/22f85220769f49d986abafbe2d56838c as hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testEmptyExportFileSystemState/b83af764f940c552bf73f48a701e3f05/cf/22f85220769f49d986abafbe2d56838c 2023-07-20 12:12:16,778 INFO [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testEmptyExportFileSystemState/b83af764f940c552bf73f48a701e3f05/cf/22f85220769f49d986abafbe2d56838c, entries=46, sequenceid=6, filesize=12.9 K 2023-07-20 12:12:16,779 INFO [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for b83af764f940c552bf73f48a701e3f05 in 248ms, sequenceid=6, compaction requested=false 2023-07-20 12:12:16,781 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b83af764f940c552bf73f48a701e3f05: 2023-07-20 12:12:16,782 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689855134344.b83af764f940c552bf73f48a701e3f05.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,782 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 12:12:16,782 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testEmptyExportFileSystemState/b83af764f940c552bf73f48a701e3f05/cf/22f85220769f49d986abafbe2d56838c] hfiles 2023-07-20 12:12:16,782 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testEmptyExportFileSystemState/b83af764f940c552bf73f48a701e3f05/cf/22f85220769f49d986abafbe2d56838c for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,840 DEBUG [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689855134344.4b29d2d6d87999cd5bb22bfb5f131788. completed. 2023-07-20 12:12:16,841 DEBUG [rs(jenkins-hbase4.apache.org,41865,1689855028765)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689855134344.4b29d2d6d87999cd5bb22bfb5f131788. 2023-07-20 12:12:16,841 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 12:12:16,841 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 12:12:16,841 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:16,841 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-20 12:12:16,841 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41865,1689855028765' in zk 2023-07-20 12:12:16,843 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:16,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:16,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:12:16,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:12:16,843 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-20 12:12:16,843 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:12:16,843 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-20 12:12:16,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:12:16,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:12:16,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:16,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:16,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:16,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:12:16,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:16,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:16,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,41865,1689855028765': 2023-07-20 12:12:16,852 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41865,1689855028765' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-20 12:12:16,860 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689855134344.b83af764f940c552bf73f48a701e3f05. completed. 2023-07-20 12:12:16,860 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689855134344.b83af764f940c552bf73f48a701e3f05. 2023-07-20 12:12:16,860 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 12:12:16,860 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 12:12:16,860 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:16,860 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-20 12:12:16,860 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43611,1689855028889' in zk 2023-07-20 12:12:16,862 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:16,862 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-20 12:12:16,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:16,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:12:16,862 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:12:16,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:12:16,862 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-20 12:12:16,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:12:16,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:12:16,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:16,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:16,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:16,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:12:16,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:16,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:16,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:16,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43611,1689855028889': 2023-07-20 12:12:16,871 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43611,1689855028889' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-20 12:12:16,871 INFO [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-20 12:12:16,871 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 12:12:16,871 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 12:12:16,871 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,871 INFO [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 12:12:16,873 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,873 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:12:16,873 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,873 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,873 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:12:16,873 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:12:16,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,873 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,873 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:16,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:12:16,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:12:16,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:12:16,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:12:16,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:12:16,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:12:16,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:12:16,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:12:16,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:12:16,874 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:16,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,874 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:16,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:12:16,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:16,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:16,877 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:16,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:16,878 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:16,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:12:16,878 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:16,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:16,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:16,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:16,883 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:12:16,883 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:12:16,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:12:16,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:12:16,883 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:12:16,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:12:16,883 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:12:16,883 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:12:16,883 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:16,883 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,883 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:16,884 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:16,884 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,884 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:16,884 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,884 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:16,884 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:16,884 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,884 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:12:16,883 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,884 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-20 12:12:16,883 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:12:16,884 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,883 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:12:16,884 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 12:12:16,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:12:16,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:12:16,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:12:16,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:12:16,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:12:16,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:12:16,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230720d1246e8fda2c4a08aa3e3b5b2969fa07, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230720d4af97745ee24e5babd8035813520fd1] mob files 2023-07-20 12:12:16,887 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230720d1246e8fda2c4a08aa3e3b5b2969fa07 2023-07-20 12:12:16,887 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230720d4af97745ee24e5babd8035813520fd1 2023-07-20 12:12:16,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:12:16,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:12:16,902 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,903 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,950 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,985 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-20 12:12:16,986 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,986 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:16,986 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689855136392Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689855136902 (+510 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689855136902Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689855136902Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689855136907 (+5 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689855136925 (+18 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689855136985 (+60 ms) 2023-07-20 12:12:16,990 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-20 12:12:16,993 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 596 msec 2023-07-20 12:12:17,020 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 12:12:17,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 12:12:17,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 12:12:17,023 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855137023 2023-07-20 12:12:17,024 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37499, tgtDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855137023, rawTgtDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855137023, srcFsUri=hdfs://localhost:37499, srcDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc 2023-07-20 12:12:17,055 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37499, inputRoot=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc 2023-07-20 12:12:17,055 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_582523281_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855137023, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855137023/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:17,055 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37499, inputRoot=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc, snapshotDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-20 12:12:17,063 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855137023/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:17,185 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 12:12:17,186 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 12:12:17,186 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 12:12:17,187 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 12:12:18,316 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/hadoop-123881614504575002.jar 2023-07-20 12:12:18,317 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 12:12:18,317 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 12:12:18,382 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689855037970_0005_000001 (auth:SIMPLE) 2023-07-20 12:12:18,416 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/hadoop-8062321402619451929.jar 2023-07-20 12:12:18,417 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 12:12:18,418 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 12:12:18,418 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 12:12:18,419 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 12:12:18,419 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 12:12:18,419 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 12:12:18,420 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 12:12:18,420 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 12:12:18,420 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 12:12:18,421 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 12:12:18,421 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 12:12:18,422 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 12:12:18,422 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 12:12:18,422 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 12:12:18,423 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 12:12:18,423 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 12:12:18,424 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 12:12:18,425 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 12:12:18,426 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 12:12:18,426 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 12:12:18,427 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 12:12:18,427 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 12:12:18,428 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 12:12:19,215 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 12:12:19,565 WARN [Listener at jenkins-hbase4.apache.org/34263] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 12:12:19,570 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-20 12:12:19,812 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 12:12:19,813 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 12:12:20,200 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689855037970_0006_000001 (auth:SIMPLE) 2023-07-20 12:12:27,198 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689855037970_0006_000001 (auth:SIMPLE) 2023-07-20 12:12:29,970 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 12:12:29,971 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 12:12:29,977 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:29,978 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 12:12:29,978 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 12:12:29,978 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1891902696_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:29,979 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(367): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-20 12:12:29,979 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(367): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-20 12:12:29,979 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1891902696_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855137023/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855137023/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:29,979 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(367): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855137023/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-20 12:12:29,979 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(367): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855137023/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-20 12:12:29,985 INFO [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-20 12:12:29,985 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-20 12:12:29,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 12:12:29,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-20 12:12:29,990 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689855149990"}]},"ts":"1689855149990"} 2023-07-20 12:12:29,992 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-20 12:12:29,993 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-20 12:12:29,994 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4b29d2d6d87999cd5bb22bfb5f131788, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b83af764f940c552bf73f48a701e3f05, UNASSIGN}] 2023-07-20 12:12:29,996 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4b29d2d6d87999cd5bb22bfb5f131788, UNASSIGN 2023-07-20 12:12:29,997 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b83af764f940c552bf73f48a701e3f05, UNASSIGN 2023-07-20 12:12:29,997 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=4b29d2d6d87999cd5bb22bfb5f131788, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:29,997 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=b83af764f940c552bf73f48a701e3f05, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:29,997 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689855134344.4b29d2d6d87999cd5bb22bfb5f131788.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689855149997"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689855149997"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689855149997"}]},"ts":"1689855149997"} 2023-07-20 12:12:29,998 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689855134344.b83af764f940c552bf73f48a701e3f05.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689855149997"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689855149997"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689855149997"}]},"ts":"1689855149997"} 2023-07-20 12:12:29,999 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 4b29d2d6d87999cd5bb22bfb5f131788, server=jenkins-hbase4.apache.org,41865,1689855028765}] 2023-07-20 12:12:30,000 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure b83af764f940c552bf73f48a701e3f05, server=jenkins-hbase4.apache.org,43611,1689855028889}] 2023-07-20 12:12:30,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-20 12:12:30,150 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4b29d2d6d87999cd5bb22bfb5f131788 2023-07-20 12:12:30,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4b29d2d6d87999cd5bb22bfb5f131788, disabling compactions & flushes 2023-07-20 12:12:30,151 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689855134344.4b29d2d6d87999cd5bb22bfb5f131788. 2023-07-20 12:12:30,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689855134344.4b29d2d6d87999cd5bb22bfb5f131788. 2023-07-20 12:12:30,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689855134344.4b29d2d6d87999cd5bb22bfb5f131788. after waiting 0 ms 2023-07-20 12:12:30,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689855134344.4b29d2d6d87999cd5bb22bfb5f131788. 2023-07-20 12:12:30,157 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b83af764f940c552bf73f48a701e3f05 2023-07-20 12:12:30,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b83af764f940c552bf73f48a701e3f05, disabling compactions & flushes 2023-07-20 12:12:30,157 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689855134344.b83af764f940c552bf73f48a701e3f05. 2023-07-20 12:12:30,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689855134344.b83af764f940c552bf73f48a701e3f05. 2023-07-20 12:12:30,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689855134344.b83af764f940c552bf73f48a701e3f05. after waiting 0 ms 2023-07-20 12:12:30,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689855134344.b83af764f940c552bf73f48a701e3f05. 2023-07-20 12:12:30,180 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testEmptyExportFileSystemState/4b29d2d6d87999cd5bb22bfb5f131788/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 12:12:30,182 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 12:12:30,184 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689855134344.4b29d2d6d87999cd5bb22bfb5f131788. 2023-07-20 12:12:30,184 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4b29d2d6d87999cd5bb22bfb5f131788: 2023-07-20 12:12:30,185 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testEmptyExportFileSystemState/b83af764f940c552bf73f48a701e3f05/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 12:12:30,186 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4b29d2d6d87999cd5bb22bfb5f131788 2023-07-20 12:12:30,186 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 12:12:30,187 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689855134344.b83af764f940c552bf73f48a701e3f05. 2023-07-20 12:12:30,187 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b83af764f940c552bf73f48a701e3f05: 2023-07-20 12:12:30,188 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=4b29d2d6d87999cd5bb22bfb5f131788, regionState=CLOSED 2023-07-20 12:12:30,188 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689855134344.4b29d2d6d87999cd5bb22bfb5f131788.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689855150188"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689855150188"}]},"ts":"1689855150188"} 2023-07-20 12:12:30,194 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b83af764f940c552bf73f48a701e3f05 2023-07-20 12:12:30,194 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=b83af764f940c552bf73f48a701e3f05, regionState=CLOSED 2023-07-20 12:12:30,194 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689855134344.b83af764f940c552bf73f48a701e3f05.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689855150194"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689855150194"}]},"ts":"1689855150194"} 2023-07-20 12:12:30,195 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-20 12:12:30,195 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 4b29d2d6d87999cd5bb22bfb5f131788, server=jenkins-hbase4.apache.org,41865,1689855028765 in 190 msec 2023-07-20 12:12:30,196 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4b29d2d6d87999cd5bb22bfb5f131788, UNASSIGN in 201 msec 2023-07-20 12:12:30,198 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-20 12:12:30,198 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure b83af764f940c552bf73f48a701e3f05, server=jenkins-hbase4.apache.org,43611,1689855028889 in 196 msec 2023-07-20 12:12:30,200 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-20 12:12:30,200 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b83af764f940c552bf73f48a701e3f05, UNASSIGN in 204 msec 2023-07-20 12:12:30,200 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689855150200"}]},"ts":"1689855150200"} 2023-07-20 12:12:30,202 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-20 12:12:30,205 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-20 12:12:30,208 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 221 msec 2023-07-20 12:12:30,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-20 12:12:30,293 INFO [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-20 12:12:30,293 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-20 12:12:30,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 12:12:30,297 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 12:12:30,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-20 12:12:30,298 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 12:12:30,300 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43611] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-20 12:12:30,303 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 12:12:30,303 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 12:12:30,303 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 12:12:30,303 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 12:12:30,303 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-20 12:12:30,303 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-20 12:12:30,303 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testEmptyExportFileSystemState/4b29d2d6d87999cd5bb22bfb5f131788 2023-07-20 12:12:30,303 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-20 12:12:30,303 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testEmptyExportFileSystemState/b83af764f940c552bf73f48a701e3f05 2023-07-20 12:12:30,304 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 12:12:30,304 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 12:12:30,304 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:12:30,304 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:12:30,304 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 12:12:30,304 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:12:30,304 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-20 12:12:30,305 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-20 12:12:30,305 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:12:30,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-20 12:12:30,306 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testEmptyExportFileSystemState/b83af764f940c552bf73f48a701e3f05/cf, FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testEmptyExportFileSystemState/b83af764f940c552bf73f48a701e3f05/recovered.edits] 2023-07-20 12:12:30,306 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testEmptyExportFileSystemState/4b29d2d6d87999cd5bb22bfb5f131788/cf, FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testEmptyExportFileSystemState/4b29d2d6d87999cd5bb22bfb5f131788/recovered.edits] 2023-07-20 12:12:30,311 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testEmptyExportFileSystemState/b83af764f940c552bf73f48a701e3f05/cf/22f85220769f49d986abafbe2d56838c to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testEmptyExportFileSystemState/b83af764f940c552bf73f48a701e3f05/cf/22f85220769f49d986abafbe2d56838c 2023-07-20 12:12:30,313 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testEmptyExportFileSystemState/4b29d2d6d87999cd5bb22bfb5f131788/cf/881ed22251254c868d080abc71f27b39 to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testEmptyExportFileSystemState/4b29d2d6d87999cd5bb22bfb5f131788/cf/881ed22251254c868d080abc71f27b39 2023-07-20 12:12:30,315 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testEmptyExportFileSystemState/b83af764f940c552bf73f48a701e3f05/recovered.edits/9.seqid to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testEmptyExportFileSystemState/b83af764f940c552bf73f48a701e3f05/recovered.edits/9.seqid 2023-07-20 12:12:30,320 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testEmptyExportFileSystemState/b83af764f940c552bf73f48a701e3f05 2023-07-20 12:12:30,322 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testEmptyExportFileSystemState/4b29d2d6d87999cd5bb22bfb5f131788/recovered.edits/9.seqid to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testEmptyExportFileSystemState/4b29d2d6d87999cd5bb22bfb5f131788/recovered.edits/9.seqid 2023-07-20 12:12:30,322 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testEmptyExportFileSystemState/4b29d2d6d87999cd5bb22bfb5f131788 2023-07-20 12:12:30,323 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-20 12:12:30,323 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-20 12:12:30,324 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-20 12:12:30,328 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230720d1246e8fda2c4a08aa3e3b5b2969fa07 to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230720d1246e8fda2c4a08aa3e3b5b2969fa07 2023-07-20 12:12:30,330 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230720d4af97745ee24e5babd8035813520fd1 to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230720d4af97745ee24e5babd8035813520fd1 2023-07-20 12:12:30,330 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-20 12:12:30,333 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 12:12:30,336 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-20 12:12:30,338 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-20 12:12:30,340 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 12:12:30,340 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-20 12:12:30,340 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689855134344.4b29d2d6d87999cd5bb22bfb5f131788.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689855150340"}]},"ts":"9223372036854775807"} 2023-07-20 12:12:30,340 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689855134344.b83af764f940c552bf73f48a701e3f05.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689855150340"}]},"ts":"9223372036854775807"} 2023-07-20 12:12:30,344 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-20 12:12:30,344 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4b29d2d6d87999cd5bb22bfb5f131788, NAME => 'testtb-testEmptyExportFileSystemState,,1689855134344.4b29d2d6d87999cd5bb22bfb5f131788.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b83af764f940c552bf73f48a701e3f05, NAME => 'testtb-testEmptyExportFileSystemState,1,1689855134344.b83af764f940c552bf73f48a701e3f05.', STARTKEY => '1', ENDKEY => ''}] 2023-07-20 12:12:30,344 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-20 12:12:30,344 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689855150344"}]},"ts":"9223372036854775807"} 2023-07-20 12:12:30,348 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-20 12:12:30,355 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 12:12:30,357 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 61 msec 2023-07-20 12:12:30,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-20 12:12:30,407 INFO [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-20 12:12:30,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-20 12:12:30,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:30,419 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-20 12:12:30,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-20 12:12:30,450 INFO [Listener at jenkins-hbase4.apache.org/34263] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=759 (was 757) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1891902696_17 at /127.0.0.1:44886 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18f07d5b-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1891902696_17 at /127.0.0.1:60568 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1753867629) connection to jenkins-hbase4.apache.org/172.31.14.131:45729 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x18f07d5b-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1753867629) connection to jenkins-hbase4.apache.org/172.31.14.131:34263 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1891902696_17 at /127.0.0.1:43580 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4798 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x18f07d5b-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-957901134_1 at /127.0.0.1:60550 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18f07d5b-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=906 (was 904) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=624 (was 484) - SystemLoadAverage LEAK? -, ProcessCount=189 (was 190), AvailableMemoryMB=1478 (was 2215) 2023-07-20 12:12:30,451 WARN [Listener at jenkins-hbase4.apache.org/34263] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-20 12:12:30,481 INFO [Listener at jenkins-hbase4.apache.org/34263] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=759, OpenFileDescriptor=906, MaxFileDescriptor=60000, SystemLoadAverage=624, ProcessCount=189, AvailableMemoryMB=1478 2023-07-20 12:12:30,481 WARN [Listener at jenkins-hbase4.apache.org/34263] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-20 12:12:30,483 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-20 12:12:30,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:30,489 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 12:12:30,490 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-20 12:12:30,491 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 12:12:30,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-20 12:12:30,494 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3fcc8ec58e879406b6bf52ca3120691 2023-07-20 12:12:30,494 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f2b76b20924b5701edf3365b0e602977 2023-07-20 12:12:30,495 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3fcc8ec58e879406b6bf52ca3120691 empty. 2023-07-20 12:12:30,495 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f2b76b20924b5701edf3365b0e602977 empty. 2023-07-20 12:12:30,495 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3fcc8ec58e879406b6bf52ca3120691 2023-07-20 12:12:30,495 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f2b76b20924b5701edf3365b0e602977 2023-07-20 12:12:30,495 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-20 12:12:30,554 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-20 12:12:30,556 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => c3fcc8ec58e879406b6bf52ca3120691, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689855150482.c3fcc8ec58e879406b6bf52ca3120691.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp 2023-07-20 12:12:30,556 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => f2b76b20924b5701edf3365b0e602977, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689855150482.f2b76b20924b5701edf3365b0e602977.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp 2023-07-20 12:12:30,582 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689855150482.c3fcc8ec58e879406b6bf52ca3120691.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 12:12:30,584 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing c3fcc8ec58e879406b6bf52ca3120691, disabling compactions & flushes 2023-07-20 12:12:30,586 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689855150482.c3fcc8ec58e879406b6bf52ca3120691. 2023-07-20 12:12:30,588 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689855150482.c3fcc8ec58e879406b6bf52ca3120691. 2023-07-20 12:12:30,588 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689855150482.c3fcc8ec58e879406b6bf52ca3120691. after waiting 0 ms 2023-07-20 12:12:30,588 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689855150482.c3fcc8ec58e879406b6bf52ca3120691. 2023-07-20 12:12:30,588 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689855150482.c3fcc8ec58e879406b6bf52ca3120691. 2023-07-20 12:12:30,588 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for c3fcc8ec58e879406b6bf52ca3120691: 2023-07-20 12:12:30,590 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689855150482.f2b76b20924b5701edf3365b0e602977.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 12:12:30,591 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing f2b76b20924b5701edf3365b0e602977, disabling compactions & flushes 2023-07-20 12:12:30,591 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689855150482.f2b76b20924b5701edf3365b0e602977. 2023-07-20 12:12:30,591 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689855150482.f2b76b20924b5701edf3365b0e602977. 2023-07-20 12:12:30,591 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689855150482.f2b76b20924b5701edf3365b0e602977. after waiting 0 ms 2023-07-20 12:12:30,591 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689855150482.f2b76b20924b5701edf3365b0e602977. 2023-07-20 12:12:30,591 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689855150482.f2b76b20924b5701edf3365b0e602977. 2023-07-20 12:12:30,591 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for f2b76b20924b5701edf3365b0e602977: 2023-07-20 12:12:30,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-20 12:12:30,594 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 12:12:30,595 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689855150482.c3fcc8ec58e879406b6bf52ca3120691.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689855150595"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689855150595"}]},"ts":"1689855150595"} 2023-07-20 12:12:30,595 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689855150482.f2b76b20924b5701edf3365b0e602977.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689855150595"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689855150595"}]},"ts":"1689855150595"} 2023-07-20 12:12:30,598 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 12:12:30,598 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 12:12:30,599 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689855150598"}]},"ts":"1689855150598"} 2023-07-20 12:12:30,600 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-20 12:12:30,603 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 12:12:30,604 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 12:12:30,604 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 12:12:30,604 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 12:12:30,604 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 12:12:30,604 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c3fcc8ec58e879406b6bf52ca3120691, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f2b76b20924b5701edf3365b0e602977, ASSIGN}] 2023-07-20 12:12:30,608 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f2b76b20924b5701edf3365b0e602977, ASSIGN 2023-07-20 12:12:30,608 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c3fcc8ec58e879406b6bf52ca3120691, ASSIGN 2023-07-20 12:12:30,610 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f2b76b20924b5701edf3365b0e602977, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39003,1689855028825; forceNewPlan=false, retain=false 2023-07-20 12:12:30,610 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c3fcc8ec58e879406b6bf52ca3120691, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43611,1689855028889; forceNewPlan=false, retain=false 2023-07-20 12:12:30,760 INFO [jenkins-hbase4:46247] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 12:12:30,763 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=f2b76b20924b5701edf3365b0e602977, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:30,763 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=c3fcc8ec58e879406b6bf52ca3120691, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:30,764 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689855150482.f2b76b20924b5701edf3365b0e602977.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689855150763"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689855150763"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689855150763"}]},"ts":"1689855150763"} 2023-07-20 12:12:30,764 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689855150482.c3fcc8ec58e879406b6bf52ca3120691.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689855150763"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689855150763"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689855150763"}]},"ts":"1689855150763"} 2023-07-20 12:12:30,766 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure f2b76b20924b5701edf3365b0e602977, server=jenkins-hbase4.apache.org,39003,1689855028825}] 2023-07-20 12:12:30,767 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure c3fcc8ec58e879406b6bf52ca3120691, server=jenkins-hbase4.apache.org,43611,1689855028889}] 2023-07-20 12:12:30,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-20 12:12:30,922 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689855150482.c3fcc8ec58e879406b6bf52ca3120691. 2023-07-20 12:12:30,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c3fcc8ec58e879406b6bf52ca3120691, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689855150482.c3fcc8ec58e879406b6bf52ca3120691.', STARTKEY => '', ENDKEY => '1'} 2023-07-20 12:12:30,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689855150482.c3fcc8ec58e879406b6bf52ca3120691. service=AccessControlService 2023-07-20 12:12:30,923 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 12:12:30,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp c3fcc8ec58e879406b6bf52ca3120691 2023-07-20 12:12:30,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689855150482.c3fcc8ec58e879406b6bf52ca3120691.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 12:12:30,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c3fcc8ec58e879406b6bf52ca3120691 2023-07-20 12:12:30,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c3fcc8ec58e879406b6bf52ca3120691 2023-07-20 12:12:30,938 INFO [StoreOpener-c3fcc8ec58e879406b6bf52ca3120691-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c3fcc8ec58e879406b6bf52ca3120691 2023-07-20 12:12:30,940 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689855150482.f2b76b20924b5701edf3365b0e602977. 2023-07-20 12:12:30,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f2b76b20924b5701edf3365b0e602977, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689855150482.f2b76b20924b5701edf3365b0e602977.', STARTKEY => '1', ENDKEY => ''} 2023-07-20 12:12:30,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689855150482.f2b76b20924b5701edf3365b0e602977. service=AccessControlService 2023-07-20 12:12:30,941 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 12:12:30,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp f2b76b20924b5701edf3365b0e602977 2023-07-20 12:12:30,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689855150482.f2b76b20924b5701edf3365b0e602977.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 12:12:30,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f2b76b20924b5701edf3365b0e602977 2023-07-20 12:12:30,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f2b76b20924b5701edf3365b0e602977 2023-07-20 12:12:30,942 DEBUG [StoreOpener-c3fcc8ec58e879406b6bf52ca3120691-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3fcc8ec58e879406b6bf52ca3120691/cf 2023-07-20 12:12:30,942 DEBUG [StoreOpener-c3fcc8ec58e879406b6bf52ca3120691-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3fcc8ec58e879406b6bf52ca3120691/cf 2023-07-20 12:12:30,942 INFO [StoreOpener-c3fcc8ec58e879406b6bf52ca3120691-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c3fcc8ec58e879406b6bf52ca3120691 columnFamilyName cf 2023-07-20 12:12:30,944 INFO [StoreOpener-c3fcc8ec58e879406b6bf52ca3120691-1] regionserver.HStore(310): Store=c3fcc8ec58e879406b6bf52ca3120691/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 12:12:30,944 INFO [StoreOpener-f2b76b20924b5701edf3365b0e602977-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f2b76b20924b5701edf3365b0e602977 2023-07-20 12:12:30,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3fcc8ec58e879406b6bf52ca3120691 2023-07-20 12:12:30,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3fcc8ec58e879406b6bf52ca3120691 2023-07-20 12:12:30,946 DEBUG [StoreOpener-f2b76b20924b5701edf3365b0e602977-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithSkipTmp/f2b76b20924b5701edf3365b0e602977/cf 2023-07-20 12:12:30,946 DEBUG [StoreOpener-f2b76b20924b5701edf3365b0e602977-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithSkipTmp/f2b76b20924b5701edf3365b0e602977/cf 2023-07-20 12:12:30,946 INFO [StoreOpener-f2b76b20924b5701edf3365b0e602977-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f2b76b20924b5701edf3365b0e602977 columnFamilyName cf 2023-07-20 12:12:30,947 INFO [StoreOpener-f2b76b20924b5701edf3365b0e602977-1] regionserver.HStore(310): Store=f2b76b20924b5701edf3365b0e602977/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 12:12:30,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithSkipTmp/f2b76b20924b5701edf3365b0e602977 2023-07-20 12:12:30,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithSkipTmp/f2b76b20924b5701edf3365b0e602977 2023-07-20 12:12:30,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c3fcc8ec58e879406b6bf52ca3120691 2023-07-20 12:12:30,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f2b76b20924b5701edf3365b0e602977 2023-07-20 12:12:30,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3fcc8ec58e879406b6bf52ca3120691/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 12:12:30,952 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c3fcc8ec58e879406b6bf52ca3120691; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72046117, jitterRate=0.07357080280780792}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 12:12:30,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c3fcc8ec58e879406b6bf52ca3120691: 2023-07-20 12:12:30,953 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689855150482.c3fcc8ec58e879406b6bf52ca3120691., pid=109, masterSystemTime=1689855150918 2023-07-20 12:12:30,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithSkipTmp/f2b76b20924b5701edf3365b0e602977/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 12:12:30,954 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f2b76b20924b5701edf3365b0e602977; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66239910, jitterRate=-0.012948423624038696}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 12:12:30,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f2b76b20924b5701edf3365b0e602977: 2023-07-20 12:12:30,955 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689855150482.f2b76b20924b5701edf3365b0e602977., pid=108, masterSystemTime=1689855150917 2023-07-20 12:12:30,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689855150482.c3fcc8ec58e879406b6bf52ca3120691. 2023-07-20 12:12:30,955 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689855150482.c3fcc8ec58e879406b6bf52ca3120691. 2023-07-20 12:12:30,956 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=c3fcc8ec58e879406b6bf52ca3120691, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:30,956 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689855150482.c3fcc8ec58e879406b6bf52ca3120691.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689855150956"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689855150956"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689855150956"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689855150956"}]},"ts":"1689855150956"} 2023-07-20 12:12:30,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689855150482.f2b76b20924b5701edf3365b0e602977. 2023-07-20 12:12:30,958 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689855150482.f2b76b20924b5701edf3365b0e602977. 2023-07-20 12:12:30,959 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=f2b76b20924b5701edf3365b0e602977, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:30,961 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689855150482.f2b76b20924b5701edf3365b0e602977.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689855150959"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689855150959"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689855150959"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689855150959"}]},"ts":"1689855150959"} 2023-07-20 12:12:30,971 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-20 12:12:30,971 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure c3fcc8ec58e879406b6bf52ca3120691, server=jenkins-hbase4.apache.org,43611,1689855028889 in 202 msec 2023-07-20 12:12:30,972 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-20 12:12:30,972 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure f2b76b20924b5701edf3365b0e602977, server=jenkins-hbase4.apache.org,39003,1689855028825 in 205 msec 2023-07-20 12:12:30,973 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c3fcc8ec58e879406b6bf52ca3120691, ASSIGN in 367 msec 2023-07-20 12:12:30,974 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-20 12:12:30,974 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f2b76b20924b5701edf3365b0e602977, ASSIGN in 368 msec 2023-07-20 12:12:30,974 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 12:12:30,975 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689855150974"}]},"ts":"1689855150974"} 2023-07-20 12:12:30,976 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-20 12:12:30,978 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 12:12:30,978 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-20 12:12:30,980 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43611] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-20 12:12:30,983 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:12:30,983 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:12:30,983 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:12:30,983 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:12:30,984 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-20 12:12:30,985 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-20 12:12:30,985 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-20 12:12:30,989 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-20 12:12:30,990 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 501 msec 2023-07-20 12:12:31,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-20 12:12:31,096 INFO [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-20 12:12:31,098 DEBUG [Listener at jenkins-hbase4.apache.org/34263] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,098 DEBUG [Listener at jenkins-hbase4.apache.org/34263] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689855150482.c3fcc8ec58e879406b6bf52ca3120691. 2023-07-20 12:12:31,100 INFO [Listener at jenkins-hbase4.apache.org/34263] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 12:12:31,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-20 12:12:31,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689855151114 (current time:1689855151114). 2023-07-20 12:12:31,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 12:12:31,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(139): Connect 0x6bae8643 to 127.0.0.1:59849 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 12:12:31,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ac55447, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 12:12:31,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:12:31,127 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39308, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:12:31,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6bae8643 to 127.0.0.1:59849 2023-07-20 12:12:31,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 12:12:31,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(139): Connect 0x2292fef9 to 127.0.0.1:59849 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 12:12:31,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d11e876, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 12:12:31,137 DEBUG [hconnection-0x7d36f4ff-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:12:31,141 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39318, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:12:31,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:12:31,148 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42606, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:12:31,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2292fef9 to 127.0.0.1:59849 2023-07-20 12:12:31,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 12:12:31,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-20 12:12:31,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 12:12:31,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-20 12:12:31,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-20 12:12:31,154 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-20 12:12:31,155 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689855751155 2023-07-20 12:12:31,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-20 12:12:31,155 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,157 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 12:12:31,157 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 12:12:31,158 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-20 12:12:31,158 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-20 12:12:31,159 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-07-20 12:12:31,160 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-20 12:12:31,161 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689855751161 2023-07-20 12:12:31,174 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,174 INFO [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-20 12:12:31,174 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:12:31,176 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-20 12:12:31,176 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-20 12:12:31,178 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,178 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,180 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:12:31,180 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:12:31,180 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:12:31,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:12:31,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:12:31,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:12:31,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:12:31,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:12:31,180 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:31,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:12:31,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,181 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:31,181 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:31,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,181 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,181 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-20 12:12:31,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-20 12:12:31,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,181 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:31,182 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 12:12:31,182 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-20 12:12:31,182 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-20 12:12:31,182 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-20 12:12:31,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,183 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-20 12:12:31,183 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,183 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-20 12:12:31,183 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:12:31,188 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-20 12:12:31,188 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-20 12:12:31,189 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41865,1689855028765' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-20 12:12:31,189 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,189 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,189 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-20 12:12:31,189 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-20 12:12:31,189 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:12:31,189 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:12:31,190 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-20 12:12:31,192 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-20 12:12:31,192 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-20 12:12:31,192 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-20 12:12:31,192 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39003,1689855028825' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-20 12:12:31,192 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43611,1689855028889' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-20 12:12:31,197 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,199 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:31,199 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:31,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:12:31,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:12:31,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:12:31,200 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,200 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 12:12:31,200 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,200 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,200 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:31,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:12:31,200 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 12:12:31,200 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,200 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 12:12:31,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:31,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:31,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:31,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:12:31,202 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43611,1689855028889' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-20 12:12:31,202 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d738367[Count = 1] remaining members to acquire global barrier 2023-07-20 12:12:31,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:31,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:12:31,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:12:31,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:12:31,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:12:31,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:31,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:31,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:31,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:12:31,205 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39003,1689855028825' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-20 12:12:31,205 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d738367[Count = 0] remaining members to acquire global barrier 2023-07-20 12:12:31,205 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-20 12:12:31,205 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,206 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,206 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,206 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,206 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-20 12:12:31,206 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-20 12:12:31,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,207 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-20 12:12:31,207 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 12:12:31,206 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:31,207 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 12:12:31,207 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689855150482.f2b76b20924b5701edf3365b0e602977. 2023-07-20 12:12:31,207 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41865,1689855028765' in zk 2023-07-20 12:12:31,207 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689855150482.f2b76b20924b5701edf3365b0e602977. started... 2023-07-20 12:12:31,207 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-20 12:12:31,207 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:31,207 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 12:12:31,207 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 12:12:31,209 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 12:12:31,207 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689855150482.c3fcc8ec58e879406b6bf52ca3120691. 2023-07-20 12:12:31,209 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f2b76b20924b5701edf3365b0e602977: 2023-07-20 12:12:31,210 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689855150482.c3fcc8ec58e879406b6bf52ca3120691. started... 2023-07-20 12:12:31,211 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689855150482.f2b76b20924b5701edf3365b0e602977.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,211 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c3fcc8ec58e879406b6bf52ca3120691: 2023-07-20 12:12:31,211 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 12:12:31,211 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 12:12:31,211 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689855150482.c3fcc8ec58e879406b6bf52ca3120691.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,211 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 12:12:31,211 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 12:12:31,211 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-20 12:12:31,211 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:12:31,211 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-20 12:12:31,223 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689855150482.c3fcc8ec58e879406b6bf52ca3120691. completed. 2023-07-20 12:12:31,223 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689855150482.c3fcc8ec58e879406b6bf52ca3120691. 2023-07-20 12:12:31,223 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 12:12:31,224 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 12:12:31,224 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:31,224 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-20 12:12:31,224 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43611,1689855028889' in zk 2023-07-20 12:12:31,225 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689855150482.f2b76b20924b5701edf3365b0e602977. completed. 2023-07-20 12:12:31,225 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689855150482.f2b76b20924b5701edf3365b0e602977. 2023-07-20 12:12:31,225 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 12:12:31,225 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 12:12:31,225 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:31,226 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-20 12:12:31,226 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39003,1689855028825' in zk 2023-07-20 12:12:31,228 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-20 12:12:31,228 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:31,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:31,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:12:31,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:12:31,228 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:12:31,229 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-20 12:12:31,232 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:31,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:12:31,232 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-20 12:12:31,233 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:12:31,233 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-20 12:12:31,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:12:31,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:31,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:31,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:31,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:12:31,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:31,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:31,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:31,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43611,1689855028889': 2023-07-20 12:12:31,237 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43611,1689855028889' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-20 12:12:31,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:31,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:12:31,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:12:31,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:12:31,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:12:31,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:31,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:31,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:31,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:12:31,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:31,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:31,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:31,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39003,1689855028825': 2023-07-20 12:12:31,241 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39003,1689855028825' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-20 12:12:31,241 INFO [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-20 12:12:31,241 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 12:12:31,242 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 12:12:31,242 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,242 INFO [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 12:12:31,243 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,243 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:12:31,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,243 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,243 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,244 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:12:31,243 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:12:31,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:12:31,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,244 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:31,244 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:12:31,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:12:31,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:12:31,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:12:31,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:12:31,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:12:31,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:12:31,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:12:31,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,245 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:31,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,245 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:31,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:12:31,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:31,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:31,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:31,247 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:31,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:12:31,247 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:31,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,248 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:31,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:31,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:31,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:31,251 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:31,251 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:12:31,252 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:12:31,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:12:31,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:12:31,251 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:12:31,252 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:12:31,251 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:12:31,252 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:12:31,251 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:12:31,252 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:12:31,252 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:12:31,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:12:31,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:12:31,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:12:31,253 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:12:31,255 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,255 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 12:12:31,252 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:31,255 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:31,255 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,255 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:31,255 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,255 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:31,255 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:31,255 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,255 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:12:31,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:12:31,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:12:31,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:12:31,255 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-20 12:12:31,257 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 12:12:31,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-20 12:12:31,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-20 12:12:31,258 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 12:12:31,262 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,263 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,307 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,347 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-20 12:12:31,347 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,347 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,347 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689855151155Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689855151262 (+107 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689855151262Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689855151262Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689855151266 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689855151278 (+12 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689855151347 (+69 ms) 2023-07-20 12:12:31,350 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-20 12:12:31,352 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 194 msec 2023-07-20 12:12:31,458 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 12:12:31,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-20 12:12:31,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 12:12:31,462 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43611] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689855150482.c3fcc8ec58e879406b6bf52ca3120691. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 12:12:31,465 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39003] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689855150482.f2b76b20924b5701edf3365b0e602977. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 12:12:31,468 DEBUG [Listener at jenkins-hbase4.apache.org/34263] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,468 DEBUG [Listener at jenkins-hbase4.apache.org/34263] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689855150482.c3fcc8ec58e879406b6bf52ca3120691. 2023-07-20 12:12:31,468 INFO [Listener at jenkins-hbase4.apache.org/34263] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 12:12:31,484 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-20 12:12:31,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689855151484 (current time:1689855151484). 2023-07-20 12:12:31,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 12:12:31,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(139): Connect 0x360abbd7 to 127.0.0.1:59849 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 12:12:31,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7cd120e5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 12:12:31,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:12:31,502 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39334, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:12:31,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x360abbd7 to 127.0.0.1:59849 2023-07-20 12:12:31,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 12:12:31,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(139): Connect 0x4b99d6c7 to 127.0.0.1:59849 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 12:12:31,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@282e1860, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 12:12:31,612 DEBUG [hconnection-0x5d0dd388-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:12:31,615 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39346, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:12:31,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 12:12:31,621 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42610, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 12:12:31,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b99d6c7 to 127.0.0.1:59849 2023-07-20 12:12:31,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 12:12:31,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-20 12:12:31,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 12:12:31,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-20 12:12:31,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-20 12:12:31,626 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-20 12:12:31,626 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689855751626 2023-07-20 12:12:31,626 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-20 12:12:31,628 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 12:12:31,628 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 12:12:31,629 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-20 12:12:31,629 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-20 12:12:31,631 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-07-20 12:12:31,631 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-20 12:12:31,633 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689855751633 2023-07-20 12:12:31,641 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,641 INFO [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-20 12:12:31,641 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:12:31,643 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-20 12:12:31,643 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-20 12:12:31,643 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,643 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,645 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:12:31,646 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:12:31,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:12:31,645 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:12:31,645 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:31,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:12:31,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:12:31,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:12:31,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:12:31,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:12:31,646 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:31,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,646 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:31,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,646 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,647 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,647 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,647 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:31,647 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 12:12:31,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-20 12:12:31,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-20 12:12:31,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-20 12:12:31,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,647 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-20 12:12:31,647 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-20 12:12:31,647 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-20 12:12:31,647 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,647 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,647 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-20 12:12:31,647 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:12:31,647 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-20 12:12:31,648 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:12:31,652 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-20 12:12:31,652 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-20 12:12:31,652 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,652 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-20 12:12:31,652 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-20 12:12:31,652 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43611,1689855028889' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-20 12:12:31,652 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-20 12:12:31,652 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41865,1689855028765' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-20 12:12:31,652 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 12:12:31,654 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-20 12:12:31,654 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-20 12:12:31,654 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39003,1689855028825' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-20 12:12:31,655 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,655 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,655 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:31,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:31,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:12:31,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:12:31,656 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:31,656 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:12:31,656 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,656 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 12:12:31,656 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,656 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 12:12:31,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:12:31,656 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,656 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 12:12:31,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:31,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:31,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:31,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:12:31,658 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43611,1689855028889' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-20 12:12:31,658 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4623fd43[Count = 1] remaining members to acquire global barrier 2023-07-20 12:12:31,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:31,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:12:31,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:12:31,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:12:31,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:12:31,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:31,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:31,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:31,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:12:31,660 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39003,1689855028825' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-20 12:12:31,660 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4623fd43[Count = 0] remaining members to acquire global barrier 2023-07-20 12:12:31,660 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-20 12:12:31,660 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,665 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,665 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,665 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,665 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-20 12:12:31,665 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-20 12:12:31,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,665 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:31,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,665 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-20 12:12:31,665 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-20 12:12:31,665 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41865,1689855028765' in zk 2023-07-20 12:12:31,666 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689855150482.f2b76b20924b5701edf3365b0e602977. 2023-07-20 12:12:31,665 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 12:12:31,666 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689855150482.f2b76b20924b5701edf3365b0e602977. started... 2023-07-20 12:12:31,666 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:31,666 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 12:12:31,666 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 12:12:31,666 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689855150482.c3fcc8ec58e879406b6bf52ca3120691. 2023-07-20 12:12:31,666 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 12:12:31,666 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689855150482.c3fcc8ec58e879406b6bf52ca3120691. started... 2023-07-20 12:12:31,666 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 12:12:31,666 INFO [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f2b76b20924b5701edf3365b0e602977 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-20 12:12:31,666 INFO [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c3fcc8ec58e879406b6bf52ca3120691 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-20 12:12:31,667 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-20 12:12:31,667 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:12:31,667 DEBUG [member: 'jenkins-hbase4.apache.org,41865,1689855028765' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-20 12:12:31,696 INFO [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023072003cbf08b09cc4a079dd2359473a4c0d5 to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023072003cbf08b09cc4a079dd2359473a4c0d5 2023-07-20 12:12:31,700 INFO [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023072001720cbd17b04187bfec3a6199c47871 to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023072001720cbd17b04187bfec3a6199c47871 2023-07-20 12:12:31,706 INFO [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3fcc8ec58e879406b6bf52ca3120691/.tmp/cf/2abc140888b64b5f8dcbb2244191bcd8 2023-07-20 12:12:31,710 INFO [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithSkipTmp/f2b76b20924b5701edf3365b0e602977/.tmp/cf/5f5b20bea1334790971063e46d3e5528 2023-07-20 12:12:31,711 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3fcc8ec58e879406b6bf52ca3120691/.tmp/cf/2abc140888b64b5f8dcbb2244191bcd8 as hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3fcc8ec58e879406b6bf52ca3120691/cf/2abc140888b64b5f8dcbb2244191bcd8 2023-07-20 12:12:31,715 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithSkipTmp/f2b76b20924b5701edf3365b0e602977/.tmp/cf/5f5b20bea1334790971063e46d3e5528 as hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithSkipTmp/f2b76b20924b5701edf3365b0e602977/cf/5f5b20bea1334790971063e46d3e5528 2023-07-20 12:12:31,715 INFO [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3fcc8ec58e879406b6bf52ca3120691/cf/2abc140888b64b5f8dcbb2244191bcd8, entries=5, sequenceid=6, filesize=5.8 K 2023-07-20 12:12:31,716 INFO [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for c3fcc8ec58e879406b6bf52ca3120691 in 50ms, sequenceid=6, compaction requested=false 2023-07-20 12:12:31,716 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-20 12:12:31,717 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c3fcc8ec58e879406b6bf52ca3120691: 2023-07-20 12:12:31,717 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689855150482.c3fcc8ec58e879406b6bf52ca3120691.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,717 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 12:12:31,717 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3fcc8ec58e879406b6bf52ca3120691/cf/2abc140888b64b5f8dcbb2244191bcd8] hfiles 2023-07-20 12:12:31,717 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3fcc8ec58e879406b6bf52ca3120691/cf/2abc140888b64b5f8dcbb2244191bcd8 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,726 INFO [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithSkipTmp/f2b76b20924b5701edf3365b0e602977/cf/5f5b20bea1334790971063e46d3e5528, entries=45, sequenceid=6, filesize=13.0 K 2023-07-20 12:12:31,727 INFO [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for f2b76b20924b5701edf3365b0e602977 in 61ms, sequenceid=6, compaction requested=false 2023-07-20 12:12:31,728 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 12:12:31,730 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f2b76b20924b5701edf3365b0e602977: 2023-07-20 12:12:31,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-20 12:12:31,730 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689855150482.f2b76b20924b5701edf3365b0e602977.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-20 12:12:31,730 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 12:12:31,731 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithSkipTmp/f2b76b20924b5701edf3365b0e602977/cf/5f5b20bea1334790971063e46d3e5528] hfiles 2023-07-20 12:12:31,731 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithSkipTmp/f2b76b20924b5701edf3365b0e602977/cf/5f5b20bea1334790971063e46d3e5528 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,731 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 12:12:31,735 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689855150482.c3fcc8ec58e879406b6bf52ca3120691. completed. 2023-07-20 12:12:31,735 DEBUG [rs(jenkins-hbase4.apache.org,43611,1689855028889)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689855150482.c3fcc8ec58e879406b6bf52ca3120691. 2023-07-20 12:12:31,735 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 12:12:31,735 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 12:12:31,735 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:31,735 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-20 12:12:31,735 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43611,1689855028889' in zk 2023-07-20 12:12:31,737 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:31,737 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-20 12:12:31,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:31,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:12:31,737 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:12:31,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:12:31,738 DEBUG [member: 'jenkins-hbase4.apache.org,43611,1689855028889' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-20 12:12:31,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:12:31,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:12:31,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:31,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:31,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:31,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:12:31,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:31,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:31,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43611,1689855028889': 2023-07-20 12:12:31,741 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43611,1689855028889' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-20 12:12:31,749 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689855150482.f2b76b20924b5701edf3365b0e602977. completed. 2023-07-20 12:12:31,749 DEBUG [rs(jenkins-hbase4.apache.org,39003,1689855028825)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689855150482.f2b76b20924b5701edf3365b0e602977. 2023-07-20 12:12:31,749 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 12:12:31,749 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 12:12:31,749 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:31,750 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-20 12:12:31,750 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39003,1689855028825' in zk 2023-07-20 12:12:31,751 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-20 12:12:31,751 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:31,751 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:12:31,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:31,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:12:31,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:12:31,751 DEBUG [member: 'jenkins-hbase4.apache.org,39003,1689855028825' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-20 12:12:31,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:12:31,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:12:31,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:31,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:31,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:31,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:12:31,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:31,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:31,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:31,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39003,1689855028825': 2023-07-20 12:12:31,756 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39003,1689855028825' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-20 12:12:31,756 INFO [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-20 12:12:31,756 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 12:12:31,756 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 12:12:31,756 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,756 INFO [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 12:12:31,758 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,759 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,758 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,758 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 12:12:31,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 12:12:31,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,759 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:12:31,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,759 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:12:31,759 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:12:31,759 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:31,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:12:31,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 12:12:31,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:12:31,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:12:31,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:12:31,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:12:31,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:12:31,760 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:31,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,760 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:31,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 12:12:31,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:31,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:31,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:31,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 12:12:31,762 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:31,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,762 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:31,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:31,763 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:31,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:31,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:31,766 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:31,766 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:12:31,766 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:12:31,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:12:31,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:12:31,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:12:31,766 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,766 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:12:31,766 DEBUG [(jenkins-hbase4.apache.org,46247,1689855027157)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 12:12:31,766 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:12:31,766 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,766 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 12:12:31,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:12:31,768 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:12:31,768 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,766 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:31,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:12:31,768 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:31,768 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,768 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:31,768 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,768 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:31,768 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:12:31,768 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,768 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 12:12:31,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 12:12:31,768 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 12:12:31,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:12:31,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 12:12:31,768 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:12:31,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 12:12:31,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 12:12:31,769 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023072001720cbd17b04187bfec3a6199c47871, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023072003cbf08b09cc4a079dd2359473a4c0d5] mob files 2023-07-20 12:12:31,769 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023072001720cbd17b04187bfec3a6199c47871 2023-07-20 12:12:31,769 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023072003cbf08b09cc4a079dd2359473a4c0d5 2023-07-20 12:12:31,775 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,776 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,794 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,810 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-20 12:12:31,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,811 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689855151627Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689855151775 (+148 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689855151775Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689855151775Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689855151781 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689855151788 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689855151810 (+22 ms) 2023-07-20 12:12:31,814 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-20 12:12:31,815 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 186 msec 2023-07-20 12:12:31,931 DEBUG [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 12:12:31,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-20 12:12:31,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 12:12:31,932 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855151932 2023-07-20 12:12:31,932 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37499, tgtDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855151932, rawTgtDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855151932, srcFsUri=hdfs://localhost:37499, srcDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc 2023-07-20 12:12:31,956 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37499, inputRoot=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc 2023-07-20 12:12:31,956 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-905048533_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855151932, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855151932/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:31,956 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37499, inputRoot=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc, snapshotDir=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-20 12:12:31,969 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855151932/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:32,001 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 12:12:32,002 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 12:12:32,002 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 12:12:32,003 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 12:12:33,075 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/hadoop-3022153878359673216.jar 2023-07-20 12:12:33,076 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 12:12:33,076 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 12:12:33,154 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/hadoop-5594564656430904426.jar 2023-07-20 12:12:33,155 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 12:12:33,155 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 12:12:33,156 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 12:12:33,156 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 12:12:33,157 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 12:12:33,157 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 12:12:33,158 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 12:12:33,158 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 12:12:33,159 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 12:12:33,159 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 12:12:33,160 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 12:12:33,160 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 12:12:33,160 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 12:12:33,161 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 12:12:33,161 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 12:12:33,162 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 12:12:33,162 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 12:12:33,163 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 12:12:33,163 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 12:12:33,164 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 12:12:33,164 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 12:12:33,165 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 12:12:33,165 DEBUG [Listener at jenkins-hbase4.apache.org/34263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 12:12:33,876 WARN [Listener at jenkins-hbase4.apache.org/34263] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 12:12:33,879 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-20 12:12:33,882 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-20 12:12:34,688 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 12:12:34,688 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 12:12:34,694 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689855037970_0006_000001 (auth:SIMPLE) 2023-07-20 12:12:35,402 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689855037970_0007_000001 (auth:SIMPLE) 2023-07-20 12:12:35,783 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 12:12:42,687 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689855037970_0007_000001 (auth:SIMPLE) 2023-07-20 12:12:45,013 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689855037970_0007_000001 (auth:SIMPLE) 2023-07-20 12:12:48,806 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689855037970_0007_000001 (auth:SIMPLE) 2023-07-20 12:12:50,232 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 12:12:50,232 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 12:12:50,255 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:50,255 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 12:12:50,256 INFO [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 12:12:50,256 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1891902696_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:50,257 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(367): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-20 12:12:50,257 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(367): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-20 12:12:50,257 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1891902696_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855151932/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855151932/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:50,257 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(367): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855151932/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-20 12:12:50,257 DEBUG [Listener at jenkins-hbase4.apache.org/34263] snapshot.TestExportSnapshot(367): hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/export-test/export-1689855151932/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-20 12:12:50,265 INFO [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:50,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:50,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:50,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-20 12:12:50,276 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689855170276"}]},"ts":"1689855170276"} 2023-07-20 12:12:50,278 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-20 12:12:50,279 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-20 12:12:50,280 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c3fcc8ec58e879406b6bf52ca3120691, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f2b76b20924b5701edf3365b0e602977, UNASSIGN}] 2023-07-20 12:12:50,283 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c3fcc8ec58e879406b6bf52ca3120691, UNASSIGN 2023-07-20 12:12:50,283 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f2b76b20924b5701edf3365b0e602977, UNASSIGN 2023-07-20 12:12:50,284 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=c3fcc8ec58e879406b6bf52ca3120691, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:12:50,284 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=f2b76b20924b5701edf3365b0e602977, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:12:50,284 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689855150482.c3fcc8ec58e879406b6bf52ca3120691.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689855170284"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689855170284"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689855170284"}]},"ts":"1689855170284"} 2023-07-20 12:12:50,284 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689855150482.f2b76b20924b5701edf3365b0e602977.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689855170284"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689855170284"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689855170284"}]},"ts":"1689855170284"} 2023-07-20 12:12:50,286 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure c3fcc8ec58e879406b6bf52ca3120691, server=jenkins-hbase4.apache.org,43611,1689855028889}] 2023-07-20 12:12:50,286 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure f2b76b20924b5701edf3365b0e602977, server=jenkins-hbase4.apache.org,39003,1689855028825}] 2023-07-20 12:12:50,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-20 12:12:50,438 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c3fcc8ec58e879406b6bf52ca3120691 2023-07-20 12:12:50,439 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f2b76b20924b5701edf3365b0e602977 2023-07-20 12:12:50,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c3fcc8ec58e879406b6bf52ca3120691, disabling compactions & flushes 2023-07-20 12:12:50,439 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689855150482.c3fcc8ec58e879406b6bf52ca3120691. 2023-07-20 12:12:50,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689855150482.c3fcc8ec58e879406b6bf52ca3120691. 2023-07-20 12:12:50,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f2b76b20924b5701edf3365b0e602977, disabling compactions & flushes 2023-07-20 12:12:50,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689855150482.c3fcc8ec58e879406b6bf52ca3120691. after waiting 0 ms 2023-07-20 12:12:50,439 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689855150482.f2b76b20924b5701edf3365b0e602977. 2023-07-20 12:12:50,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689855150482.c3fcc8ec58e879406b6bf52ca3120691. 2023-07-20 12:12:50,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689855150482.f2b76b20924b5701edf3365b0e602977. 2023-07-20 12:12:50,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689855150482.f2b76b20924b5701edf3365b0e602977. after waiting 0 ms 2023-07-20 12:12:50,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689855150482.f2b76b20924b5701edf3365b0e602977. 2023-07-20 12:12:50,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithSkipTmp/f2b76b20924b5701edf3365b0e602977/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 12:12:50,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3fcc8ec58e879406b6bf52ca3120691/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 12:12:50,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 12:12:50,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 12:12:50,451 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689855150482.f2b76b20924b5701edf3365b0e602977. 2023-07-20 12:12:50,452 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689855150482.c3fcc8ec58e879406b6bf52ca3120691. 2023-07-20 12:12:50,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f2b76b20924b5701edf3365b0e602977: 2023-07-20 12:12:50,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c3fcc8ec58e879406b6bf52ca3120691: 2023-07-20 12:12:50,454 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c3fcc8ec58e879406b6bf52ca3120691 2023-07-20 12:12:50,454 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=c3fcc8ec58e879406b6bf52ca3120691, regionState=CLOSED 2023-07-20 12:12:50,454 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f2b76b20924b5701edf3365b0e602977 2023-07-20 12:12:50,455 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689855150482.c3fcc8ec58e879406b6bf52ca3120691.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689855170454"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689855170454"}]},"ts":"1689855170454"} 2023-07-20 12:12:50,455 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=f2b76b20924b5701edf3365b0e602977, regionState=CLOSED 2023-07-20 12:12:50,455 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689855150482.f2b76b20924b5701edf3365b0e602977.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689855170455"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689855170455"}]},"ts":"1689855170455"} 2023-07-20 12:12:50,458 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-20 12:12:50,458 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure c3fcc8ec58e879406b6bf52ca3120691, server=jenkins-hbase4.apache.org,43611,1689855028889 in 170 msec 2023-07-20 12:12:50,458 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-20 12:12:50,458 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure f2b76b20924b5701edf3365b0e602977, server=jenkins-hbase4.apache.org,39003,1689855028825 in 171 msec 2023-07-20 12:12:50,459 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c3fcc8ec58e879406b6bf52ca3120691, UNASSIGN in 178 msec 2023-07-20 12:12:50,460 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-20 12:12:50,460 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f2b76b20924b5701edf3365b0e602977, UNASSIGN in 179 msec 2023-07-20 12:12:50,463 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689855170463"}]},"ts":"1689855170463"} 2023-07-20 12:12:50,468 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-20 12:12:50,469 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-20 12:12:50,471 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 204 msec 2023-07-20 12:12:50,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-20 12:12:50,579 INFO [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-20 12:12:50,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:50,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:50,583 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:50,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:50,585 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:50,586 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43611] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:50,589 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:50,589 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:50,589 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:50,589 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-20 12:12:50,589 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:50,589 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-20 12:12:50,590 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:12:50,590 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-20 12:12:50,590 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-20 12:12:50,590 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-20 12:12:50,590 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-20 12:12:50,590 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:50,590 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:12:50,590 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:12:50,591 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:50,591 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 12:12:50,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-20 12:12:50,592 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3fcc8ec58e879406b6bf52ca3120691 2023-07-20 12:12:50,592 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f2b76b20924b5701edf3365b0e602977 2023-07-20 12:12:50,594 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3fcc8ec58e879406b6bf52ca3120691/cf, FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3fcc8ec58e879406b6bf52ca3120691/recovered.edits] 2023-07-20 12:12:50,594 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f2b76b20924b5701edf3365b0e602977/cf, FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f2b76b20924b5701edf3365b0e602977/recovered.edits] 2023-07-20 12:12:50,599 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f2b76b20924b5701edf3365b0e602977/cf/5f5b20bea1334790971063e46d3e5528 to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/f2b76b20924b5701edf3365b0e602977/cf/5f5b20bea1334790971063e46d3e5528 2023-07-20 12:12:50,599 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3fcc8ec58e879406b6bf52ca3120691/cf/2abc140888b64b5f8dcbb2244191bcd8 to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3fcc8ec58e879406b6bf52ca3120691/cf/2abc140888b64b5f8dcbb2244191bcd8 2023-07-20 12:12:50,604 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f2b76b20924b5701edf3365b0e602977/recovered.edits/9.seqid to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/f2b76b20924b5701edf3365b0e602977/recovered.edits/9.seqid 2023-07-20 12:12:50,605 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f2b76b20924b5701edf3365b0e602977 2023-07-20 12:12:50,606 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3fcc8ec58e879406b6bf52ca3120691/recovered.edits/9.seqid to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3fcc8ec58e879406b6bf52ca3120691/recovered.edits/9.seqid 2023-07-20 12:12:50,606 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c3fcc8ec58e879406b6bf52ca3120691 2023-07-20 12:12:50,606 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-20 12:12:50,607 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-20 12:12:50,608 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-20 12:12:50,612 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023072001720cbd17b04187bfec3a6199c47871 to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023072001720cbd17b04187bfec3a6199c47871 2023-07-20 12:12:50,613 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023072003cbf08b09cc4a079dd2359473a4c0d5 to hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023072003cbf08b09cc4a079dd2359473a4c0d5 2023-07-20 12:12:50,614 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-20 12:12:50,616 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:50,619 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-20 12:12:50,625 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-20 12:12:50,626 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:50,626 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-20 12:12:50,626 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689855150482.c3fcc8ec58e879406b6bf52ca3120691.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689855170626"}]},"ts":"9223372036854775807"} 2023-07-20 12:12:50,626 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689855150482.f2b76b20924b5701edf3365b0e602977.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689855170626"}]},"ts":"9223372036854775807"} 2023-07-20 12:12:50,628 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-20 12:12:50,628 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c3fcc8ec58e879406b6bf52ca3120691, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689855150482.c3fcc8ec58e879406b6bf52ca3120691.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f2b76b20924b5701edf3365b0e602977, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689855150482.f2b76b20924b5701edf3365b0e602977.', STARTKEY => '1', ENDKEY => ''}] 2023-07-20 12:12:50,628 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-20 12:12:50,628 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689855170628"}]},"ts":"9223372036854775807"} 2023-07-20 12:12:50,630 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-20 12:12:50,633 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:50,643 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 53 msec 2023-07-20 12:12:50,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-20 12:12:50,693 INFO [Listener at jenkins-hbase4.apache.org/34263] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-20 12:12:50,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-20 12:12:50,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:50,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-20 12:12:50,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46247] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 12:12:50,741 INFO [Listener at jenkins-hbase4.apache.org/34263] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=762 (was 759) Potentially hanging thread: Thread-5438 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x18f07d5b-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18f07d5b-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1753867629) connection to jenkins-hbase4.apache.org/172.31.14.131:38823 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x18f07d5b-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1891902696_17 at /127.0.0.1:46228 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1046218617_1 at /127.0.0.1:46196 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1891902696_17 at /127.0.0.1:47224 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18f07d5b-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1891902696_17 at /127.0.0.1:47368 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=897 (was 906), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=675 (was 624) - SystemLoadAverage LEAK? -, ProcessCount=188 (was 189), AvailableMemoryMB=929 (was 1478) 2023-07-20 12:12:50,741 WARN [Listener at jenkins-hbase4.apache.org/34263] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-20 12:12:50,741 INFO [Listener at jenkins-hbase4.apache.org/34263] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-20 12:12:50,756 INFO [Listener at jenkins-hbase4.apache.org/34263] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-20 12:12:54,984 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689855037970_0007_000001 (auth:SIMPLE) 2023-07-20 12:12:56,022 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 12:13:04,890 INFO [Listener at jenkins-hbase4.apache.org/34263] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-20 12:13:04,891 WARN [463025488@qtp-1158702161-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:41445] http.HttpServer2$SelectChannelConnectorWithSafeStartup(546): HttpServer Acceptor: isRunning is false. Rechecking. 2023-07-20 12:13:04,891 WARN [463025488@qtp-1158702161-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:41445] http.HttpServer2$SelectChannelConnectorWithSafeStartup(555): HttpServer Acceptor: isRunning is false 2023-07-20 12:13:19,035 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-20 12:13:19,039 INFO [Listener at jenkins-hbase4.apache.org/34263] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-20 12:13:19,154 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-20 12:13:19,166 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-20 12:13:19,171 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-20 12:13:19,201 INFO [Listener at jenkins-hbase4.apache.org/34263] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-20 12:13:19,306 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-20 12:13:19,306 INFO [Listener at jenkins-hbase4.apache.org/34263] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-20 12:13:19,306 INFO [Listener at jenkins-hbase4.apache.org/34263] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-20 12:13:19,306 INFO [Listener at jenkins-hbase4.apache.org/34263] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-20 12:13:19,307 DEBUG [Listener at jenkins-hbase4.apache.org/34263] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x59ecae38 to 127.0.0.1:59849 2023-07-20 12:13:19,307 DEBUG [Listener at jenkins-hbase4.apache.org/34263] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 12:13:19,307 DEBUG [Listener at jenkins-hbase4.apache.org/34263] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-20 12:13:19,307 DEBUG [Listener at jenkins-hbase4.apache.org/34263] util.JVMClusterUtil(257): Found active master hash=359483354, stopped=false 2023-07-20 12:13:19,307 DEBUG [Listener at jenkins-hbase4.apache.org/34263] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 12:13:19,307 DEBUG [Listener at jenkins-hbase4.apache.org/34263] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-20 12:13:19,307 INFO [Listener at jenkins-hbase4.apache.org/34263] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,46247,1689855027157 2023-07-20 12:13:19,310 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-20 12:13:19,310 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-20 12:13:19,310 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-20 12:13:19,311 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 12:13:19,311 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 12:13:19,311 INFO [Listener at jenkins-hbase4.apache.org/34263] procedure2.ProcedureExecutor(629): Stopping 2023-07-20 12:13:19,311 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 12:13:19,311 DEBUG [Listener at jenkins-hbase4.apache.org/34263] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60a6497b to 127.0.0.1:59849 2023-07-20 12:13:19,311 DEBUG [Listener at jenkins-hbase4.apache.org/34263] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 12:13:19,311 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 12:13:19,312 INFO [Listener at jenkins-hbase4.apache.org/34263] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,41865,1689855028765' ***** 2023-07-20 12:13:19,312 DEBUG [Listener at jenkins-hbase4.apache.org/34263] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 12:13:19,312 INFO [Listener at jenkins-hbase4.apache.org/34263] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-20 12:13:19,312 INFO [Listener at jenkins-hbase4.apache.org/34263] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39003,1689855028825' ***** 2023-07-20 12:13:19,312 DEBUG [Listener at jenkins-hbase4.apache.org/34263] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 12:13:19,312 INFO [Listener at jenkins-hbase4.apache.org/34263] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-20 12:13:19,312 INFO [Listener at jenkins-hbase4.apache.org/34263] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43611,1689855028889' ***** 2023-07-20 12:13:19,312 DEBUG [Listener at jenkins-hbase4.apache.org/34263] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 12:13:19,312 INFO [Listener at jenkins-hbase4.apache.org/34263] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-20 12:13:19,313 INFO [RS:2;jenkins-hbase4:43611] regionserver.HeapMemoryManager(220): Stopping 2023-07-20 12:13:19,313 INFO [RS:2;jenkins-hbase4:43611] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-20 12:13:19,313 INFO [RS:2;jenkins-hbase4:43611] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-20 12:13:19,314 INFO [RS:2;jenkins-hbase4:43611] regionserver.HRegionServer(3305): Received CLOSE for f1ce01a510a04cc69fea3d7670ad816b 2023-07-20 12:13:19,314 INFO [RS:2;jenkins-hbase4:43611] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:13:19,314 DEBUG [RS:2;jenkins-hbase4:43611] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5deae49f to 127.0.0.1:59849 2023-07-20 12:13:19,312 INFO [RS:1;jenkins-hbase4:39003] regionserver.HeapMemoryManager(220): Stopping 2023-07-20 12:13:19,316 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-20 12:13:19,316 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-20 12:13:19,316 DEBUG [RS:2;jenkins-hbase4:43611] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 12:13:19,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f1ce01a510a04cc69fea3d7670ad816b, disabling compactions & flushes 2023-07-20 12:13:19,313 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-20 12:13:19,313 INFO [RS:0;jenkins-hbase4:41865] regionserver.HeapMemoryManager(220): Stopping 2023-07-20 12:13:19,319 INFO [RS:0;jenkins-hbase4:41865] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-20 12:13:19,319 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689855032589.f1ce01a510a04cc69fea3d7670ad816b. 2023-07-20 12:13:19,319 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-20 12:13:19,318 INFO [RS:2;jenkins-hbase4:43611] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-20 12:13:19,319 DEBUG [RS:2;jenkins-hbase4:43611] regionserver.HRegionServer(1478): Online Regions={f1ce01a510a04cc69fea3d7670ad816b=hbase:acl,,1689855032589.f1ce01a510a04cc69fea3d7670ad816b.} 2023-07-20 12:13:19,320 DEBUG [RS:2;jenkins-hbase4:43611] regionserver.HRegionServer(1504): Waiting on f1ce01a510a04cc69fea3d7670ad816b 2023-07-20 12:13:19,316 INFO [RS:1;jenkins-hbase4:39003] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-20 12:13:19,320 INFO [RS:1;jenkins-hbase4:39003] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-20 12:13:19,319 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 12:13:19,319 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689855032589.f1ce01a510a04cc69fea3d7670ad816b. 2023-07-20 12:13:19,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689855032589.f1ce01a510a04cc69fea3d7670ad816b. after waiting 0 ms 2023-07-20 12:13:19,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689855032589.f1ce01a510a04cc69fea3d7670ad816b. 2023-07-20 12:13:19,321 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing f1ce01a510a04cc69fea3d7670ad816b 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-20 12:13:19,319 INFO [RS:0;jenkins-hbase4:41865] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-20 12:13:19,320 INFO [RS:1;jenkins-hbase4:39003] regionserver.HRegionServer(3305): Received CLOSE for ace36fd6302cf0989f2fd79aaf8b3f5d 2023-07-20 12:13:19,322 INFO [RS:1;jenkins-hbase4:39003] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:13:19,322 DEBUG [RS:1;jenkins-hbase4:39003] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33a2ea7f to 127.0.0.1:59849 2023-07-20 12:13:19,322 DEBUG [RS:1;jenkins-hbase4:39003] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 12:13:19,322 INFO [RS:0;jenkins-hbase4:41865] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:13:19,323 DEBUG [RS:0;jenkins-hbase4:41865] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7cd5a480 to 127.0.0.1:59849 2023-07-20 12:13:19,323 DEBUG [RS:0;jenkins-hbase4:41865] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 12:13:19,327 INFO [RS:1;jenkins-hbase4:39003] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-20 12:13:19,341 DEBUG [RS:1;jenkins-hbase4:39003] regionserver.HRegionServer(1478): Online Regions={ace36fd6302cf0989f2fd79aaf8b3f5d=hbase:namespace,,1689855031820.ace36fd6302cf0989f2fd79aaf8b3f5d.} 2023-07-20 12:13:19,341 DEBUG [RS:1;jenkins-hbase4:39003] regionserver.HRegionServer(1504): Waiting on ace36fd6302cf0989f2fd79aaf8b3f5d 2023-07-20 12:13:19,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ace36fd6302cf0989f2fd79aaf8b3f5d, disabling compactions & flushes 2023-07-20 12:13:19,339 INFO [RS:0;jenkins-hbase4:41865] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-20 12:13:19,341 INFO [RS:0;jenkins-hbase4:41865] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-20 12:13:19,341 INFO [RS:0;jenkins-hbase4:41865] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-20 12:13:19,342 INFO [RS:0;jenkins-hbase4:41865] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-20 12:13:19,341 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689855031820.ace36fd6302cf0989f2fd79aaf8b3f5d. 2023-07-20 12:13:19,342 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689855031820.ace36fd6302cf0989f2fd79aaf8b3f5d. 2023-07-20 12:13:19,342 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689855031820.ace36fd6302cf0989f2fd79aaf8b3f5d. after waiting 0 ms 2023-07-20 12:13:19,342 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689855031820.ace36fd6302cf0989f2fd79aaf8b3f5d. 2023-07-20 12:13:19,342 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing ace36fd6302cf0989f2fd79aaf8b3f5d 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-20 12:13:19,349 INFO [RS:0;jenkins-hbase4:41865] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-20 12:13:19,349 DEBUG [RS:0;jenkins-hbase4:41865] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-20 12:13:19,349 DEBUG [RS:0;jenkins-hbase4:41865] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-20 12:13:19,365 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-20 12:13:19,366 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-20 12:13:19,375 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-20 12:13:19,376 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-20 12:13:19,376 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-20 12:13:19,377 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-20 12:13:19,377 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-20 12:13:19,377 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-20 12:13:19,377 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-20 12:13:19,496 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/acl/f1ce01a510a04cc69fea3d7670ad816b/.tmp/l/743b419e068141179deab46e318386d5 2023-07-20 12:13:19,496 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/namespace/ace36fd6302cf0989f2fd79aaf8b3f5d/.tmp/info/9a4be876370c4161be26ac33355d17e5 2023-07-20 12:13:19,501 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/meta/1588230740/.tmp/info/4b66ad50c3d146919d425b9410f6e81f 2023-07-20 12:13:19,501 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 743b419e068141179deab46e318386d5 2023-07-20 12:13:19,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/acl/f1ce01a510a04cc69fea3d7670ad816b/.tmp/l/743b419e068141179deab46e318386d5 as hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/acl/f1ce01a510a04cc69fea3d7670ad816b/l/743b419e068141179deab46e318386d5 2023-07-20 12:13:19,507 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4b66ad50c3d146919d425b9410f6e81f 2023-07-20 12:13:19,508 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 743b419e068141179deab46e318386d5 2023-07-20 12:13:19,508 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/acl/f1ce01a510a04cc69fea3d7670ad816b/l/743b419e068141179deab46e318386d5, entries=7, sequenceid=18, filesize=5.2 K 2023-07-20 12:13:19,509 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for f1ce01a510a04cc69fea3d7670ad816b in 188ms, sequenceid=18, compaction requested=false 2023-07-20 12:13:19,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/namespace/ace36fd6302cf0989f2fd79aaf8b3f5d/.tmp/info/9a4be876370c4161be26ac33355d17e5 as hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/namespace/ace36fd6302cf0989f2fd79aaf8b3f5d/info/9a4be876370c4161be26ac33355d17e5 2023-07-20 12:13:19,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/acl/f1ce01a510a04cc69fea3d7670ad816b/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-20 12:13:19,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 12:13:19,519 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689855032589.f1ce01a510a04cc69fea3d7670ad816b. 2023-07-20 12:13:19,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f1ce01a510a04cc69fea3d7670ad816b: 2023-07-20 12:13:19,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689855032589.f1ce01a510a04cc69fea3d7670ad816b. 2023-07-20 12:13:19,520 INFO [RS:2;jenkins-hbase4:43611] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43611,1689855028889; all regions closed. 2023-07-20 12:13:19,531 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/meta/1588230740/.tmp/rep_barrier/0324dd25cf3f4e888291825959ce92fc 2023-07-20 12:13:19,533 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/namespace/ace36fd6302cf0989f2fd79aaf8b3f5d/info/9a4be876370c4161be26ac33355d17e5, entries=2, sequenceid=6, filesize=4.8 K 2023-07-20 12:13:19,534 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for ace36fd6302cf0989f2fd79aaf8b3f5d in 192ms, sequenceid=6, compaction requested=false 2023-07-20 12:13:19,537 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0324dd25cf3f4e888291825959ce92fc 2023-07-20 12:13:19,542 DEBUG [RS:1;jenkins-hbase4:39003] regionserver.HRegionServer(1504): Waiting on ace36fd6302cf0989f2fd79aaf8b3f5d 2023-07-20 12:13:19,550 DEBUG [RS:0;jenkins-hbase4:41865] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-20 12:13:19,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/namespace/ace36fd6302cf0989f2fd79aaf8b3f5d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 12:13:19,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 12:13:19,560 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689855031820.ace36fd6302cf0989f2fd79aaf8b3f5d. 2023-07-20 12:13:19,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ace36fd6302cf0989f2fd79aaf8b3f5d: 2023-07-20 12:13:19,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689855031820.ace36fd6302cf0989f2fd79aaf8b3f5d. 2023-07-20 12:13:19,573 DEBUG [RS:2;jenkins-hbase4:43611] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/oldWALs 2023-07-20 12:13:19,573 INFO [RS:2;jenkins-hbase4:43611] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43611%2C1689855028889:(num 1689855031103) 2023-07-20 12:13:19,573 DEBUG [RS:2;jenkins-hbase4:43611] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 12:13:19,573 INFO [RS:2;jenkins-hbase4:43611] regionserver.LeaseManager(133): Closed leases 2023-07-20 12:13:19,575 INFO [RS:2;jenkins-hbase4:43611] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-20 12:13:19,575 INFO [RS:2;jenkins-hbase4:43611] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-20 12:13:19,575 INFO [RS:2;jenkins-hbase4:43611] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-20 12:13:19,575 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-20 12:13:19,575 INFO [RS:2;jenkins-hbase4:43611] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-20 12:13:19,580 INFO [RS:2;jenkins-hbase4:43611] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43611 2023-07-20 12:13:19,583 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/meta/1588230740/.tmp/table/b122495f2f654bebad4940469c2f0323 2023-07-20 12:13:19,588 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b122495f2f654bebad4940469c2f0323 2023-07-20 12:13:19,589 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/meta/1588230740/.tmp/info/4b66ad50c3d146919d425b9410f6e81f as hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/meta/1588230740/info/4b66ad50c3d146919d425b9410f6e81f 2023-07-20 12:13:19,590 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:13:19,591 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 12:13:19,591 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:13:19,591 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 12:13:19,591 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43611,1689855028889 2023-07-20 12:13:19,591 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 12:13:19,591 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 12:13:19,594 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43611,1689855028889] 2023-07-20 12:13:19,595 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43611,1689855028889; numProcessing=1 2023-07-20 12:13:19,597 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43611,1689855028889 already deleted, retry=false 2023-07-20 12:13:19,597 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43611,1689855028889 expired; onlineServers=2 2023-07-20 12:13:19,597 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4b66ad50c3d146919d425b9410f6e81f 2023-07-20 12:13:19,597 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/meta/1588230740/info/4b66ad50c3d146919d425b9410f6e81f, entries=48, sequenceid=131, filesize=10.3 K 2023-07-20 12:13:19,598 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/meta/1588230740/.tmp/rep_barrier/0324dd25cf3f4e888291825959ce92fc as hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/meta/1588230740/rep_barrier/0324dd25cf3f4e888291825959ce92fc 2023-07-20 12:13:19,604 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0324dd25cf3f4e888291825959ce92fc 2023-07-20 12:13:19,604 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/meta/1588230740/rep_barrier/0324dd25cf3f4e888291825959ce92fc, entries=13, sequenceid=131, filesize=6.4 K 2023-07-20 12:13:19,605 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/meta/1588230740/.tmp/table/b122495f2f654bebad4940469c2f0323 as hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/meta/1588230740/table/b122495f2f654bebad4940469c2f0323 2023-07-20 12:13:19,610 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b122495f2f654bebad4940469c2f0323 2023-07-20 12:13:19,610 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/meta/1588230740/table/b122495f2f654bebad4940469c2f0323, entries=24, sequenceid=131, filesize=6.9 K 2023-07-20 12:13:19,615 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 238ms, sequenceid=131, compaction requested=false 2023-07-20 12:13:19,665 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-20 12:13:19,667 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 12:13:19,667 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-20 12:13:19,668 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-20 12:13:19,668 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-20 12:13:19,669 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-20 12:13:19,695 INFO [RS:2;jenkins-hbase4:43611] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43611,1689855028889; zookeeper connection closed. 2023-07-20 12:13:19,695 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 12:13:19,695 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:43611-0x10182a3e70e0003, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 12:13:19,699 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@28e51d36] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@28e51d36 2023-07-20 12:13:19,743 INFO [RS:1;jenkins-hbase4:39003] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39003,1689855028825; all regions closed. 2023-07-20 12:13:19,750 INFO [RS:0;jenkins-hbase4:41865] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,41865,1689855028765; all regions closed. 2023-07-20 12:13:19,755 DEBUG [RS:1;jenkins-hbase4:39003] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/oldWALs 2023-07-20 12:13:19,755 INFO [RS:1;jenkins-hbase4:39003] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39003%2C1689855028825:(num 1689855031117) 2023-07-20 12:13:19,755 DEBUG [RS:1;jenkins-hbase4:39003] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 12:13:19,755 INFO [RS:1;jenkins-hbase4:39003] regionserver.LeaseManager(133): Closed leases 2023-07-20 12:13:19,759 INFO [RS:1;jenkins-hbase4:39003] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-20 12:13:19,761 INFO [RS:1;jenkins-hbase4:39003] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-20 12:13:19,761 INFO [RS:1;jenkins-hbase4:39003] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-20 12:13:19,761 INFO [RS:1;jenkins-hbase4:39003] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-20 12:13:19,762 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-20 12:13:19,763 INFO [RS:1;jenkins-hbase4:39003] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39003 2023-07-20 12:13:19,765 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/WALs/jenkins-hbase4.apache.org,41865,1689855028765/jenkins-hbase4.apache.org%2C41865%2C1689855028765.meta.1689855031467.meta not finished, retry = 0 2023-07-20 12:13:19,766 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:13:19,766 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 12:13:19,766 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39003,1689855028825 2023-07-20 12:13:19,768 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39003,1689855028825] 2023-07-20 12:13:19,769 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39003,1689855028825; numProcessing=2 2023-07-20 12:13:19,868 DEBUG [RS:0;jenkins-hbase4:41865] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/oldWALs 2023-07-20 12:13:19,868 INFO [RS:0;jenkins-hbase4:41865] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41865%2C1689855028765.meta:.meta(num 1689855031467) 2023-07-20 12:13:19,869 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 12:13:19,869 INFO [RS:1;jenkins-hbase4:39003] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39003,1689855028825; zookeeper connection closed. 2023-07-20 12:13:19,869 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:39003-0x10182a3e70e0002, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 12:13:19,869 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@41cba284] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@41cba284 2023-07-20 12:13:19,871 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39003,1689855028825 already deleted, retry=false 2023-07-20 12:13:19,871 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39003,1689855028825 expired; onlineServers=1 2023-07-20 12:13:19,873 DEBUG [RS:0;jenkins-hbase4:41865] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/oldWALs 2023-07-20 12:13:19,873 INFO [RS:0;jenkins-hbase4:41865] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41865%2C1689855028765:(num 1689855031101) 2023-07-20 12:13:19,873 DEBUG [RS:0;jenkins-hbase4:41865] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 12:13:19,873 INFO [RS:0;jenkins-hbase4:41865] regionserver.LeaseManager(133): Closed leases 2023-07-20 12:13:19,874 INFO [RS:0;jenkins-hbase4:41865] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-20 12:13:19,874 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-20 12:13:19,876 INFO [RS:0;jenkins-hbase4:41865] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41865 2023-07-20 12:13:19,878 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 12:13:19,878 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41865,1689855028765 2023-07-20 12:13:19,882 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41865,1689855028765] 2023-07-20 12:13:19,882 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41865,1689855028765; numProcessing=3 2023-07-20 12:13:19,888 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41865,1689855028765 already deleted, retry=false 2023-07-20 12:13:19,888 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41865,1689855028765 expired; onlineServers=0 2023-07-20 12:13:19,889 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46247,1689855027157' ***** 2023-07-20 12:13:19,889 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-20 12:13:19,889 DEBUG [M:0;jenkins-hbase4:46247] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@54504de1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-20 12:13:19,889 INFO [M:0;jenkins-hbase4:46247] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46247,1689855027157 2023-07-20 12:13:19,889 INFO [M:0;jenkins-hbase4:46247] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46247,1689855027157; all regions closed. 2023-07-20 12:13:19,889 DEBUG [M:0;jenkins-hbase4:46247] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 12:13:19,889 DEBUG [M:0;jenkins-hbase4:46247] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-20 12:13:19,889 DEBUG [M:0;jenkins-hbase4:46247] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-20 12:13:19,890 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689855030573] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689855030573,5,FailOnTimeoutGroup] 2023-07-20 12:13:19,890 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689855030575] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689855030575,5,FailOnTimeoutGroup] 2023-07-20 12:13:19,890 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-20 12:13:19,890 INFO [M:0;jenkins-hbase4:46247] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-20 12:13:19,890 INFO [M:0;jenkins-hbase4:46247] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-20 12:13:19,890 INFO [M:0;jenkins-hbase4:46247] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-20 12:13:19,890 DEBUG [M:0;jenkins-hbase4:46247] master.HMaster(1512): Stopping service threads 2023-07-20 12:13:19,891 INFO [M:0;jenkins-hbase4:46247] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-20 12:13:19,891 ERROR [M:0;jenkins-hbase4:46247] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-20 12:13:19,892 INFO [M:0;jenkins-hbase4:46247] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-20 12:13:19,892 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-20 12:13:19,985 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 12:13:19,985 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): regionserver:41865-0x10182a3e70e0001, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 12:13:19,985 INFO [RS:0;jenkins-hbase4:41865] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,41865,1689855028765; zookeeper connection closed. 2023-07-20 12:13:19,987 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7dcacde4] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7dcacde4 2023-07-20 12:13:19,987 INFO [Listener at jenkins-hbase4.apache.org/34263] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-20 12:13:19,988 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-20 12:13:19,988 INFO [M:0;jenkins-hbase4:46247] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-20 12:13:19,988 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 12:13:19,988 INFO [M:0;jenkins-hbase4:46247] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-20 12:13:19,989 DEBUG [M:0;jenkins-hbase4:46247] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-20 12:13:19,989 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-20 12:13:19,989 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/master already deleted, retry=false 2023-07-20 12:13:19,989 INFO [M:0;jenkins-hbase4:46247] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 12:13:19,989 DEBUG [M:0;jenkins-hbase4:46247] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 12:13:19,989 DEBUG [RegionServerTracker-0] master.ActiveMasterManager(335): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Failed delete of our master address node; KeeperErrorCode = NoNode for /hbase/master 2023-07-20 12:13:19,989 DEBUG [M:0;jenkins-hbase4:46247] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-20 12:13:19,990 DEBUG [M:0;jenkins-hbase4:46247] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 12:13:19,990 INFO [M:0;jenkins-hbase4:46247] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.64 KB heapSize=451.91 KB 2023-07-20 12:13:20,012 INFO [M:0;jenkins-hbase4:46247] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.64 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6df4a0c410b64c7d816b638b061df55e 2023-07-20 12:13:20,016 INFO [M:0;jenkins-hbase4:46247] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6df4a0c410b64c7d816b638b061df55e 2023-07-20 12:13:20,017 DEBUG [M:0;jenkins-hbase4:46247] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6df4a0c410b64c7d816b638b061df55e as hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6df4a0c410b64c7d816b638b061df55e 2023-07-20 12:13:20,022 INFO [M:0;jenkins-hbase4:46247] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6df4a0c410b64c7d816b638b061df55e 2023-07-20 12:13:20,022 INFO [M:0;jenkins-hbase4:46247] regionserver.HStore(1080): Added hdfs://localhost:37499/user/jenkins/test-data/9da2aa48-ee37-a9f1-e361-e4df22fa5ecc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6df4a0c410b64c7d816b638b061df55e, entries=119, sequenceid=899, filesize=28.6 K 2023-07-20 12:13:20,023 INFO [M:0;jenkins-hbase4:46247] regionserver.HRegion(2948): Finished flush of dataSize ~375.64 KB/384652, heapSize ~451.90 KB/462744, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 33ms, sequenceid=899, compaction requested=false 2023-07-20 12:13:20,025 INFO [M:0;jenkins-hbase4:46247] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 12:13:20,025 DEBUG [M:0;jenkins-hbase4:46247] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-20 12:13:20,029 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-20 12:13:20,029 INFO [M:0;jenkins-hbase4:46247] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-20 12:13:20,030 INFO [M:0;jenkins-hbase4:46247] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46247 2023-07-20 12:13:20,032 DEBUG [M:0;jenkins-hbase4:46247] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,46247,1689855027157 already deleted, retry=false 2023-07-20 12:13:20,135 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 12:13:20,135 INFO [M:0;jenkins-hbase4:46247] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46247,1689855027157; zookeeper connection closed. 2023-07-20 12:13:20,135 DEBUG [Listener at localhost/39119-EventThread] zookeeper.ZKWatcher(600): master:46247-0x10182a3e70e0000, quorum=127.0.0.1:59849, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 12:13:20,137 WARN [Listener at jenkins-hbase4.apache.org/34263] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-20 12:13:20,145 INFO [Listener at jenkins-hbase4.apache.org/34263] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-20 12:13:20,253 WARN [BP-2106797616-172.31.14.131-1689855022221 heartbeating to localhost/127.0.0.1:37499] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-20 12:13:20,253 WARN [BP-2106797616-172.31.14.131-1689855022221 heartbeating to localhost/127.0.0.1:37499] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2106797616-172.31.14.131-1689855022221 (Datanode Uuid a44f1ad5-183f-40ac-8f6b-893082a89699) service to localhost/127.0.0.1:37499 2023-07-20 12:13:20,256 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/cluster_516f25e7-6d47-16d0-f492-9f19a2a0360c/dfs/data/data5/current/BP-2106797616-172.31.14.131-1689855022221] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-20 12:13:20,256 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/cluster_516f25e7-6d47-16d0-f492-9f19a2a0360c/dfs/data/data6/current/BP-2106797616-172.31.14.131-1689855022221] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-20 12:13:20,259 WARN [Listener at jenkins-hbase4.apache.org/34263] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-20 12:13:20,282 INFO [Listener at jenkins-hbase4.apache.org/34263] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-20 12:13:20,391 WARN [BP-2106797616-172.31.14.131-1689855022221 heartbeating to localhost/127.0.0.1:37499] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-20 12:13:20,391 WARN [BP-2106797616-172.31.14.131-1689855022221 heartbeating to localhost/127.0.0.1:37499] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2106797616-172.31.14.131-1689855022221 (Datanode Uuid aaa995f7-8b66-4bfe-bda3-962061aec446) service to localhost/127.0.0.1:37499 2023-07-20 12:13:20,392 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/cluster_516f25e7-6d47-16d0-f492-9f19a2a0360c/dfs/data/data3/current/BP-2106797616-172.31.14.131-1689855022221] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-20 12:13:20,393 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/cluster_516f25e7-6d47-16d0-f492-9f19a2a0360c/dfs/data/data4/current/BP-2106797616-172.31.14.131-1689855022221] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-20 12:13:20,394 WARN [Listener at jenkins-hbase4.apache.org/34263] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-20 12:13:20,408 INFO [Listener at jenkins-hbase4.apache.org/34263] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-20 12:13:20,511 WARN [BP-2106797616-172.31.14.131-1689855022221 heartbeating to localhost/127.0.0.1:37499] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-20 12:13:20,511 WARN [BP-2106797616-172.31.14.131-1689855022221 heartbeating to localhost/127.0.0.1:37499] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2106797616-172.31.14.131-1689855022221 (Datanode Uuid 6896c29f-600a-471c-b7e5-7087f9722f48) service to localhost/127.0.0.1:37499 2023-07-20 12:13:20,511 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/cluster_516f25e7-6d47-16d0-f492-9f19a2a0360c/dfs/data/data1/current/BP-2106797616-172.31.14.131-1689855022221] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-20 12:13:20,512 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d36f3a3b-3b9a-48ae-c402-aafca69485f1/cluster_516f25e7-6d47-16d0-f492-9f19a2a0360c/dfs/data/data2/current/BP-2106797616-172.31.14.131-1689855022221] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-20 12:13:20,547 INFO [Listener at jenkins-hbase4.apache.org/34263] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-20 12:13:20,674 INFO [Listener at jenkins-hbase4.apache.org/34263] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-20 12:13:20,780 INFO [Listener at jenkins-hbase4.apache.org/34263] hbase.HBaseTestingUtility(1293): Minicluster is down