2023-07-19 19:10:28,180 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-19 19:10:28,458 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31 2023-07-19 19:10:28,458 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-19 19:10:28,459 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-19 19:10:28,502 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-19 19:10:28,789 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-19 19:10:28,789 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/cluster_2c362217-96ff-d8ab-49ae-f9e6c2163f5d, deleteOnExit=true 2023-07-19 19:10:28,790 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-19 19:10:28,791 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/test.cache.data in system properties and HBase conf 2023-07-19 19:10:28,791 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/hadoop.tmp.dir in system properties and HBase conf 2023-07-19 19:10:28,792 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/hadoop.log.dir in system properties and HBase conf 2023-07-19 19:10:28,792 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-19 19:10:28,793 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-19 19:10:28,793 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-19 19:10:29,175 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-19 19:10:29,181 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-19 19:10:29,181 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-19 19:10:29,182 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-19 19:10:29,182 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 19:10:29,182 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-19 19:10:29,183 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-19 19:10:29,183 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 19:10:29,184 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 19:10:29,184 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-19 19:10:29,185 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/nfs.dump.dir in system properties and HBase conf 2023-07-19 19:10:29,185 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/java.io.tmpdir in system properties and HBase conf 2023-07-19 19:10:29,186 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 19:10:29,186 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-19 19:10:29,186 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-19 19:10:29,835 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-19 19:10:29,839 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-19 19:10:30,119 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-19 19:10:30,309 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-19 19:10:30,326 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 19:10:30,373 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 19:10:30,420 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/java.io.tmpdir/Jetty_localhost_38513_hdfs____.wyxtxg/webapp 2023-07-19 19:10:30,576 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38513 2023-07-19 19:10:30,620 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-19 19:10:30,620 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-19 19:10:31,199 WARN [Listener at localhost/43367] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 19:10:31,296 WARN [Listener at localhost/43367] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-19 19:10:31,319 WARN [Listener at localhost/43367] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 19:10:31,325 INFO [Listener at localhost/43367] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 19:10:31,331 INFO [Listener at localhost/43367] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/java.io.tmpdir/Jetty_localhost_42805_datanode____tdx4di/webapp 2023-07-19 19:10:31,528 INFO [Listener at localhost/43367] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42805 2023-07-19 19:10:32,032 WARN [Listener at localhost/38767] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 19:10:32,080 WARN [Listener at localhost/38767] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-19 19:10:32,087 WARN [Listener at localhost/38767] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 19:10:32,090 INFO [Listener at localhost/38767] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 19:10:32,096 INFO [Listener at localhost/38767] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/java.io.tmpdir/Jetty_localhost_33447_datanode____.294h1e/webapp 2023-07-19 19:10:32,241 INFO [Listener at localhost/38767] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33447 2023-07-19 19:10:32,279 WARN [Listener at localhost/42427] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 19:10:32,307 WARN [Listener at localhost/42427] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-19 19:10:32,313 WARN [Listener at localhost/42427] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 19:10:32,315 INFO [Listener at localhost/42427] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 19:10:32,320 INFO [Listener at localhost/42427] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/java.io.tmpdir/Jetty_localhost_36609_datanode____.p0dqjh/webapp 2023-07-19 19:10:32,491 INFO [Listener at localhost/42427] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36609 2023-07-19 19:10:32,528 WARN [Listener at localhost/44441] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 19:10:32,828 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5640f816ff06060d: Processing first storage report for DS-69ffe6d3-e676-4fb0-a969-9397d66c3a3b from datanode 0661f3f7-036d-4d35-897b-d1f78df5bfb0 2023-07-19 19:10:32,830 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5640f816ff06060d: from storage DS-69ffe6d3-e676-4fb0-a969-9397d66c3a3b node DatanodeRegistration(127.0.0.1:44807, datanodeUuid=0661f3f7-036d-4d35-897b-d1f78df5bfb0, infoPort=41227, infoSecurePort=0, ipcPort=42427, storageInfo=lv=-57;cid=testClusterID;nsid=55365292;c=1689793829911), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-19 19:10:32,830 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4bffca7e06663e7c: Processing first storage report for DS-121a7470-b792-4a57-bd19-68fc575d0061 from datanode d5f7c849-9e9c-4d44-b929-f627d4d1fc35 2023-07-19 19:10:32,830 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4bffca7e06663e7c: from storage DS-121a7470-b792-4a57-bd19-68fc575d0061 node DatanodeRegistration(127.0.0.1:32977, datanodeUuid=d5f7c849-9e9c-4d44-b929-f627d4d1fc35, infoPort=35607, infoSecurePort=0, ipcPort=44441, storageInfo=lv=-57;cid=testClusterID;nsid=55365292;c=1689793829911), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 19:10:32,830 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5640f816ff06060d: Processing first storage report for DS-14207f1d-7d0f-40cc-a7fc-373a047f2ccf from datanode 0661f3f7-036d-4d35-897b-d1f78df5bfb0 2023-07-19 19:10:32,831 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5640f816ff06060d: from storage DS-14207f1d-7d0f-40cc-a7fc-373a047f2ccf node DatanodeRegistration(127.0.0.1:44807, datanodeUuid=0661f3f7-036d-4d35-897b-d1f78df5bfb0, infoPort=41227, infoSecurePort=0, ipcPort=42427, storageInfo=lv=-57;cid=testClusterID;nsid=55365292;c=1689793829911), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-19 19:10:32,831 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4bffca7e06663e7c: Processing first storage report for DS-8677be71-918e-403e-8ba4-1bea384ea808 from datanode d5f7c849-9e9c-4d44-b929-f627d4d1fc35 2023-07-19 19:10:32,831 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4bffca7e06663e7c: from storage DS-8677be71-918e-403e-8ba4-1bea384ea808 node DatanodeRegistration(127.0.0.1:32977, datanodeUuid=d5f7c849-9e9c-4d44-b929-f627d4d1fc35, infoPort=35607, infoSecurePort=0, ipcPort=44441, storageInfo=lv=-57;cid=testClusterID;nsid=55365292;c=1689793829911), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 19:10:32,831 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe7fea370d3c8d70c: Processing first storage report for DS-3e6e52f1-8ece-4571-a362-2d1d72958a63 from datanode 5456848f-aac7-4428-8ab3-8bf0c283644f 2023-07-19 19:10:32,831 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe7fea370d3c8d70c: from storage DS-3e6e52f1-8ece-4571-a362-2d1d72958a63 node DatanodeRegistration(127.0.0.1:33585, datanodeUuid=5456848f-aac7-4428-8ab3-8bf0c283644f, infoPort=38381, infoSecurePort=0, ipcPort=38767, storageInfo=lv=-57;cid=testClusterID;nsid=55365292;c=1689793829911), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 19:10:32,832 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe7fea370d3c8d70c: Processing first storage report for DS-e301d374-5a91-4864-b2f0-75941d9d5e0b from datanode 5456848f-aac7-4428-8ab3-8bf0c283644f 2023-07-19 19:10:32,832 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe7fea370d3c8d70c: from storage DS-e301d374-5a91-4864-b2f0-75941d9d5e0b node DatanodeRegistration(127.0.0.1:33585, datanodeUuid=5456848f-aac7-4428-8ab3-8bf0c283644f, infoPort=38381, infoSecurePort=0, ipcPort=38767, storageInfo=lv=-57;cid=testClusterID;nsid=55365292;c=1689793829911), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 19:10:33,003 DEBUG [Listener at localhost/44441] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31 2023-07-19 19:10:33,108 INFO [Listener at localhost/44441] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/cluster_2c362217-96ff-d8ab-49ae-f9e6c2163f5d/zookeeper_0, clientPort=58293, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/cluster_2c362217-96ff-d8ab-49ae-f9e6c2163f5d/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/cluster_2c362217-96ff-d8ab-49ae-f9e6c2163f5d/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-19 19:10:33,130 INFO [Listener at localhost/44441] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58293 2023-07-19 19:10:33,142 INFO [Listener at localhost/44441] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 19:10:33,145 INFO [Listener at localhost/44441] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 19:10:33,826 INFO [Listener at localhost/44441] util.FSUtils(471): Created version file at hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978 with version=8 2023-07-19 19:10:33,826 INFO [Listener at localhost/44441] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/hbase-staging 2023-07-19 19:10:34,214 INFO [Listener at localhost/44441] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-19 19:10:34,928 INFO [Listener at localhost/44441] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 19:10:34,962 INFO [Listener at localhost/44441] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 19:10:34,962 INFO [Listener at localhost/44441] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 19:10:34,962 INFO [Listener at localhost/44441] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 19:10:34,963 INFO [Listener at localhost/44441] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 19:10:34,963 INFO [Listener at localhost/44441] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 19:10:35,145 INFO [Listener at localhost/44441] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 19:10:35,237 DEBUG [Listener at localhost/44441] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-19 19:10:35,345 INFO [Listener at localhost/44441] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37769 2023-07-19 19:10:35,360 INFO [Listener at localhost/44441] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 19:10:35,362 INFO [Listener at localhost/44441] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 19:10:35,391 INFO [Listener at localhost/44441] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37769 connecting to ZooKeeper ensemble=127.0.0.1:58293 2023-07-19 19:10:35,450 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:377690x0, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 19:10:35,455 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:37769-0x1017efe2b740000 connected 2023-07-19 19:10:35,490 DEBUG [Listener at localhost/44441] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 19:10:35,491 DEBUG [Listener at localhost/44441] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 19:10:35,506 DEBUG [Listener at localhost/44441] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 19:10:35,515 DEBUG [Listener at localhost/44441] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37769 2023-07-19 19:10:35,515 DEBUG [Listener at localhost/44441] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37769 2023-07-19 19:10:35,516 DEBUG [Listener at localhost/44441] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37769 2023-07-19 19:10:35,518 DEBUG [Listener at localhost/44441] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37769 2023-07-19 19:10:35,518 DEBUG [Listener at localhost/44441] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37769 2023-07-19 19:10:35,525 INFO [Listener at localhost/44441] master.HMaster(444): hbase.rootdir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978, hbase.cluster.distributed=false 2023-07-19 19:10:35,595 INFO [Listener at localhost/44441] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 19:10:35,595 INFO [Listener at localhost/44441] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 19:10:35,596 INFO [Listener at localhost/44441] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 19:10:35,596 INFO [Listener at localhost/44441] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 19:10:35,596 INFO [Listener at localhost/44441] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 19:10:35,596 INFO [Listener at localhost/44441] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 19:10:35,601 INFO [Listener at localhost/44441] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 19:10:35,608 INFO [Listener at localhost/44441] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46111 2023-07-19 19:10:35,610 INFO [Listener at localhost/44441] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-19 19:10:35,618 INFO [Listener at localhost/44441] mob.MobFileCache(124): MobFileCache disabled 2023-07-19 19:10:35,619 INFO [Listener at localhost/44441] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 19:10:35,621 INFO [Listener at localhost/44441] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 19:10:35,623 INFO [Listener at localhost/44441] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46111 connecting to ZooKeeper ensemble=127.0.0.1:58293 2023-07-19 19:10:35,630 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:461110x0, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 19:10:35,631 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46111-0x1017efe2b740001 connected 2023-07-19 19:10:35,631 DEBUG [Listener at localhost/44441] zookeeper.ZKUtil(164): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 19:10:35,633 DEBUG [Listener at localhost/44441] zookeeper.ZKUtil(164): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 19:10:35,634 DEBUG [Listener at localhost/44441] zookeeper.ZKUtil(164): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 19:10:35,640 DEBUG [Listener at localhost/44441] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46111 2023-07-19 19:10:35,641 DEBUG [Listener at localhost/44441] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46111 2023-07-19 19:10:35,646 DEBUG [Listener at localhost/44441] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46111 2023-07-19 19:10:35,653 DEBUG [Listener at localhost/44441] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46111 2023-07-19 19:10:35,653 DEBUG [Listener at localhost/44441] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46111 2023-07-19 19:10:35,673 INFO [Listener at localhost/44441] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 19:10:35,673 INFO [Listener at localhost/44441] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 19:10:35,673 INFO [Listener at localhost/44441] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 19:10:35,674 INFO [Listener at localhost/44441] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 19:10:35,674 INFO [Listener at localhost/44441] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 19:10:35,674 INFO [Listener at localhost/44441] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 19:10:35,675 INFO [Listener at localhost/44441] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 19:10:35,679 INFO [Listener at localhost/44441] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45693 2023-07-19 19:10:35,680 INFO [Listener at localhost/44441] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-19 19:10:35,681 INFO [Listener at localhost/44441] mob.MobFileCache(124): MobFileCache disabled 2023-07-19 19:10:35,682 INFO [Listener at localhost/44441] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 19:10:35,685 INFO [Listener at localhost/44441] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 19:10:35,688 INFO [Listener at localhost/44441] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45693 connecting to ZooKeeper ensemble=127.0.0.1:58293 2023-07-19 19:10:35,703 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:456930x0, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 19:10:35,704 DEBUG [Listener at localhost/44441] zookeeper.ZKUtil(164): regionserver:456930x0, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 19:10:35,705 DEBUG [Listener at localhost/44441] zookeeper.ZKUtil(164): regionserver:456930x0, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 19:10:35,706 DEBUG [Listener at localhost/44441] zookeeper.ZKUtil(164): regionserver:456930x0, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 19:10:35,707 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45693-0x1017efe2b740002 connected 2023-07-19 19:10:35,710 DEBUG [Listener at localhost/44441] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45693 2023-07-19 19:10:35,711 DEBUG [Listener at localhost/44441] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45693 2023-07-19 19:10:35,711 DEBUG [Listener at localhost/44441] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45693 2023-07-19 19:10:35,713 DEBUG [Listener at localhost/44441] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45693 2023-07-19 19:10:35,717 DEBUG [Listener at localhost/44441] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45693 2023-07-19 19:10:35,732 INFO [Listener at localhost/44441] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 19:10:35,732 INFO [Listener at localhost/44441] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 19:10:35,733 INFO [Listener at localhost/44441] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 19:10:35,733 INFO [Listener at localhost/44441] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 19:10:35,733 INFO [Listener at localhost/44441] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 19:10:35,733 INFO [Listener at localhost/44441] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 19:10:35,733 INFO [Listener at localhost/44441] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 19:10:35,735 INFO [Listener at localhost/44441] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40791 2023-07-19 19:10:35,736 INFO [Listener at localhost/44441] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-19 19:10:35,742 INFO [Listener at localhost/44441] mob.MobFileCache(124): MobFileCache disabled 2023-07-19 19:10:35,743 INFO [Listener at localhost/44441] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 19:10:35,746 INFO [Listener at localhost/44441] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 19:10:35,747 INFO [Listener at localhost/44441] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40791 connecting to ZooKeeper ensemble=127.0.0.1:58293 2023-07-19 19:10:35,754 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:407910x0, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 19:10:35,755 DEBUG [Listener at localhost/44441] zookeeper.ZKUtil(164): regionserver:407910x0, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 19:10:35,756 DEBUG [Listener at localhost/44441] zookeeper.ZKUtil(164): regionserver:407910x0, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 19:10:35,758 DEBUG [Listener at localhost/44441] zookeeper.ZKUtil(164): regionserver:407910x0, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 19:10:35,759 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40791-0x1017efe2b740003 connected 2023-07-19 19:10:35,766 DEBUG [Listener at localhost/44441] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40791 2023-07-19 19:10:35,767 DEBUG [Listener at localhost/44441] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40791 2023-07-19 19:10:35,771 DEBUG [Listener at localhost/44441] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40791 2023-07-19 19:10:35,779 DEBUG [Listener at localhost/44441] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40791 2023-07-19 19:10:35,783 DEBUG [Listener at localhost/44441] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40791 2023-07-19 19:10:35,789 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,37769,1689793834010 2023-07-19 19:10:35,799 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-19 19:10:35,801 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,37769,1689793834010 2023-07-19 19:10:35,824 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 19:10:35,824 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 19:10:35,824 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 19:10:35,825 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 19:10:35,824 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 19:10:35,826 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-19 19:10:35,831 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,37769,1689793834010 from backup master directory 2023-07-19 19:10:35,831 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-19 19:10:35,836 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,37769,1689793834010 2023-07-19 19:10:35,836 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-19 19:10:35,837 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 19:10:35,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,37769,1689793834010 2023-07-19 19:10:35,841 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-19 19:10:35,843 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-19 19:10:36,015 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/hbase.id with ID: d26c932b-9fcb-426e-9afb-d28a5cc5be2e 2023-07-19 19:10:36,083 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 19:10:36,105 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 19:10:36,172 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x1b71b91e to 127.0.0.1:58293 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:10:36,222 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8611c89, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:10:36,255 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 19:10:36,258 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-19 19:10:36,277 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-19 19:10:36,277 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-19 19:10:36,280 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-19 19:10:36,285 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-19 19:10:36,287 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 19:10:36,332 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/MasterData/data/master/store-tmp 2023-07-19 19:10:36,400 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:10:36,400 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-19 19:10:36,400 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 19:10:36,400 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 19:10:36,400 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-19 19:10:36,400 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 19:10:36,400 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 19:10:36,400 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-19 19:10:36,403 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/MasterData/WALs/jenkins-hbase4.apache.org,37769,1689793834010 2023-07-19 19:10:36,436 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37769%2C1689793834010, suffix=, logDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/MasterData/WALs/jenkins-hbase4.apache.org,37769,1689793834010, archiveDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/MasterData/oldWALs, maxLogs=10 2023-07-19 19:10:36,520 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32977,DS-121a7470-b792-4a57-bd19-68fc575d0061,DISK] 2023-07-19 19:10:36,523 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33585,DS-3e6e52f1-8ece-4571-a362-2d1d72958a63,DISK] 2023-07-19 19:10:36,520 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44807,DS-69ffe6d3-e676-4fb0-a969-9397d66c3a3b,DISK] 2023-07-19 19:10:36,532 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-19 19:10:36,619 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/MasterData/WALs/jenkins-hbase4.apache.org,37769,1689793834010/jenkins-hbase4.apache.org%2C37769%2C1689793834010.1689793836448 2023-07-19 19:10:36,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33585,DS-3e6e52f1-8ece-4571-a362-2d1d72958a63,DISK], DatanodeInfoWithStorage[127.0.0.1:44807,DS-69ffe6d3-e676-4fb0-a969-9397d66c3a3b,DISK], DatanodeInfoWithStorage[127.0.0.1:32977,DS-121a7470-b792-4a57-bd19-68fc575d0061,DISK]] 2023-07-19 19:10:36,621 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-19 19:10:36,621 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:10:36,625 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-19 19:10:36,627 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-19 19:10:36,717 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-19 19:10:36,725 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-19 19:10:36,759 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-19 19:10:36,772 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:10:36,780 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-19 19:10:36,783 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-19 19:10:36,801 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-19 19:10:36,808 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 19:10:36,812 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75409155, jitterRate=0.12368397414684296}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 19:10:36,812 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-19 19:10:36,814 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-19 19:10:36,846 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-19 19:10:36,846 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-19 19:10:36,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-19 19:10:36,852 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-19 19:10:36,901 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 48 msec 2023-07-19 19:10:36,901 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-19 19:10:36,935 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-19 19:10:36,942 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-19 19:10:36,967 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-19 19:10:36,973 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-19 19:10:36,975 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-19 19:10:36,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-19 19:10:36,988 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-19 19:10:36,991 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 19:10:36,993 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-19 19:10:36,997 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-19 19:10:37,016 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-19 19:10:37,023 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 19:10:37,023 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 19:10:37,023 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 19:10:37,023 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 19:10:37,023 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 19:10:37,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,37769,1689793834010, sessionid=0x1017efe2b740000, setting cluster-up flag (Was=false) 2023-07-19 19:10:37,050 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 19:10:37,062 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-19 19:10:37,064 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37769,1689793834010 2023-07-19 19:10:37,076 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 19:10:37,082 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-19 19:10:37,083 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37769,1689793834010 2023-07-19 19:10:37,087 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp 2023-07-19 19:10:37,188 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-19 19:10:37,193 INFO [RS:0;jenkins-hbase4:46111] regionserver.HRegionServer(951): ClusterId : d26c932b-9fcb-426e-9afb-d28a5cc5be2e 2023-07-19 19:10:37,193 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:10:37,194 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-19 19:10:37,198 INFO [RS:1;jenkins-hbase4:45693] regionserver.HRegionServer(951): ClusterId : d26c932b-9fcb-426e-9afb-d28a5cc5be2e 2023-07-19 19:10:37,216 INFO [RS:2;jenkins-hbase4:40791] regionserver.HRegionServer(951): ClusterId : d26c932b-9fcb-426e-9afb-d28a5cc5be2e 2023-07-19 19:10:37,224 DEBUG [RS:0;jenkins-hbase4:46111] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-19 19:10:37,224 DEBUG [RS:2;jenkins-hbase4:40791] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-19 19:10:37,224 DEBUG [RS:1;jenkins-hbase4:45693] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-19 19:10:37,241 DEBUG [RS:2;jenkins-hbase4:40791] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-19 19:10:37,242 DEBUG [RS:2;jenkins-hbase4:40791] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-19 19:10:37,241 DEBUG [RS:0;jenkins-hbase4:46111] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-19 19:10:37,243 DEBUG [RS:1;jenkins-hbase4:45693] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-19 19:10:37,243 DEBUG [RS:0;jenkins-hbase4:46111] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-19 19:10:37,243 DEBUG [RS:1;jenkins-hbase4:45693] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-19 19:10:37,246 DEBUG [RS:1;jenkins-hbase4:45693] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-19 19:10:37,246 DEBUG [RS:2;jenkins-hbase4:40791] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-19 19:10:37,248 DEBUG [RS:2;jenkins-hbase4:40791] zookeeper.ReadOnlyZKClient(139): Connect 0x006fef8e to 127.0.0.1:58293 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:10:37,248 DEBUG [RS:0;jenkins-hbase4:46111] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-19 19:10:37,248 DEBUG [RS:1;jenkins-hbase4:45693] zookeeper.ReadOnlyZKClient(139): Connect 0x1be1f3c3 to 127.0.0.1:58293 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:10:37,253 DEBUG [RS:0;jenkins-hbase4:46111] zookeeper.ReadOnlyZKClient(139): Connect 0x0a2eeaea to 127.0.0.1:58293 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:10:37,271 DEBUG [RS:2;jenkins-hbase4:40791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37efdda4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:10:37,272 DEBUG [RS:2;jenkins-hbase4:40791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78c97381, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 19:10:37,276 DEBUG [RS:1;jenkins-hbase4:45693] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@15260ecf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:10:37,276 DEBUG [RS:1;jenkins-hbase4:45693] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@111998b3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 19:10:37,322 DEBUG [RS:2;jenkins-hbase4:40791] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:40791 2023-07-19 19:10:37,324 DEBUG [RS:1;jenkins-hbase4:45693] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:45693 2023-07-19 19:10:37,326 DEBUG [RS:0;jenkins-hbase4:46111] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@51032f6c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:10:37,326 DEBUG [RS:0;jenkins-hbase4:46111] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5924a8be, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 19:10:37,329 INFO [RS:1;jenkins-hbase4:45693] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-19 19:10:37,330 INFO [RS:1;jenkins-hbase4:45693] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-19 19:10:37,329 INFO [RS:2;jenkins-hbase4:40791] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-19 19:10:37,330 INFO [RS:2;jenkins-hbase4:40791] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-19 19:10:37,330 DEBUG [RS:1;jenkins-hbase4:45693] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-19 19:10:37,330 DEBUG [RS:2;jenkins-hbase4:40791] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-19 19:10:37,331 INFO [RS:1;jenkins-hbase4:45693] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:10:37,331 INFO [RS:2;jenkins-hbase4:40791] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:10:37,331 DEBUG [RS:2;jenkins-hbase4:40791] regionserver.HRegionServer(1022): About to register with Master. 2023-07-19 19:10:37,331 DEBUG [RS:1;jenkins-hbase4:45693] regionserver.HRegionServer(1022): About to register with Master. 2023-07-19 19:10:37,336 INFO [RS:2;jenkins-hbase4:40791] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37769,1689793834010 with isa=jenkins-hbase4.apache.org/172.31.14.131:40791, startcode=1689793835731 2023-07-19 19:10:37,336 INFO [RS:1;jenkins-hbase4:45693] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37769,1689793834010 with isa=jenkins-hbase4.apache.org/172.31.14.131:45693, startcode=1689793835672 2023-07-19 19:10:37,338 DEBUG [RS:0;jenkins-hbase4:46111] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:46111 2023-07-19 19:10:37,339 INFO [RS:0;jenkins-hbase4:46111] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-19 19:10:37,339 INFO [RS:0;jenkins-hbase4:46111] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-19 19:10:37,339 DEBUG [RS:0;jenkins-hbase4:46111] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-19 19:10:37,339 INFO [RS:0;jenkins-hbase4:46111] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:10:37,339 DEBUG [RS:0;jenkins-hbase4:46111] regionserver.HRegionServer(1022): About to register with Master. 2023-07-19 19:10:37,340 INFO [RS:0;jenkins-hbase4:46111] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37769,1689793834010 with isa=jenkins-hbase4.apache.org/172.31.14.131:46111, startcode=1689793835594 2023-07-19 19:10:37,347 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-19 19:10:37,359 DEBUG [RS:1;jenkins-hbase4:45693] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-19 19:10:37,359 DEBUG [RS:2;jenkins-hbase4:40791] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-19 19:10:37,359 DEBUG [RS:0;jenkins-hbase4:46111] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-19 19:10:37,362 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 19:10:37,363 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 19:10:37,363 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 19:10:37,363 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 19:10:37,363 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-19 19:10:37,363 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,363 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 19:10:37,363 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,374 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689793867374 2023-07-19 19:10:37,378 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-19 19:10:37,382 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-19 19:10:37,383 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-19 19:10:37,393 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-19 19:10:37,399 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-19 19:10:37,403 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-19 19:10:37,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-19 19:10:37,405 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-19 19:10:37,405 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-19 19:10:37,408 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,410 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-19 19:10:37,413 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-19 19:10:37,413 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-19 19:10:37,419 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-19 19:10:37,419 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-19 19:10:37,422 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689793837421,5,FailOnTimeoutGroup] 2023-07-19 19:10:37,435 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689793837423,5,FailOnTimeoutGroup] 2023-07-19 19:10:37,435 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,436 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-19 19:10:37,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,443 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,457 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54089, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-19 19:10:37,457 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56283, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-19 19:10:37,462 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55777, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-19 19:10:37,475 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37769] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:10:37,494 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37769] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:37,498 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37769] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:37,502 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-19 19:10:37,504 DEBUG [RS:0;jenkins-hbase4:46111] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978 2023-07-19 19:10:37,504 DEBUG [RS:2;jenkins-hbase4:40791] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978 2023-07-19 19:10:37,504 DEBUG [RS:1;jenkins-hbase4:45693] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978 2023-07-19 19:10:37,504 DEBUG [RS:2;jenkins-hbase4:40791] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:43367 2023-07-19 19:10:37,505 DEBUG [RS:2;jenkins-hbase4:40791] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-19 19:10:37,504 DEBUG [RS:0;jenkins-hbase4:46111] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:43367 2023-07-19 19:10:37,504 DEBUG [RS:1;jenkins-hbase4:45693] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:43367 2023-07-19 19:10:37,505 DEBUG [RS:0;jenkins-hbase4:46111] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-19 19:10:37,505 DEBUG [RS:1;jenkins-hbase4:45693] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-19 19:10:37,507 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-19 19:10:37,507 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978 2023-07-19 19:10:37,523 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 19:10:37,524 DEBUG [RS:1;jenkins-hbase4:45693] zookeeper.ZKUtil(162): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:10:37,524 DEBUG [RS:2;jenkins-hbase4:40791] zookeeper.ZKUtil(162): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:37,524 DEBUG [RS:0;jenkins-hbase4:46111] zookeeper.ZKUtil(162): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:37,532 WARN [RS:2;jenkins-hbase4:40791] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 19:10:37,532 WARN [RS:0;jenkins-hbase4:46111] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 19:10:37,531 WARN [RS:1;jenkins-hbase4:45693] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 19:10:37,533 INFO [RS:1;jenkins-hbase4:45693] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 19:10:37,533 INFO [RS:0;jenkins-hbase4:46111] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 19:10:37,533 DEBUG [RS:1;jenkins-hbase4:45693] regionserver.HRegionServer(1948): logDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/WALs/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:10:37,533 DEBUG [RS:0;jenkins-hbase4:46111] regionserver.HRegionServer(1948): logDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/WALs/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:37,533 INFO [RS:2;jenkins-hbase4:40791] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 19:10:37,535 DEBUG [RS:2;jenkins-hbase4:40791] regionserver.HRegionServer(1948): logDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/WALs/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:37,534 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46111,1689793835594] 2023-07-19 19:10:37,543 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40791,1689793835731] 2023-07-19 19:10:37,543 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45693,1689793835672] 2023-07-19 19:10:37,592 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:10:37,594 DEBUG [RS:0;jenkins-hbase4:46111] zookeeper.ZKUtil(162): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:37,594 DEBUG [RS:2;jenkins-hbase4:40791] zookeeper.ZKUtil(162): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:37,597 DEBUG [RS:1;jenkins-hbase4:45693] zookeeper.ZKUtil(162): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:37,597 DEBUG [RS:0;jenkins-hbase4:46111] zookeeper.ZKUtil(162): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:10:37,598 DEBUG [RS:2;jenkins-hbase4:40791] zookeeper.ZKUtil(162): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:10:37,598 DEBUG [RS:1;jenkins-hbase4:45693] zookeeper.ZKUtil(162): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:10:37,598 DEBUG [RS:0;jenkins-hbase4:46111] zookeeper.ZKUtil(162): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:37,598 DEBUG [RS:2;jenkins-hbase4:40791] zookeeper.ZKUtil(162): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:37,599 DEBUG [RS:1;jenkins-hbase4:45693] zookeeper.ZKUtil(162): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:37,604 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-19 19:10:37,610 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/meta/1588230740/info 2023-07-19 19:10:37,611 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-19 19:10:37,612 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:10:37,612 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-19 19:10:37,616 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/meta/1588230740/rep_barrier 2023-07-19 19:10:37,618 DEBUG [RS:2;jenkins-hbase4:40791] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-19 19:10:37,636 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-19 19:10:37,616 DEBUG [RS:0;jenkins-hbase4:46111] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-19 19:10:37,616 DEBUG [RS:1;jenkins-hbase4:45693] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-19 19:10:37,642 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:10:37,643 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-19 19:10:37,646 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/meta/1588230740/table 2023-07-19 19:10:37,654 INFO [RS:2;jenkins-hbase4:40791] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-19 19:10:37,659 INFO [RS:0;jenkins-hbase4:46111] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-19 19:10:37,673 INFO [RS:1;jenkins-hbase4:45693] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-19 19:10:37,679 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-19 19:10:37,682 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:10:37,684 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/meta/1588230740 2023-07-19 19:10:37,686 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/meta/1588230740 2023-07-19 19:10:37,692 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-19 19:10:37,695 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-19 19:10:37,728 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 19:10:37,730 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63178776, jitterRate=-0.05856287479400635}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-19 19:10:37,730 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-19 19:10:37,730 INFO [RS:1;jenkins-hbase4:45693] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-19 19:10:37,730 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-19 19:10:37,731 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-19 19:10:37,731 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-19 19:10:37,730 INFO [RS:2;jenkins-hbase4:40791] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-19 19:10:37,730 INFO [RS:0;jenkins-hbase4:46111] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-19 19:10:37,731 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-19 19:10:37,732 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-19 19:10:37,737 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-19 19:10:37,737 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-19 19:10:37,738 INFO [RS:2;jenkins-hbase4:40791] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-19 19:10:37,738 INFO [RS:2;jenkins-hbase4:40791] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,747 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-19 19:10:37,747 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-19 19:10:37,738 INFO [RS:0;jenkins-hbase4:46111] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-19 19:10:37,763 INFO [RS:1;jenkins-hbase4:45693] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-19 19:10:37,768 INFO [RS:2;jenkins-hbase4:40791] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-19 19:10:37,768 INFO [RS:1;jenkins-hbase4:45693] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,768 INFO [RS:0;jenkins-hbase4:46111] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,770 INFO [RS:0;jenkins-hbase4:46111] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-19 19:10:37,772 INFO [RS:1;jenkins-hbase4:45693] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-19 19:10:37,778 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-19 19:10:37,782 INFO [RS:0;jenkins-hbase4:46111] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,782 INFO [RS:1;jenkins-hbase4:45693] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,782 INFO [RS:2;jenkins-hbase4:40791] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,783 DEBUG [RS:0;jenkins-hbase4:46111] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,783 DEBUG [RS:2;jenkins-hbase4:40791] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,783 DEBUG [RS:1;jenkins-hbase4:45693] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,783 DEBUG [RS:2;jenkins-hbase4:40791] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,783 DEBUG [RS:1;jenkins-hbase4:45693] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,783 DEBUG [RS:0;jenkins-hbase4:46111] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,784 DEBUG [RS:1;jenkins-hbase4:45693] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,784 DEBUG [RS:2;jenkins-hbase4:40791] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,784 DEBUG [RS:1;jenkins-hbase4:45693] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,784 DEBUG [RS:2;jenkins-hbase4:40791] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,784 DEBUG [RS:1;jenkins-hbase4:45693] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,784 DEBUG [RS:2;jenkins-hbase4:40791] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,784 DEBUG [RS:1;jenkins-hbase4:45693] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 19:10:37,784 DEBUG [RS:2;jenkins-hbase4:40791] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 19:10:37,784 DEBUG [RS:1;jenkins-hbase4:45693] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,784 DEBUG [RS:2;jenkins-hbase4:40791] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,784 DEBUG [RS:1;jenkins-hbase4:45693] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,784 DEBUG [RS:2;jenkins-hbase4:40791] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,784 DEBUG [RS:1;jenkins-hbase4:45693] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,785 DEBUG [RS:2;jenkins-hbase4:40791] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,784 DEBUG [RS:0;jenkins-hbase4:46111] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,785 DEBUG [RS:2;jenkins-hbase4:40791] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,785 DEBUG [RS:1;jenkins-hbase4:45693] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,785 DEBUG [RS:0;jenkins-hbase4:46111] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,785 DEBUG [RS:0;jenkins-hbase4:46111] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,785 DEBUG [RS:0;jenkins-hbase4:46111] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 19:10:37,786 DEBUG [RS:0;jenkins-hbase4:46111] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,786 DEBUG [RS:0;jenkins-hbase4:46111] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,786 DEBUG [RS:0;jenkins-hbase4:46111] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,786 DEBUG [RS:0;jenkins-hbase4:46111] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 19:10:37,795 INFO [RS:1;jenkins-hbase4:45693] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,796 INFO [RS:2;jenkins-hbase4:40791] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,796 INFO [RS:1;jenkins-hbase4:45693] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,797 INFO [RS:2;jenkins-hbase4:40791] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,797 INFO [RS:1;jenkins-hbase4:45693] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,797 INFO [RS:2;jenkins-hbase4:40791] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,798 INFO [RS:0;jenkins-hbase4:46111] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,798 INFO [RS:0;jenkins-hbase4:46111] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,798 INFO [RS:0;jenkins-hbase4:46111] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,805 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-19 19:10:37,811 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-19 19:10:37,823 INFO [RS:2;jenkins-hbase4:40791] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-19 19:10:37,826 INFO [RS:2;jenkins-hbase4:40791] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40791,1689793835731-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,827 INFO [RS:0;jenkins-hbase4:46111] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-19 19:10:37,831 INFO [RS:1;jenkins-hbase4:45693] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-19 19:10:37,836 INFO [RS:0;jenkins-hbase4:46111] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46111,1689793835594-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,836 INFO [RS:1;jenkins-hbase4:45693] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45693,1689793835672-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:37,867 INFO [RS:0;jenkins-hbase4:46111] regionserver.Replication(203): jenkins-hbase4.apache.org,46111,1689793835594 started 2023-07-19 19:10:37,867 INFO [RS:0;jenkins-hbase4:46111] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,46111,1689793835594, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46111, sessionid=0x1017efe2b740001 2023-07-19 19:10:37,868 INFO [RS:1;jenkins-hbase4:45693] regionserver.Replication(203): jenkins-hbase4.apache.org,45693,1689793835672 started 2023-07-19 19:10:37,869 INFO [RS:1;jenkins-hbase4:45693] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,45693,1689793835672, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45693, sessionid=0x1017efe2b740002 2023-07-19 19:10:37,869 DEBUG [RS:1;jenkins-hbase4:45693] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-19 19:10:37,869 DEBUG [RS:1;jenkins-hbase4:45693] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:10:37,869 DEBUG [RS:1;jenkins-hbase4:45693] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45693,1689793835672' 2023-07-19 19:10:37,869 DEBUG [RS:1;jenkins-hbase4:45693] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-19 19:10:37,869 DEBUG [RS:0;jenkins-hbase4:46111] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-19 19:10:37,869 DEBUG [RS:0;jenkins-hbase4:46111] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:37,880 INFO [RS:2;jenkins-hbase4:40791] regionserver.Replication(203): jenkins-hbase4.apache.org,40791,1689793835731 started 2023-07-19 19:10:37,881 INFO [RS:2;jenkins-hbase4:40791] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,40791,1689793835731, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40791, sessionid=0x1017efe2b740003 2023-07-19 19:10:37,881 DEBUG [RS:2;jenkins-hbase4:40791] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-19 19:10:37,881 DEBUG [RS:2;jenkins-hbase4:40791] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:37,881 DEBUG [RS:2;jenkins-hbase4:40791] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40791,1689793835731' 2023-07-19 19:10:37,881 DEBUG [RS:2;jenkins-hbase4:40791] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-19 19:10:37,871 DEBUG [RS:0;jenkins-hbase4:46111] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46111,1689793835594' 2023-07-19 19:10:37,881 DEBUG [RS:0;jenkins-hbase4:46111] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-19 19:10:37,882 DEBUG [RS:1;jenkins-hbase4:45693] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-19 19:10:37,882 DEBUG [RS:2;jenkins-hbase4:40791] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-19 19:10:37,882 DEBUG [RS:0;jenkins-hbase4:46111] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-19 19:10:37,883 DEBUG [RS:1;jenkins-hbase4:45693] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-19 19:10:37,883 DEBUG [RS:1;jenkins-hbase4:45693] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-19 19:10:37,883 DEBUG [RS:1;jenkins-hbase4:45693] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:10:37,883 DEBUG [RS:1;jenkins-hbase4:45693] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45693,1689793835672' 2023-07-19 19:10:37,883 DEBUG [RS:1;jenkins-hbase4:45693] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:10:37,883 DEBUG [RS:2;jenkins-hbase4:40791] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-19 19:10:37,883 DEBUG [RS:0;jenkins-hbase4:46111] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-19 19:10:37,883 DEBUG [RS:2;jenkins-hbase4:40791] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-19 19:10:37,883 DEBUG [RS:0;jenkins-hbase4:46111] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-19 19:10:37,887 DEBUG [RS:1;jenkins-hbase4:45693] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:10:37,887 DEBUG [RS:0;jenkins-hbase4:46111] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:37,887 DEBUG [RS:0;jenkins-hbase4:46111] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46111,1689793835594' 2023-07-19 19:10:37,887 DEBUG [RS:0;jenkins-hbase4:46111] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:10:37,888 DEBUG [RS:1;jenkins-hbase4:45693] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-19 19:10:37,888 INFO [RS:1;jenkins-hbase4:45693] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-19 19:10:37,888 DEBUG [RS:0;jenkins-hbase4:46111] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:10:37,888 INFO [RS:1;jenkins-hbase4:45693] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-19 19:10:37,889 DEBUG [RS:0;jenkins-hbase4:46111] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-19 19:10:37,884 DEBUG [RS:2;jenkins-hbase4:40791] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:37,891 DEBUG [RS:2;jenkins-hbase4:40791] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40791,1689793835731' 2023-07-19 19:10:37,891 DEBUG [RS:2;jenkins-hbase4:40791] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:10:37,889 INFO [RS:0;jenkins-hbase4:46111] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-19 19:10:37,891 INFO [RS:0;jenkins-hbase4:46111] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-19 19:10:37,892 DEBUG [RS:2;jenkins-hbase4:40791] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:10:37,892 DEBUG [RS:2;jenkins-hbase4:40791] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-19 19:10:37,892 INFO [RS:2;jenkins-hbase4:40791] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-19 19:10:37,892 INFO [RS:2;jenkins-hbase4:40791] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-19 19:10:37,964 DEBUG [jenkins-hbase4:37769] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-19 19:10:37,970 DEBUG [jenkins-hbase4:37769] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 19:10:38,000 DEBUG [jenkins-hbase4:37769] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 19:10:38,001 DEBUG [jenkins-hbase4:37769] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 19:10:38,001 DEBUG [jenkins-hbase4:37769] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 19:10:38,001 DEBUG [jenkins-hbase4:37769] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 19:10:38,004 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40791,1689793835731, state=OPENING 2023-07-19 19:10:38,008 INFO [RS:1;jenkins-hbase4:45693] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45693%2C1689793835672, suffix=, logDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/WALs/jenkins-hbase4.apache.org,45693,1689793835672, archiveDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/oldWALs, maxLogs=32 2023-07-19 19:10:38,012 INFO [RS:0;jenkins-hbase4:46111] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46111%2C1689793835594, suffix=, logDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/WALs/jenkins-hbase4.apache.org,46111,1689793835594, archiveDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/oldWALs, maxLogs=32 2023-07-19 19:10:38,017 INFO [RS:2;jenkins-hbase4:40791] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40791%2C1689793835731, suffix=, logDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/WALs/jenkins-hbase4.apache.org,40791,1689793835731, archiveDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/oldWALs, maxLogs=32 2023-07-19 19:10:38,022 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-19 19:10:38,029 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 19:10:38,030 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-19 19:10:38,036 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40791,1689793835731}] 2023-07-19 19:10:38,067 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44807,DS-69ffe6d3-e676-4fb0-a969-9397d66c3a3b,DISK] 2023-07-19 19:10:38,067 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32977,DS-121a7470-b792-4a57-bd19-68fc575d0061,DISK] 2023-07-19 19:10:38,083 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33585,DS-3e6e52f1-8ece-4571-a362-2d1d72958a63,DISK] 2023-07-19 19:10:38,088 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33585,DS-3e6e52f1-8ece-4571-a362-2d1d72958a63,DISK] 2023-07-19 19:10:38,089 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32977,DS-121a7470-b792-4a57-bd19-68fc575d0061,DISK] 2023-07-19 19:10:38,088 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44807,DS-69ffe6d3-e676-4fb0-a969-9397d66c3a3b,DISK] 2023-07-19 19:10:38,100 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33585,DS-3e6e52f1-8ece-4571-a362-2d1d72958a63,DISK] 2023-07-19 19:10:38,101 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44807,DS-69ffe6d3-e676-4fb0-a969-9397d66c3a3b,DISK] 2023-07-19 19:10:38,101 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32977,DS-121a7470-b792-4a57-bd19-68fc575d0061,DISK] 2023-07-19 19:10:38,126 INFO [RS:1;jenkins-hbase4:45693] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/WALs/jenkins-hbase4.apache.org,45693,1689793835672/jenkins-hbase4.apache.org%2C45693%2C1689793835672.1689793838012 2023-07-19 19:10:38,126 INFO [RS:2;jenkins-hbase4:40791] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/WALs/jenkins-hbase4.apache.org,40791,1689793835731/jenkins-hbase4.apache.org%2C40791%2C1689793835731.1689793838024 2023-07-19 19:10:38,129 DEBUG [RS:1;jenkins-hbase4:45693] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44807,DS-69ffe6d3-e676-4fb0-a969-9397d66c3a3b,DISK], DatanodeInfoWithStorage[127.0.0.1:32977,DS-121a7470-b792-4a57-bd19-68fc575d0061,DISK], DatanodeInfoWithStorage[127.0.0.1:33585,DS-3e6e52f1-8ece-4571-a362-2d1d72958a63,DISK]] 2023-07-19 19:10:38,129 DEBUG [RS:2;jenkins-hbase4:40791] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:32977,DS-121a7470-b792-4a57-bd19-68fc575d0061,DISK], DatanodeInfoWithStorage[127.0.0.1:33585,DS-3e6e52f1-8ece-4571-a362-2d1d72958a63,DISK], DatanodeInfoWithStorage[127.0.0.1:44807,DS-69ffe6d3-e676-4fb0-a969-9397d66c3a3b,DISK]] 2023-07-19 19:10:38,132 INFO [RS:0;jenkins-hbase4:46111] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/WALs/jenkins-hbase4.apache.org,46111,1689793835594/jenkins-hbase4.apache.org%2C46111%2C1689793835594.1689793838021 2023-07-19 19:10:38,138 DEBUG [RS:0;jenkins-hbase4:46111] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44807,DS-69ffe6d3-e676-4fb0-a969-9397d66c3a3b,DISK], DatanodeInfoWithStorage[127.0.0.1:33585,DS-3e6e52f1-8ece-4571-a362-2d1d72958a63,DISK], DatanodeInfoWithStorage[127.0.0.1:32977,DS-121a7470-b792-4a57-bd19-68fc575d0061,DISK]] 2023-07-19 19:10:38,307 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:38,311 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 19:10:38,315 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34910, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 19:10:38,332 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-19 19:10:38,333 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 19:10:38,351 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40791%2C1689793835731.meta, suffix=.meta, logDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/WALs/jenkins-hbase4.apache.org,40791,1689793835731, archiveDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/oldWALs, maxLogs=32 2023-07-19 19:10:38,389 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32977,DS-121a7470-b792-4a57-bd19-68fc575d0061,DISK] 2023-07-19 19:10:38,405 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33585,DS-3e6e52f1-8ece-4571-a362-2d1d72958a63,DISK] 2023-07-19 19:10:38,409 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44807,DS-69ffe6d3-e676-4fb0-a969-9397d66c3a3b,DISK] 2023-07-19 19:10:38,435 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/WALs/jenkins-hbase4.apache.org,40791,1689793835731/jenkins-hbase4.apache.org%2C40791%2C1689793835731.meta.1689793838353.meta 2023-07-19 19:10:38,437 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:32977,DS-121a7470-b792-4a57-bd19-68fc575d0061,DISK], DatanodeInfoWithStorage[127.0.0.1:33585,DS-3e6e52f1-8ece-4571-a362-2d1d72958a63,DISK], DatanodeInfoWithStorage[127.0.0.1:44807,DS-69ffe6d3-e676-4fb0-a969-9397d66c3a3b,DISK]] 2023-07-19 19:10:38,438 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-19 19:10:38,439 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-19 19:10:38,440 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:10:38,441 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-19 19:10:38,444 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-19 19:10:38,445 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-19 19:10:38,461 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-19 19:10:38,462 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:10:38,462 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-19 19:10:38,462 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-19 19:10:38,474 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-19 19:10:38,479 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/meta/1588230740/info 2023-07-19 19:10:38,479 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/meta/1588230740/info 2023-07-19 19:10:38,480 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-19 19:10:38,482 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:10:38,482 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-19 19:10:38,484 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/meta/1588230740/rep_barrier 2023-07-19 19:10:38,484 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/meta/1588230740/rep_barrier 2023-07-19 19:10:38,486 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-19 19:10:38,487 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:10:38,488 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-19 19:10:38,489 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/meta/1588230740/table 2023-07-19 19:10:38,490 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/meta/1588230740/table 2023-07-19 19:10:38,490 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-19 19:10:38,491 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:10:38,494 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/meta/1588230740 2023-07-19 19:10:38,497 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/meta/1588230740 2023-07-19 19:10:38,502 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-19 19:10:38,505 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-19 19:10:38,507 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68250122, jitterRate=0.01700606942176819}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-19 19:10:38,510 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-19 19:10:38,524 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689793838295 2023-07-19 19:10:38,547 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-19 19:10:38,549 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40791,1689793835731, state=OPEN 2023-07-19 19:10:38,550 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-19 19:10:38,552 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-19 19:10:38,553 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-19 19:10:38,559 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-19 19:10:38,559 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40791,1689793835731 in 517 msec 2023-07-19 19:10:38,570 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-19 19:10:38,570 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 782 msec 2023-07-19 19:10:38,581 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.3530 sec 2023-07-19 19:10:38,582 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689793838582, completionTime=-1 2023-07-19 19:10:38,582 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-19 19:10:38,582 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-19 19:10:38,665 DEBUG [hconnection-0x1164f60d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:10:38,669 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34922, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:10:38,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-19 19:10:38,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689793898692 2023-07-19 19:10:38,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689793958692 2023-07-19 19:10:38,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 109 msec 2023-07-19 19:10:38,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37769,1689793834010-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:38,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37769,1689793834010-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:38,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37769,1689793834010-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:38,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:37769, period=300000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:38,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-19 19:10:38,729 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-19 19:10:38,737 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-19 19:10:38,738 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-19 19:10:38,749 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-19 19:10:38,752 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 19:10:38,756 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 19:10:38,785 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/hbase/namespace/8249fd75ae928a70fcb60e633db01d47 2023-07-19 19:10:38,789 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/hbase/namespace/8249fd75ae928a70fcb60e633db01d47 empty. 2023-07-19 19:10:38,790 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/hbase/namespace/8249fd75ae928a70fcb60e633db01d47 2023-07-19 19:10:38,790 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-19 19:10:38,836 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-19 19:10:38,838 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8249fd75ae928a70fcb60e633db01d47, NAME => 'hbase:namespace,,1689793838738.8249fd75ae928a70fcb60e633db01d47.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp 2023-07-19 19:10:38,865 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689793838738.8249fd75ae928a70fcb60e633db01d47.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:10:38,866 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 8249fd75ae928a70fcb60e633db01d47, disabling compactions & flushes 2023-07-19 19:10:38,866 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689793838738.8249fd75ae928a70fcb60e633db01d47. 2023-07-19 19:10:38,866 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689793838738.8249fd75ae928a70fcb60e633db01d47. 2023-07-19 19:10:38,866 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689793838738.8249fd75ae928a70fcb60e633db01d47. after waiting 0 ms 2023-07-19 19:10:38,866 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689793838738.8249fd75ae928a70fcb60e633db01d47. 2023-07-19 19:10:38,866 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689793838738.8249fd75ae928a70fcb60e633db01d47. 2023-07-19 19:10:38,866 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 8249fd75ae928a70fcb60e633db01d47: 2023-07-19 19:10:38,871 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 19:10:38,889 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689793838738.8249fd75ae928a70fcb60e633db01d47.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689793838874"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793838874"}]},"ts":"1689793838874"} 2023-07-19 19:10:38,924 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-19 19:10:38,927 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 19:10:38,932 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793838927"}]},"ts":"1689793838927"} 2023-07-19 19:10:38,939 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-19 19:10:38,943 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 19:10:38,945 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 19:10:38,945 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 19:10:38,945 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 19:10:38,945 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 19:10:38,949 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8249fd75ae928a70fcb60e633db01d47, ASSIGN}] 2023-07-19 19:10:38,953 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8249fd75ae928a70fcb60e633db01d47, ASSIGN 2023-07-19 19:10:38,956 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=8249fd75ae928a70fcb60e633db01d47, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45693,1689793835672; forceNewPlan=false, retain=false 2023-07-19 19:10:39,110 INFO [jenkins-hbase4:37769] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-19 19:10:39,111 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8249fd75ae928a70fcb60e633db01d47, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:10:39,112 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689793838738.8249fd75ae928a70fcb60e633db01d47.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689793839111"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793839111"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793839111"}]},"ts":"1689793839111"} 2023-07-19 19:10:39,116 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 8249fd75ae928a70fcb60e633db01d47, server=jenkins-hbase4.apache.org,45693,1689793835672}] 2023-07-19 19:10:39,271 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:10:39,271 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 19:10:39,277 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49558, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 19:10:39,288 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689793838738.8249fd75ae928a70fcb60e633db01d47. 2023-07-19 19:10:39,288 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8249fd75ae928a70fcb60e633db01d47, NAME => 'hbase:namespace,,1689793838738.8249fd75ae928a70fcb60e633db01d47.', STARTKEY => '', ENDKEY => ''} 2023-07-19 19:10:39,288 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689793838738.8249fd75ae928a70fcb60e633db01d47. service=AccessControlService 2023-07-19 19:10:39,289 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:10:39,290 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 8249fd75ae928a70fcb60e633db01d47 2023-07-19 19:10:39,290 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689793838738.8249fd75ae928a70fcb60e633db01d47.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:10:39,290 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8249fd75ae928a70fcb60e633db01d47 2023-07-19 19:10:39,290 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8249fd75ae928a70fcb60e633db01d47 2023-07-19 19:10:39,300 INFO [StoreOpener-8249fd75ae928a70fcb60e633db01d47-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 8249fd75ae928a70fcb60e633db01d47 2023-07-19 19:10:39,309 DEBUG [StoreOpener-8249fd75ae928a70fcb60e633db01d47-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/namespace/8249fd75ae928a70fcb60e633db01d47/info 2023-07-19 19:10:39,310 DEBUG [StoreOpener-8249fd75ae928a70fcb60e633db01d47-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/namespace/8249fd75ae928a70fcb60e633db01d47/info 2023-07-19 19:10:39,310 INFO [StoreOpener-8249fd75ae928a70fcb60e633db01d47-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8249fd75ae928a70fcb60e633db01d47 columnFamilyName info 2023-07-19 19:10:39,311 INFO [StoreOpener-8249fd75ae928a70fcb60e633db01d47-1] regionserver.HStore(310): Store=8249fd75ae928a70fcb60e633db01d47/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:10:39,313 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/namespace/8249fd75ae928a70fcb60e633db01d47 2023-07-19 19:10:39,314 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/namespace/8249fd75ae928a70fcb60e633db01d47 2023-07-19 19:10:39,320 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8249fd75ae928a70fcb60e633db01d47 2023-07-19 19:10:39,328 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/namespace/8249fd75ae928a70fcb60e633db01d47/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 19:10:39,329 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8249fd75ae928a70fcb60e633db01d47; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70987901, jitterRate=0.05780215561389923}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 19:10:39,330 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8249fd75ae928a70fcb60e633db01d47: 2023-07-19 19:10:39,332 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689793838738.8249fd75ae928a70fcb60e633db01d47., pid=6, masterSystemTime=1689793839271 2023-07-19 19:10:39,338 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689793838738.8249fd75ae928a70fcb60e633db01d47. 2023-07-19 19:10:39,339 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689793838738.8249fd75ae928a70fcb60e633db01d47. 2023-07-19 19:10:39,340 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8249fd75ae928a70fcb60e633db01d47, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:10:39,341 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689793838738.8249fd75ae928a70fcb60e633db01d47.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689793839339"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689793839339"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689793839339"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689793839339"}]},"ts":"1689793839339"} 2023-07-19 19:10:39,349 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-19 19:10:39,350 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 8249fd75ae928a70fcb60e633db01d47, server=jenkins-hbase4.apache.org,45693,1689793835672 in 229 msec 2023-07-19 19:10:39,356 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-19 19:10:39,358 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=8249fd75ae928a70fcb60e633db01d47, ASSIGN in 401 msec 2023-07-19 19:10:39,359 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 19:10:39,359 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793839359"}]},"ts":"1689793839359"} 2023-07-19 19:10:39,362 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-19 19:10:39,367 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 19:10:39,370 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 628 msec 2023-07-19 19:10:39,452 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-19 19:10:39,454 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-19 19:10:39,454 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 19:10:39,480 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:10:39,491 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49562, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:10:39,509 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-19 19:10:39,534 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-19 19:10:39,541 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 42 msec 2023-07-19 19:10:39,549 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-19 19:10:39,563 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-19 19:10:39,569 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 19 msec 2023-07-19 19:10:39,585 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-19 19:10:39,589 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-19 19:10:39,590 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.753sec 2023-07-19 19:10:39,593 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-19 19:10:39,595 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-19 19:10:39,595 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-19 19:10:39,597 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37769,1689793834010-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-19 19:10:39,598 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37769,1689793834010-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-19 19:10:39,615 DEBUG [Listener at localhost/44441] zookeeper.ReadOnlyZKClient(139): Connect 0x416d673c to 127.0.0.1:58293 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:10:39,620 DEBUG [Listener at localhost/44441] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d40e34, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:10:39,622 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-19 19:10:39,625 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-19 19:10:39,629 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 19:10:39,632 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 19:10:39,635 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-19 19:10:39,637 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/hbase/acl/d9649b1716be71c1e4890f6a127b36b2 2023-07-19 19:10:39,638 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/hbase/acl/d9649b1716be71c1e4890f6a127b36b2 empty. 2023-07-19 19:10:39,640 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/hbase/acl/d9649b1716be71c1e4890f6a127b36b2 2023-07-19 19:10:39,640 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-19 19:10:39,640 DEBUG [hconnection-0x46f19b93-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:10:39,646 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 19:10:39,664 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34930, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:10:39,668 INFO [Listener at localhost/44441] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,37769,1689793834010 2023-07-19 19:10:39,668 INFO [Listener at localhost/44441] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-19 19:10:39,668 INFO [Listener at localhost/44441] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/test.cache.data in system properties and HBase conf 2023-07-19 19:10:39,668 INFO [Listener at localhost/44441] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/hadoop.tmp.dir in system properties and HBase conf 2023-07-19 19:10:39,668 INFO [Listener at localhost/44441] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/hadoop.log.dir in system properties and HBase conf 2023-07-19 19:10:39,669 INFO [Listener at localhost/44441] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-19 19:10:39,669 INFO [Listener at localhost/44441] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-19 19:10:39,669 INFO [Listener at localhost/44441] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-19 19:10:39,669 INFO [Listener at localhost/44441] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-19 19:10:39,669 INFO [Listener at localhost/44441] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-19 19:10:39,669 INFO [Listener at localhost/44441] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-19 19:10:39,669 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-19 19:10:39,669 INFO [Listener at localhost/44441] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 19:10:39,670 INFO [Listener at localhost/44441] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-19 19:10:39,670 INFO [Listener at localhost/44441] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-19 19:10:39,670 INFO [Listener at localhost/44441] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 19:10:39,670 INFO [Listener at localhost/44441] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 19:10:39,670 INFO [Listener at localhost/44441] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-19 19:10:39,670 INFO [Listener at localhost/44441] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/nfs.dump.dir in system properties and HBase conf 2023-07-19 19:10:39,670 INFO [Listener at localhost/44441] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/java.io.tmpdir in system properties and HBase conf 2023-07-19 19:10:39,670 INFO [Listener at localhost/44441] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 19:10:39,671 INFO [Listener at localhost/44441] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-19 19:10:39,671 INFO [Listener at localhost/44441] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-19 19:10:39,671 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => d9649b1716be71c1e4890f6a127b36b2, NAME => 'hbase:acl,,1689793839616.d9649b1716be71c1e4890f6a127b36b2.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp 2023-07-19 19:10:39,717 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689793839616.d9649b1716be71c1e4890f6a127b36b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:10:39,717 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing d9649b1716be71c1e4890f6a127b36b2, disabling compactions & flushes 2023-07-19 19:10:39,717 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689793839616.d9649b1716be71c1e4890f6a127b36b2. 2023-07-19 19:10:39,717 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689793839616.d9649b1716be71c1e4890f6a127b36b2. 2023-07-19 19:10:39,717 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689793839616.d9649b1716be71c1e4890f6a127b36b2. after waiting 0 ms 2023-07-19 19:10:39,717 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689793839616.d9649b1716be71c1e4890f6a127b36b2. 2023-07-19 19:10:39,718 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689793839616.d9649b1716be71c1e4890f6a127b36b2. 2023-07-19 19:10:39,718 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for d9649b1716be71c1e4890f6a127b36b2: 2023-07-19 19:10:39,724 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 19:10:39,726 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689793839616.d9649b1716be71c1e4890f6a127b36b2.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689793839726"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793839726"}]},"ts":"1689793839726"} 2023-07-19 19:10:39,734 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-19 19:10:39,738 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 19:10:39,740 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793839738"}]},"ts":"1689793839738"} 2023-07-19 19:10:39,746 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-19 19:10:39,751 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 19:10:39,754 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 19:10:39,756 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 19:10:39,756 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 19:10:39,756 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 19:10:39,756 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 19:10:39,756 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=d9649b1716be71c1e4890f6a127b36b2, ASSIGN}] 2023-07-19 19:10:39,760 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=d9649b1716be71c1e4890f6a127b36b2, ASSIGN 2023-07-19 19:10:39,762 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=d9649b1716be71c1e4890f6a127b36b2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40791,1689793835731; forceNewPlan=false, retain=false 2023-07-19 19:10:39,912 INFO [jenkins-hbase4:37769] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-19 19:10:39,914 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=d9649b1716be71c1e4890f6a127b36b2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:39,914 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689793839616.d9649b1716be71c1e4890f6a127b36b2.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689793839913"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793839913"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793839913"}]},"ts":"1689793839913"} 2023-07-19 19:10:39,918 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure d9649b1716be71c1e4890f6a127b36b2, server=jenkins-hbase4.apache.org,40791,1689793835731}] 2023-07-19 19:10:39,952 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 19:10:40,083 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689793839616.d9649b1716be71c1e4890f6a127b36b2. 2023-07-19 19:10:40,083 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d9649b1716be71c1e4890f6a127b36b2, NAME => 'hbase:acl,,1689793839616.d9649b1716be71c1e4890f6a127b36b2.', STARTKEY => '', ENDKEY => ''} 2023-07-19 19:10:40,084 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689793839616.d9649b1716be71c1e4890f6a127b36b2. service=AccessControlService 2023-07-19 19:10:40,084 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:10:40,084 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl d9649b1716be71c1e4890f6a127b36b2 2023-07-19 19:10:40,084 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689793839616.d9649b1716be71c1e4890f6a127b36b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:10:40,084 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d9649b1716be71c1e4890f6a127b36b2 2023-07-19 19:10:40,084 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d9649b1716be71c1e4890f6a127b36b2 2023-07-19 19:10:40,091 INFO [StoreOpener-d9649b1716be71c1e4890f6a127b36b2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region d9649b1716be71c1e4890f6a127b36b2 2023-07-19 19:10:40,093 DEBUG [StoreOpener-d9649b1716be71c1e4890f6a127b36b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/acl/d9649b1716be71c1e4890f6a127b36b2/l 2023-07-19 19:10:40,093 DEBUG [StoreOpener-d9649b1716be71c1e4890f6a127b36b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/acl/d9649b1716be71c1e4890f6a127b36b2/l 2023-07-19 19:10:40,094 INFO [StoreOpener-d9649b1716be71c1e4890f6a127b36b2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d9649b1716be71c1e4890f6a127b36b2 columnFamilyName l 2023-07-19 19:10:40,095 INFO [StoreOpener-d9649b1716be71c1e4890f6a127b36b2-1] regionserver.HStore(310): Store=d9649b1716be71c1e4890f6a127b36b2/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:10:40,098 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/acl/d9649b1716be71c1e4890f6a127b36b2 2023-07-19 19:10:40,104 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/acl/d9649b1716be71c1e4890f6a127b36b2 2023-07-19 19:10:40,113 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d9649b1716be71c1e4890f6a127b36b2 2023-07-19 19:10:40,118 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/acl/d9649b1716be71c1e4890f6a127b36b2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 19:10:40,119 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d9649b1716be71c1e4890f6a127b36b2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61869830, jitterRate=-0.07806769013404846}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 19:10:40,120 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d9649b1716be71c1e4890f6a127b36b2: 2023-07-19 19:10:40,123 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689793839616.d9649b1716be71c1e4890f6a127b36b2., pid=11, masterSystemTime=1689793840072 2023-07-19 19:10:40,130 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=d9649b1716be71c1e4890f6a127b36b2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:40,131 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689793839616.d9649b1716be71c1e4890f6a127b36b2.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689793840130"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689793840130"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689793840130"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689793840130"}]},"ts":"1689793840130"} 2023-07-19 19:10:40,134 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689793839616.d9649b1716be71c1e4890f6a127b36b2. 2023-07-19 19:10:40,135 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689793839616.d9649b1716be71c1e4890f6a127b36b2. 2023-07-19 19:10:40,142 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-19 19:10:40,142 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure d9649b1716be71c1e4890f6a127b36b2, server=jenkins-hbase4.apache.org,40791,1689793835731 in 217 msec 2023-07-19 19:10:40,148 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-19 19:10:40,149 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=d9649b1716be71c1e4890f6a127b36b2, ASSIGN in 386 msec 2023-07-19 19:10:40,151 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 19:10:40,152 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793840152"}]},"ts":"1689793840152"} 2023-07-19 19:10:40,154 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-19 19:10:40,158 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 19:10:40,162 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 536 msec 2023-07-19 19:10:40,252 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 19:10:40,252 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-19 19:10:40,263 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-19 19:10:41,109 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 19:10:41,419 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 19:10:41,427 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34197_jobhistory____.jq84ll/webapp 2023-07-19 19:10:41,592 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-19 19:10:41,592 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-19 19:10:41,592 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 19:10:41,595 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 19:10:41,676 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 19:10:42,030 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 19:10:42,374 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-19 19:10:42,421 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34197 2023-07-19 19:10:42,606 WARN [Listener at jenkins-hbase4.apache.org/37689] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 19:10:43,074 WARN [Listener at jenkins-hbase4.apache.org/37689] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-19 19:10:43,076 INFO [Listener at jenkins-hbase4.apache.org/37689] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 19:10:43,087 INFO [Listener at jenkins-hbase4.apache.org/37689] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_33049_cluster____.l56k7l/webapp 2023-07-19 19:10:43,201 INFO [Listener at jenkins-hbase4.apache.org/37689] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-19 19:10:43,201 INFO [Listener at jenkins-hbase4.apache.org/37689] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-19 19:10:43,201 INFO [Listener at jenkins-hbase4.apache.org/37689] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 19:10:43,202 INFO [Listener at jenkins-hbase4.apache.org/37689] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 19:10:43,217 INFO [Listener at jenkins-hbase4.apache.org/37689] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 19:10:43,657 INFO [Listener at jenkins-hbase4.apache.org/37689] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 19:10:43,794 INFO [Listener at jenkins-hbase4.apache.org/37689] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 19:10:43,811 INFO [Listener at jenkins-hbase4.apache.org/37689] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:33049 2023-07-19 19:10:44,107 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 19:10:44,266 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-19 19:10:44,268 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-19 19:10:44,268 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-19 19:10:44,269 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:10:44,270 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-19 19:10:44,270 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:10:44,270 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-19 19:10:44,270 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-19 19:10:44,270 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-19 19:10:44,271 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:10:44,271 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-19 19:10:44,271 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-19 19:10:44,271 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-19 19:10:44,552 WARN [Listener at jenkins-hbase4.apache.org/44253] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 19:10:44,583 WARN [Listener at jenkins-hbase4.apache.org/44253] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-19 19:10:44,584 INFO [Listener at jenkins-hbase4.apache.org/44253] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 19:10:44,596 INFO [Listener at jenkins-hbase4.apache.org/44253] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_33397_node____ekteun/webapp 2023-07-19 19:10:44,671 INFO [Listener at jenkins-hbase4.apache.org/44253] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-19 19:10:44,671 INFO [Listener at jenkins-hbase4.apache.org/44253] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 19:10:44,672 INFO [Listener at jenkins-hbase4.apache.org/44253] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-19 19:10:44,672 INFO [Listener at jenkins-hbase4.apache.org/44253] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 19:10:44,684 INFO [Listener at jenkins-hbase4.apache.org/44253] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 19:10:44,712 INFO [Listener at jenkins-hbase4.apache.org/44253] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 19:10:44,813 INFO [Listener at jenkins-hbase4.apache.org/44253] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 19:10:44,832 INFO [Listener at jenkins-hbase4.apache.org/44253] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:33397 2023-07-19 19:10:45,044 WARN [Listener at jenkins-hbase4.apache.org/42871] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 19:10:45,050 WARN [Listener at jenkins-hbase4.apache.org/42871] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-19 19:10:45,051 INFO [Listener at jenkins-hbase4.apache.org/42871] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 19:10:45,058 INFO [Listener at jenkins-hbase4.apache.org/42871] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37017_node____.3sfhow/webapp 2023-07-19 19:10:45,116 INFO [Listener at jenkins-hbase4.apache.org/42871] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-19 19:10:45,116 INFO [Listener at jenkins-hbase4.apache.org/42871] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 19:10:45,116 INFO [Listener at jenkins-hbase4.apache.org/42871] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-19 19:10:45,117 INFO [Listener at jenkins-hbase4.apache.org/42871] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 19:10:45,127 INFO [Listener at jenkins-hbase4.apache.org/42871] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 19:10:45,147 INFO [Listener at jenkins-hbase4.apache.org/42871] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 19:10:45,213 INFO [Listener at jenkins-hbase4.apache.org/42871] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 19:10:45,217 INFO [Listener at jenkins-hbase4.apache.org/42871] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37017 2023-07-19 19:10:45,245 INFO [Listener at jenkins-hbase4.apache.org/42871] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-19 19:10:45,247 INFO [Listener at jenkins-hbase4.apache.org/42871] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 19:10:45,317 INFO [Listener at jenkins-hbase4.apache.org/42871] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=706, OpenFileDescriptor=898, MaxFileDescriptor=60000, SystemLoadAverage=377, ProcessCount=176, AvailableMemoryMB=4765 2023-07-19 19:10:45,317 WARN [Listener at jenkins-hbase4.apache.org/42871] hbase.ResourceChecker(130): Thread=706 is superior to 500 2023-07-19 19:10:45,335 DEBUG [Listener at jenkins-hbase4.apache.org/42871] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-19 19:10:45,343 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45502, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-19 19:10:45,352 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-19 19:10:45,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-19 19:10:45,360 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 19:10:45,363 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-19 19:10:45,365 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 19:10:45,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 19:10:45,379 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportWithTargetName/be9b460914639a1f3e7843595d7cbb95 2023-07-19 19:10:45,380 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportWithTargetName/be9b460914639a1f3e7843595d7cbb95 empty. 2023-07-19 19:10:45,386 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportWithTargetName/c5516418575d9b209a305aaf57dfafa6 2023-07-19 19:10:45,386 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportWithTargetName/be9b460914639a1f3e7843595d7cbb95 2023-07-19 19:10:45,388 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportWithTargetName/c5516418575d9b209a305aaf57dfafa6 empty. 2023-07-19 19:10:45,388 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportWithTargetName/c5516418575d9b209a305aaf57dfafa6 2023-07-19 19:10:45,389 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-19 19:10:45,439 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-19 19:10:45,441 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => c5516418575d9b209a305aaf57dfafa6, NAME => 'testtb-testExportWithTargetName,1,1689793845351.c5516418575d9b209a305aaf57dfafa6.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp 2023-07-19 19:10:45,441 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => be9b460914639a1f3e7843595d7cbb95, NAME => 'testtb-testExportWithTargetName,,1689793845351.be9b460914639a1f3e7843595d7cbb95.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp 2023-07-19 19:10:45,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 19:10:45,487 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689793845351.c5516418575d9b209a305aaf57dfafa6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:10:45,488 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing c5516418575d9b209a305aaf57dfafa6, disabling compactions & flushes 2023-07-19 19:10:45,488 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689793845351.c5516418575d9b209a305aaf57dfafa6. 2023-07-19 19:10:45,488 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689793845351.c5516418575d9b209a305aaf57dfafa6. 2023-07-19 19:10:45,488 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689793845351.c5516418575d9b209a305aaf57dfafa6. after waiting 0 ms 2023-07-19 19:10:45,488 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689793845351.c5516418575d9b209a305aaf57dfafa6. 2023-07-19 19:10:45,488 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689793845351.c5516418575d9b209a305aaf57dfafa6. 2023-07-19 19:10:45,488 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for c5516418575d9b209a305aaf57dfafa6: 2023-07-19 19:10:45,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 19:10:45,881 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689793845351.be9b460914639a1f3e7843595d7cbb95.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:10:45,881 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing be9b460914639a1f3e7843595d7cbb95, disabling compactions & flushes 2023-07-19 19:10:45,881 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689793845351.be9b460914639a1f3e7843595d7cbb95. 2023-07-19 19:10:45,881 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689793845351.be9b460914639a1f3e7843595d7cbb95. 2023-07-19 19:10:45,881 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689793845351.be9b460914639a1f3e7843595d7cbb95. after waiting 0 ms 2023-07-19 19:10:45,881 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689793845351.be9b460914639a1f3e7843595d7cbb95. 2023-07-19 19:10:45,881 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689793845351.be9b460914639a1f3e7843595d7cbb95. 2023-07-19 19:10:45,881 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for be9b460914639a1f3e7843595d7cbb95: 2023-07-19 19:10:45,885 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 19:10:45,887 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689793845351.c5516418575d9b209a305aaf57dfafa6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689793845886"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793845886"}]},"ts":"1689793845886"} 2023-07-19 19:10:45,887 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689793845351.be9b460914639a1f3e7843595d7cbb95.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689793845886"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793845886"}]},"ts":"1689793845886"} 2023-07-19 19:10:45,940 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 19:10:45,942 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 19:10:45,942 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793845942"}]},"ts":"1689793845942"} 2023-07-19 19:10:45,944 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-19 19:10:45,950 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 19:10:45,952 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 19:10:45,952 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 19:10:45,952 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 19:10:45,953 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 19:10:45,953 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=be9b460914639a1f3e7843595d7cbb95, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c5516418575d9b209a305aaf57dfafa6, ASSIGN}] 2023-07-19 19:10:45,958 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c5516418575d9b209a305aaf57dfafa6, ASSIGN 2023-07-19 19:10:45,958 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=be9b460914639a1f3e7843595d7cbb95, ASSIGN 2023-07-19 19:10:45,959 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=be9b460914639a1f3e7843595d7cbb95, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40791,1689793835731; forceNewPlan=false, retain=false 2023-07-19 19:10:45,959 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c5516418575d9b209a305aaf57dfafa6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46111,1689793835594; forceNewPlan=false, retain=false 2023-07-19 19:10:45,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 19:10:46,110 INFO [jenkins-hbase4:37769] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 19:10:46,113 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=c5516418575d9b209a305aaf57dfafa6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:46,113 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=be9b460914639a1f3e7843595d7cbb95, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:46,113 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689793845351.c5516418575d9b209a305aaf57dfafa6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689793846112"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793846112"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793846112"}]},"ts":"1689793846112"} 2023-07-19 19:10:46,113 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689793845351.be9b460914639a1f3e7843595d7cbb95.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689793846112"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793846112"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793846112"}]},"ts":"1689793846112"} 2023-07-19 19:10:46,116 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure c5516418575d9b209a305aaf57dfafa6, server=jenkins-hbase4.apache.org,46111,1689793835594}] 2023-07-19 19:10:46,117 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure be9b460914639a1f3e7843595d7cbb95, server=jenkins-hbase4.apache.org,40791,1689793835731}] 2023-07-19 19:10:46,271 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:46,271 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 19:10:46,275 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40806, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 19:10:46,281 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689793845351.be9b460914639a1f3e7843595d7cbb95. 2023-07-19 19:10:46,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => be9b460914639a1f3e7843595d7cbb95, NAME => 'testtb-testExportWithTargetName,,1689793845351.be9b460914639a1f3e7843595d7cbb95.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 19:10:46,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689793845351.be9b460914639a1f3e7843595d7cbb95. service=AccessControlService 2023-07-19 19:10:46,281 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:10:46,282 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689793845351.c5516418575d9b209a305aaf57dfafa6. 2023-07-19 19:10:46,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName be9b460914639a1f3e7843595d7cbb95 2023-07-19 19:10:46,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c5516418575d9b209a305aaf57dfafa6, NAME => 'testtb-testExportWithTargetName,1,1689793845351.c5516418575d9b209a305aaf57dfafa6.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 19:10:46,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689793845351.be9b460914639a1f3e7843595d7cbb95.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:10:46,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for be9b460914639a1f3e7843595d7cbb95 2023-07-19 19:10:46,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for be9b460914639a1f3e7843595d7cbb95 2023-07-19 19:10:46,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689793845351.c5516418575d9b209a305aaf57dfafa6. service=AccessControlService 2023-07-19 19:10:46,283 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:10:46,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName c5516418575d9b209a305aaf57dfafa6 2023-07-19 19:10:46,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689793845351.c5516418575d9b209a305aaf57dfafa6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:10:46,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c5516418575d9b209a305aaf57dfafa6 2023-07-19 19:10:46,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c5516418575d9b209a305aaf57dfafa6 2023-07-19 19:10:46,286 INFO [StoreOpener-be9b460914639a1f3e7843595d7cbb95-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region be9b460914639a1f3e7843595d7cbb95 2023-07-19 19:10:46,286 INFO [StoreOpener-c5516418575d9b209a305aaf57dfafa6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c5516418575d9b209a305aaf57dfafa6 2023-07-19 19:10:46,289 DEBUG [StoreOpener-be9b460914639a1f3e7843595d7cbb95-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportWithTargetName/be9b460914639a1f3e7843595d7cbb95/cf 2023-07-19 19:10:46,289 DEBUG [StoreOpener-be9b460914639a1f3e7843595d7cbb95-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportWithTargetName/be9b460914639a1f3e7843595d7cbb95/cf 2023-07-19 19:10:46,289 DEBUG [StoreOpener-c5516418575d9b209a305aaf57dfafa6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportWithTargetName/c5516418575d9b209a305aaf57dfafa6/cf 2023-07-19 19:10:46,289 DEBUG [StoreOpener-c5516418575d9b209a305aaf57dfafa6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportWithTargetName/c5516418575d9b209a305aaf57dfafa6/cf 2023-07-19 19:10:46,293 INFO [StoreOpener-c5516418575d9b209a305aaf57dfafa6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c5516418575d9b209a305aaf57dfafa6 columnFamilyName cf 2023-07-19 19:10:46,293 INFO [StoreOpener-be9b460914639a1f3e7843595d7cbb95-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region be9b460914639a1f3e7843595d7cbb95 columnFamilyName cf 2023-07-19 19:10:46,295 INFO [StoreOpener-c5516418575d9b209a305aaf57dfafa6-1] regionserver.HStore(310): Store=c5516418575d9b209a305aaf57dfafa6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:10:46,295 INFO [StoreOpener-be9b460914639a1f3e7843595d7cbb95-1] regionserver.HStore(310): Store=be9b460914639a1f3e7843595d7cbb95/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:10:46,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportWithTargetName/be9b460914639a1f3e7843595d7cbb95 2023-07-19 19:10:46,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportWithTargetName/c5516418575d9b209a305aaf57dfafa6 2023-07-19 19:10:46,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportWithTargetName/be9b460914639a1f3e7843595d7cbb95 2023-07-19 19:10:46,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportWithTargetName/c5516418575d9b209a305aaf57dfafa6 2023-07-19 19:10:46,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c5516418575d9b209a305aaf57dfafa6 2023-07-19 19:10:46,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for be9b460914639a1f3e7843595d7cbb95 2023-07-19 19:10:46,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportWithTargetName/c5516418575d9b209a305aaf57dfafa6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 19:10:46,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportWithTargetName/be9b460914639a1f3e7843595d7cbb95/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 19:10:46,317 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c5516418575d9b209a305aaf57dfafa6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73741264, jitterRate=0.0988304615020752}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 19:10:46,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c5516418575d9b209a305aaf57dfafa6: 2023-07-19 19:10:46,317 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened be9b460914639a1f3e7843595d7cbb95; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75164891, jitterRate=0.12004415690898895}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 19:10:46,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for be9b460914639a1f3e7843595d7cbb95: 2023-07-19 19:10:46,318 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689793845351.c5516418575d9b209a305aaf57dfafa6., pid=15, masterSystemTime=1689793846271 2023-07-19 19:10:46,321 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689793845351.be9b460914639a1f3e7843595d7cbb95., pid=16, masterSystemTime=1689793846271 2023-07-19 19:10:46,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689793845351.c5516418575d9b209a305aaf57dfafa6. 2023-07-19 19:10:46,325 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689793845351.c5516418575d9b209a305aaf57dfafa6. 2023-07-19 19:10:46,326 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=c5516418575d9b209a305aaf57dfafa6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:46,326 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689793845351.c5516418575d9b209a305aaf57dfafa6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689793846326"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689793846326"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689793846326"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689793846326"}]},"ts":"1689793846326"} 2023-07-19 19:10:46,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689793845351.be9b460914639a1f3e7843595d7cbb95. 2023-07-19 19:10:46,326 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689793845351.be9b460914639a1f3e7843595d7cbb95. 2023-07-19 19:10:46,327 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=be9b460914639a1f3e7843595d7cbb95, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:46,328 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689793845351.be9b460914639a1f3e7843595d7cbb95.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689793846327"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689793846327"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689793846327"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689793846327"}]},"ts":"1689793846327"} 2023-07-19 19:10:46,334 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-19 19:10:46,334 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure c5516418575d9b209a305aaf57dfafa6, server=jenkins-hbase4.apache.org,46111,1689793835594 in 214 msec 2023-07-19 19:10:46,336 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-19 19:10:46,337 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c5516418575d9b209a305aaf57dfafa6, ASSIGN in 381 msec 2023-07-19 19:10:46,337 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure be9b460914639a1f3e7843595d7cbb95, server=jenkins-hbase4.apache.org,40791,1689793835731 in 215 msec 2023-07-19 19:10:46,340 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-19 19:10:46,340 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=be9b460914639a1f3e7843595d7cbb95, ASSIGN in 384 msec 2023-07-19 19:10:46,341 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 19:10:46,341 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793846341"}]},"ts":"1689793846341"} 2023-07-19 19:10:46,343 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-19 19:10:46,346 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 19:10:46,351 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-19 19:10:46,367 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40791] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-19 19:10:46,401 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 19:10:46,401 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 19:10:46,401 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 19:10:46,402 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 19:10:46,401 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 19:10:46,410 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 19:10:46,410 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 19:10:46,410 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 19:10:46,410 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 19:10:46,415 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 1.0580 sec 2023-07-19 19:10:46,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 19:10:46,479 INFO [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-19 19:10:46,484 DEBUG [Listener at jenkins-hbase4.apache.org/42871] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-19 19:10:46,485 DEBUG [Listener at jenkins-hbase4.apache.org/42871] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689793845351.be9b460914639a1f3e7843595d7cbb95. 2023-07-19 19:10:46,487 INFO [Listener at jenkins-hbase4.apache.org/42871] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 19:10:46,518 DEBUG [hconnection-0x46f19b93-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:10:46,526 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40818, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:10:46,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 19:10:46,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689793846543 (current time:1689793846543). 2023-07-19 19:10:46,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 19:10:46,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(139): Connect 0x0a994c64 to 127.0.0.1:58293 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:10:46,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@105f3e75, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:10:46,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:10:46,559 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38200, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:10:46,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a994c64 to 127.0.0.1:58293 2023-07-19 19:10:46,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:10:46,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(139): Connect 0x109d6ffa to 127.0.0.1:58293 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:10:46,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@58a3a815, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:10:46,591 DEBUG [hconnection-0x504171c0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:10:46,593 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38212, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:10:46,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x109d6ffa to 127.0.0.1:58293 2023-07-19 19:10:46,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:10:46,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-19 19:10:46,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 19:10:46,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 19:10:46,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 19:10:46,679 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 19:10:46,681 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689794446681 2023-07-19 19:10:46,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 19:10:46,681 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-19 19:10:46,685 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 19:10:46,686 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 19:10:46,687 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 19 msec 2023-07-19 19:10:46,689 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 19:10:46,691 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 19:10:46,692 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 19:10:46,692 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689794446692 2023-07-19 19:10:46,724 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,724 INFO [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-19 19:10:46,724 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:10:46,725 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-19 19:10:46,725 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-19 19:10:46,726 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,726 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,731 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:10:46,731 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:10:46,731 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:46,731 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:10:46,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:10:46,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:10:46,731 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:46,731 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:46,732 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:46,732 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 19:10:46,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:10:46,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:10:46,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:10:46,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:10:46,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,735 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,735 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,736 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-19 19:10:46,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-19 19:10:46,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-19 19:10:46,738 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 19:10:46,738 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 19:10:46,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,738 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 19:10:46,740 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,740 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,740 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,741 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 19:10:46,741 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 19:10:46,741 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:10:46,741 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 19:10:46,742 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 19:10:46,741 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:10:46,742 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-19 19:10:46,742 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:10:46,743 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45693,1689793835672' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-19 19:10:46,744 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 19:10:46,744 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-19 19:10:46,744 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40791,1689793835731' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-19 19:10:46,743 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 19:10:46,744 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-19 19:10:46,744 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46111,1689793835594' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-19 19:10:46,747 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,747 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,747 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:46,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:46,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:10:46,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:10:46,748 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:46,748 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,748 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,748 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,748 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:10:46,748 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:10:46,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:10:46,748 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,748 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:10:46,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:10:46,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:46,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:10:46,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:46,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:10:46,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40791,1689793835731' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-19 19:10:46,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6cfb0a57[Count = 1] remaining members to acquire global barrier 2023-07-19 19:10:46,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:46,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:10:46,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:10:46,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:10:46,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:10:46,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:46,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:10:46,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:46,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:10:46,760 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46111,1689793835594' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-19 19:10:46,760 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6cfb0a57[Count = 0] remaining members to acquire global barrier 2023-07-19 19:10:46,760 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-19 19:10:46,760 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,763 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,764 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,764 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,764 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 19:10:46,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,764 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 19:10:46,764 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:46,765 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:46,765 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 19:10:46,765 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:10:46,765 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:10:46,765 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689793845351.c5516418575d9b209a305aaf57dfafa6. 2023-07-19 19:10:46,765 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689793845351.be9b460914639a1f3e7843595d7cbb95. 2023-07-19 19:10:46,765 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:10:46,772 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 19:10:46,765 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:10:46,772 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-19 19:10:46,772 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45693,1689793835672' in zk 2023-07-19 19:10:46,772 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689793845351.c5516418575d9b209a305aaf57dfafa6. started... 2023-07-19 19:10:46,772 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689793845351.be9b460914639a1f3e7843595d7cbb95. started... 2023-07-19 19:10:46,776 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 19:10:46,776 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:10:46,776 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-19 19:10:46,778 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for be9b460914639a1f3e7843595d7cbb95: 2023-07-19 19:10:46,778 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c5516418575d9b209a305aaf57dfafa6: 2023-07-19 19:10:46,779 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689793845351.c5516418575d9b209a305aaf57dfafa6.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,779 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689793845351.be9b460914639a1f3e7843595d7cbb95.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,785 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:10:46,785 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:10:46,789 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 19:10:46,789 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 19:10:46,792 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:10:46,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 19:10:46,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:10:46,801 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 19:10:46,829 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689793845351.be9b460914639a1f3e7843595d7cbb95. completed. 2023-07-19 19:10:46,829 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689793845351.be9b460914639a1f3e7843595d7cbb95. 2023-07-19 19:10:46,830 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:10:46,830 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:10:46,830 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:46,830 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-19 19:10:46,835 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40791,1689793835731' in zk 2023-07-19 19:10:46,842 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 19:10:46,842 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:46,842 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:10:46,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:46,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:10:46,842 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-19 19:10:46,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:10:46,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:10:46,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:10:46,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:46,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:10:46,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:46,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:10:46,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,850 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689793845351.c5516418575d9b209a305aaf57dfafa6. completed. 2023-07-19 19:10:46,851 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689793845351.c5516418575d9b209a305aaf57dfafa6. 2023-07-19 19:10:46,851 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:10:46,851 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:10:46,851 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:46,851 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-19 19:10:46,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:46,851 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46111,1689793835594' in zk 2023-07-19 19:10:46,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:10:46,854 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:46,854 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 19:10:46,854 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:10:46,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40791,1689793835731': 2023-07-19 19:10:46,854 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-19 19:10:46,856 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40791,1689793835731' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-19 19:10:46,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:46,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:10:46,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:10:46,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:10:46,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:10:46,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:46,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:10:46,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:46,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:10:46,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:46,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:10:46,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:46,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,46111,1689793835594': 2023-07-19 19:10:46,869 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46111,1689793835594' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-19 19:10:46,869 INFO [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-19 19:10:46,869 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 19:10:46,869 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 19:10:46,869 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,869 INFO [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 19:10:46,878 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,878 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,879 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:10:46,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,879 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:10:46,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,878 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,878 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:10:46,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:10:46,879 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:10:46,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:10:46,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:10:46,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:10:46,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:10:46,880 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:46,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:10:46,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:10:46,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:10:46,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,881 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:10:46,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:10:46,882 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:46,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:46,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:10:46,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:46,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:10:46,884 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:46,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,884 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:10:46,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:46,885 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:46,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:10:46,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:46,900 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:10:46,900 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:10:46,900 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:10:46,900 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:46,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:10:46,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:10:46,900 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:10:46,900 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:10:46,900 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,901 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-19 19:10:46,902 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,902 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 19:10:46,900 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,900 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:10:46,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:10:46,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:10:46,902 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:10:46,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:10:46,902 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:46,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:10:46,900 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:10:46,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:10:46,903 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,903 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-19 19:10:46,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:10:46,903 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:46,903 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,903 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:10:46,903 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:46,903 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,903 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:10:46,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:10:46,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:10:46,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:10:46,925 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:46,985 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:47,002 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:10:47,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 19:10:47,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:10:47,004 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 19:10:47,005 WARN [DataStreamer for file /user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/emptySnaptb0-testExportWithTargetName/.snapshotinfo] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-19 19:10:47,026 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-19 19:10:47,026 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:47,026 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-19 19:10:47,027 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689793846681Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689793846925 (+244 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689793846925Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689793846925Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689793846940 (+15 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689793846972 (+32 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689793847026 (+54 ms) 2023-07-19 19:10:47,029 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 19:10:47,032 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 344 msec 2023-07-19 19:10:47,305 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:10:47,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 19:10:47,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 19:10:47,322 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40791] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689793845351.be9b460914639a1f3e7843595d7cbb95. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 19:10:47,324 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46111] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689793845351.c5516418575d9b209a305aaf57dfafa6. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 19:10:47,329 DEBUG [Listener at jenkins-hbase4.apache.org/42871] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-19 19:10:47,330 DEBUG [Listener at jenkins-hbase4.apache.org/42871] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689793845351.be9b460914639a1f3e7843595d7cbb95. 2023-07-19 19:10:47,330 INFO [Listener at jenkins-hbase4.apache.org/42871] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 19:10:47,347 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 19:10:47,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689793847347 (current time:1689793847347). 2023-07-19 19:10:47,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 19:10:47,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(139): Connect 0x56eb8def to 127.0.0.1:58293 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:10:47,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7592bd53, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:10:47,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:10:47,359 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38222, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:10:47,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x56eb8def to 127.0.0.1:58293 2023-07-19 19:10:47,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:10:47,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(139): Connect 0x55951ad6 to 127.0.0.1:58293 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:10:47,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f9b617e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:10:47,373 DEBUG [hconnection-0x3f0327fb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:10:47,377 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38238, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:10:47,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x55951ad6 to 127.0.0.1:58293 2023-07-19 19:10:47,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:10:47,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-19 19:10:47,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 19:10:47,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 19:10:47,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 19:10:47,391 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 19:10:47,398 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689794447398 2023-07-19 19:10:47,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 19:10:47,398 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-19 19:10:47,401 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 19:10:47,401 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 19:10:47,401 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 19:10:47,403 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 19:10:47,406 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 16 msec 2023-07-19 19:10:47,407 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 19:10:47,408 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689794447408 2023-07-19 19:10:47,442 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-19 19:10:47,442 INFO [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-19 19:10:47,442 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:10:47,444 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-19 19:10:47,444 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-19 19:10:47,444 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,444 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,446 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:10:47,446 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:10:47,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:10:47,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:10:47,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:10:47,446 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:10:47,446 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:47,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:10:47,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:10:47,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:10:47,447 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:47,447 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:47,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,447 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:47,447 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,447 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,447 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 19:10:47,448 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-19 19:10:47,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,449 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 19:10:47,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-19 19:10:47,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,449 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-19 19:10:47,449 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 19:10:47,449 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 19:10:47,449 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:10:47,451 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 19:10:47,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-19 19:10:47,451 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-19 19:10:47,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,451 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 19:10:47,451 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:10:47,451 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-19 19:10:47,451 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 19:10:47,452 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 19:10:47,451 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40791,1689793835731' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-19 19:10:47,455 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-19 19:10:47,455 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45693,1689793835672' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-19 19:10:47,455 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-19 19:10:47,455 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 19:10:47,455 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:10:47,456 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 19:10:47,456 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-19 19:10:47,456 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46111,1689793835594' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-19 19:10:47,459 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,461 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:47,461 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,461 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:47,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:47,461 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:10:47,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:10:47,462 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,462 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:10:47,462 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,462 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,462 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:10:47,462 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:10:47,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:10:47,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:10:47,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 19:10:47,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:47,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:10:47,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:47,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:10:47,466 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40791,1689793835731' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-19 19:10:47,466 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d5c126a[Count = 1] remaining members to acquire global barrier 2023-07-19 19:10:47,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:47,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:10:47,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:10:47,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:10:47,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:10:47,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 19:10:47,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:47,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:10:47,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:47,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:10:47,470 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46111,1689793835594' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-19 19:10:47,470 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d5c126a[Count = 0] remaining members to acquire global barrier 2023-07-19 19:10:47,470 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-19 19:10:47,470 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,475 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,475 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,475 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,476 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:47,476 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 19:10:47,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 19:10:47,476 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 19:10:47,476 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 19:10:47,476 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-19 19:10:47,476 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45693,1689793835672' in zk 2023-07-19 19:10:47,476 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:47,476 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 19:10:47,486 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:10:47,486 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689793845351.c5516418575d9b209a305aaf57dfafa6. 2023-07-19 19:10:47,486 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:10:47,486 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689793845351.c5516418575d9b209a305aaf57dfafa6. started... 2023-07-19 19:10:47,486 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 19:10:47,486 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:10:47,486 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-19 19:10:47,486 INFO [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c5516418575d9b209a305aaf57dfafa6 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-19 19:10:47,491 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:10:47,491 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689793845351.be9b460914639a1f3e7843595d7cbb95. 2023-07-19 19:10:47,491 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:10:47,491 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689793845351.be9b460914639a1f3e7843595d7cbb95. started... 2023-07-19 19:10:47,491 INFO [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.HRegion(2745): Flushing be9b460914639a1f3e7843595d7cbb95 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-19 19:10:47,501 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:10:47,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 19:10:47,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:10:47,503 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 19:10:47,659 INFO [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307191bceebbd1fdb421ca2b4899646fe25f8 to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307191bceebbd1fdb421ca2b4899646fe25f8 2023-07-19 19:10:47,659 INFO [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307196f6ad87a6d8e4f50853d70c2ed3709a5 to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307196f6ad87a6d8e4f50853d70c2ed3709a5 2023-07-19 19:10:47,691 INFO [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportWithTargetName/be9b460914639a1f3e7843595d7cbb95/.tmp/cf/20c982c0033c4fb69a8540786454a347 2023-07-19 19:10:47,694 INFO [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportWithTargetName/c5516418575d9b209a305aaf57dfafa6/.tmp/cf/e666f8897a05458d8ed627203a97fd62 2023-07-19 19:10:47,703 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportWithTargetName/be9b460914639a1f3e7843595d7cbb95/.tmp/cf/20c982c0033c4fb69a8540786454a347 as hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportWithTargetName/be9b460914639a1f3e7843595d7cbb95/cf/20c982c0033c4fb69a8540786454a347 2023-07-19 19:10:47,703 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:10:47,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 19:10:47,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:10:47,706 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportWithTargetName/c5516418575d9b209a305aaf57dfafa6/.tmp/cf/e666f8897a05458d8ed627203a97fd62 as hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportWithTargetName/c5516418575d9b209a305aaf57dfafa6/cf/e666f8897a05458d8ed627203a97fd62 2023-07-19 19:10:47,706 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 19:10:47,713 INFO [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportWithTargetName/be9b460914639a1f3e7843595d7cbb95/cf/20c982c0033c4fb69a8540786454a347, entries=3, sequenceid=6, filesize=5.4 K 2023-07-19 19:10:47,715 INFO [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportWithTargetName/c5516418575d9b209a305aaf57dfafa6/cf/e666f8897a05458d8ed627203a97fd62, entries=47, sequenceid=6, filesize=12.8 K 2023-07-19 19:10:47,718 INFO [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for be9b460914639a1f3e7843595d7cbb95 in 227ms, sequenceid=6, compaction requested=false 2023-07-19 19:10:47,718 INFO [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for c5516418575d9b209a305aaf57dfafa6 in 232ms, sequenceid=6, compaction requested=false 2023-07-19 19:10:47,719 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-19 19:10:47,719 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-19 19:10:47,722 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c5516418575d9b209a305aaf57dfafa6: 2023-07-19 19:10:47,722 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for be9b460914639a1f3e7843595d7cbb95: 2023-07-19 19:10:47,722 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689793845351.c5516418575d9b209a305aaf57dfafa6.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-19 19:10:47,722 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689793845351.be9b460914639a1f3e7843595d7cbb95.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-19 19:10:47,722 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:10:47,722 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:10:47,722 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportWithTargetName/c5516418575d9b209a305aaf57dfafa6/cf/e666f8897a05458d8ed627203a97fd62] hfiles 2023-07-19 19:10:47,722 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportWithTargetName/be9b460914639a1f3e7843595d7cbb95/cf/20c982c0033c4fb69a8540786454a347] hfiles 2023-07-19 19:10:47,723 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportWithTargetName/c5516418575d9b209a305aaf57dfafa6/cf/e666f8897a05458d8ed627203a97fd62 for snapshot=snaptb0-testExportWithTargetName 2023-07-19 19:10:47,723 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportWithTargetName/be9b460914639a1f3e7843595d7cbb95/cf/20c982c0033c4fb69a8540786454a347 for snapshot=snaptb0-testExportWithTargetName 2023-07-19 19:10:47,758 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689793845351.be9b460914639a1f3e7843595d7cbb95. completed. 2023-07-19 19:10:47,758 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689793845351.be9b460914639a1f3e7843595d7cbb95. 2023-07-19 19:10:47,758 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:10:47,758 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:10:47,758 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:47,759 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-19 19:10:47,759 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40791,1689793835731' in zk 2023-07-19 19:10:47,766 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 19:10:47,766 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:47,766 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:10:47,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:47,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:10:47,766 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-19 19:10:47,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:10:47,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:10:47,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:10:47,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 19:10:47,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:47,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:10:47,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:47,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:10:47,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 19:10:47,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:47,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:10:47,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40791,1689793835731': 2023-07-19 19:10:47,774 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40791,1689793835731' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-19 19:10:48,006 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:10:48,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 19:10:48,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:10:48,008 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-19 19:10:48,159 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689793845351.c5516418575d9b209a305aaf57dfafa6. completed. 2023-07-19 19:10:48,159 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689793845351.c5516418575d9b209a305aaf57dfafa6. 2023-07-19 19:10:48,159 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:10:48,159 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:10:48,159 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:48,159 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-19 19:10:48,159 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46111,1689793835594' in zk 2023-07-19 19:10:48,161 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:48,161 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 19:10:48,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:48,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:10:48,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:10:48,161 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:10:48,162 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-19 19:10:48,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:10:48,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:10:48,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 19:10:48,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:48,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:10:48,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:48,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:10:48,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 19:10:48,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:48,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:10:48,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:48,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,46111,1689793835594': 2023-07-19 19:10:48,169 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46111,1689793835594' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-19 19:10:48,169 INFO [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-19 19:10:48,169 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 19:10:48,169 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 19:10:48,169 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-19 19:10:48,169 INFO [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 19:10:48,171 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 19:10:48,171 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 19:10:48,171 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 19:10:48,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 19:10:48,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 19:10:48,172 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 19:10:48,171 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:10:48,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 19:10:48,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 19:10:48,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 19:10:48,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:10:48,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:10:48,172 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:10:48,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:10:48,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:10:48,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 19:10:48,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 19:10:48,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:10:48,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:10:48,171 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:10:48,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:10:48,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:10:48,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 19:10:48,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 19:10:48,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:10:48,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 19:10:48,174 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:48,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 19:10:48,174 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:10:48,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:10:48,175 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:48,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 19:10:48,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:48,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:10:48,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:48,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:10:48,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 19:10:48,181 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:48,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:48,181 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:10:48,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:10:48,181 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:48,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:48,194 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:48,195 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:10:48,195 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:10:48,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:10:48,195 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 19:10:48,195 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:10:48,194 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:10:48,196 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:10:48,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:10:48,196 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:10:48,196 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:10:48,195 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-19 19:10:48,195 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:10:48,196 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-19 19:10:48,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:10:48,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:10:48,197 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-19 19:10:48,196 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:48,197 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 19:10:48,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:10:48,197 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 19:10:48,197 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:10:48,197 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 19:10:48,197 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:10:48,197 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:10:48,197 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 19:10:48,197 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 19:10:48,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:10:48,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:10:48,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:10:48,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:10:48,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:10:48,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:10:48,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:10:48,198 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307191bceebbd1fdb421ca2b4899646fe25f8, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307196f6ad87a6d8e4f50853d70c2ed3709a5] mob files 2023-07-19 19:10:48,198 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307191bceebbd1fdb421ca2b4899646fe25f8 2023-07-19 19:10:48,198 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307196f6ad87a6d8e4f50853d70c2ed3709a5 2023-07-19 19:10:48,212 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-19 19:10:48,213 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-19 19:10:48,509 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:10:48,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 19:10:48,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:10:48,512 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-19 19:10:48,665 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-19 19:10:48,704 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-19 19:10:48,704 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-19 19:10:48,705 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-19 19:10:48,705 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689793847399Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689793848212 (+813 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689793848212Loading Region manifests for snaptb0-testExportWithTargetName at 1689793848213 (+1 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1689793848222 (+9 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689793848649 (+427 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689793848704 (+55 ms) 2023-07-19 19:10:48,707 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 19:10:48,711 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 1.3070 sec 2023-07-19 19:10:49,512 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:10:49,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 19:10:49,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 19:10:49,516 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793849516 2023-07-19 19:10:49,517 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43367, tgtDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793849516, rawTgtDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793849516, srcFsUri=hdfs://localhost:43367, srcDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978 2023-07-19 19:10:49,564 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43367, inputRoot=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978 2023-07-19 19:10:49,564 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-645416822_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793849516, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793849516/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-19 19:10:49,565 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43367, inputRoot=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978, snapshotDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-19 19:10:49,618 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793849516/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-19 19:10:50,187 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 19:10:50,187 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 19:10:50,188 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 19:10:50,188 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 19:10:50,188 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 19:10:50,189 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 19:10:50,189 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 19:10:50,273 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/hadoop-8931147125419249776.jar 2023-07-19 19:10:50,274 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 19:10:50,275 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 19:10:50,276 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 19:10:50,276 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 19:10:50,277 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 19:10:50,277 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 19:10:50,278 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 19:10:50,279 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 19:10:50,280 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 19:10:50,280 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 19:10:50,281 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 19:10:50,282 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 19:10:50,282 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 19:10:50,283 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 19:10:50,284 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 19:10:50,285 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 19:10:50,289 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:10:50,290 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:10:50,290 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 19:10:50,291 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:10:50,291 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:10:50,292 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 19:10:50,292 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 19:10:51,809 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 19:10:51,922 WARN [Listener at jenkins-hbase4.apache.org/42871] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 19:10:51,928 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-19 19:10:51,940 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-19 19:10:52,395 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 19:10:52,395 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 19:10:53,153 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843898_0001_000001 (auth:SIMPLE) 2023-07-19 19:10:57,988 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843898_0001_000001 (auth:SIMPLE) 2023-07-19 19:11:00,381 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843898_0001_000001 (auth:SIMPLE) 2023-07-19 19:11:04,197 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843898_0001_000001 (auth:SIMPLE) 2023-07-19 19:11:05,805 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 19:11:05,807 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 19:11:05,818 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-19 19:11:05,818 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 19:11:05,819 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 19:11:05,819 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1054544951_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-19 19:11:05,820 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(367): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-19 19:11:05,820 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(367): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-19 19:11:05,820 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1054544951_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793849516/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793849516/.hbase-snapshot/testExportWithTargetName 2023-07-19 19:11:05,821 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(367): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793849516/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-19 19:11:05,821 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(367): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793849516/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-19 19:11:05,833 INFO [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-19 19:11:05,839 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-19 19:11:05,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-19 19:11:05,853 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793865853"}]},"ts":"1689793865853"} 2023-07-19 19:11:05,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-19 19:11:05,855 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-19 19:11:05,930 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-19 19:11:05,932 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=be9b460914639a1f3e7843595d7cbb95, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c5516418575d9b209a305aaf57dfafa6, UNASSIGN}] 2023-07-19 19:11:05,935 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=be9b460914639a1f3e7843595d7cbb95, UNASSIGN 2023-07-19 19:11:05,935 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c5516418575d9b209a305aaf57dfafa6, UNASSIGN 2023-07-19 19:11:05,936 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=be9b460914639a1f3e7843595d7cbb95, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:05,936 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=c5516418575d9b209a305aaf57dfafa6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:05,937 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689793845351.c5516418575d9b209a305aaf57dfafa6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689793865936"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793865936"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793865936"}]},"ts":"1689793865936"} 2023-07-19 19:11:05,937 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689793845351.be9b460914639a1f3e7843595d7cbb95.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689793865936"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793865936"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793865936"}]},"ts":"1689793865936"} 2023-07-19 19:11:05,939 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure be9b460914639a1f3e7843595d7cbb95, server=jenkins-hbase4.apache.org,40791,1689793835731}] 2023-07-19 19:11:05,940 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure c5516418575d9b209a305aaf57dfafa6, server=jenkins-hbase4.apache.org,46111,1689793835594}] 2023-07-19 19:11:05,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-19 19:11:06,105 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c5516418575d9b209a305aaf57dfafa6 2023-07-19 19:11:06,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c5516418575d9b209a305aaf57dfafa6, disabling compactions & flushes 2023-07-19 19:11:06,106 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689793845351.c5516418575d9b209a305aaf57dfafa6. 2023-07-19 19:11:06,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689793845351.c5516418575d9b209a305aaf57dfafa6. 2023-07-19 19:11:06,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689793845351.c5516418575d9b209a305aaf57dfafa6. after waiting 0 ms 2023-07-19 19:11:06,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689793845351.c5516418575d9b209a305aaf57dfafa6. 2023-07-19 19:11:06,111 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close be9b460914639a1f3e7843595d7cbb95 2023-07-19 19:11:06,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing be9b460914639a1f3e7843595d7cbb95, disabling compactions & flushes 2023-07-19 19:11:06,111 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689793845351.be9b460914639a1f3e7843595d7cbb95. 2023-07-19 19:11:06,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689793845351.be9b460914639a1f3e7843595d7cbb95. 2023-07-19 19:11:06,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689793845351.be9b460914639a1f3e7843595d7cbb95. after waiting 0 ms 2023-07-19 19:11:06,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689793845351.be9b460914639a1f3e7843595d7cbb95. 2023-07-19 19:11:06,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportWithTargetName/c5516418575d9b209a305aaf57dfafa6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 19:11:06,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportWithTargetName/be9b460914639a1f3e7843595d7cbb95/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 19:11:06,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:11:06,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:11:06,147 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689793845351.c5516418575d9b209a305aaf57dfafa6. 2023-07-19 19:11:06,147 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689793845351.be9b460914639a1f3e7843595d7cbb95. 2023-07-19 19:11:06,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c5516418575d9b209a305aaf57dfafa6: 2023-07-19 19:11:06,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for be9b460914639a1f3e7843595d7cbb95: 2023-07-19 19:11:06,150 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed be9b460914639a1f3e7843595d7cbb95 2023-07-19 19:11:06,151 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=be9b460914639a1f3e7843595d7cbb95, regionState=CLOSED 2023-07-19 19:11:06,151 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689793845351.be9b460914639a1f3e7843595d7cbb95.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689793866151"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793866151"}]},"ts":"1689793866151"} 2023-07-19 19:11:06,153 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=c5516418575d9b209a305aaf57dfafa6, regionState=CLOSED 2023-07-19 19:11:06,153 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689793845351.c5516418575d9b209a305aaf57dfafa6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689793866153"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793866153"}]},"ts":"1689793866153"} 2023-07-19 19:11:06,154 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c5516418575d9b209a305aaf57dfafa6 2023-07-19 19:11:06,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-19 19:11:06,157 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-19 19:11:06,157 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure be9b460914639a1f3e7843595d7cbb95, server=jenkins-hbase4.apache.org,40791,1689793835731 in 214 msec 2023-07-19 19:11:06,158 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-19 19:11:06,158 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure c5516418575d9b209a305aaf57dfafa6, server=jenkins-hbase4.apache.org,46111,1689793835594 in 215 msec 2023-07-19 19:11:06,159 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=be9b460914639a1f3e7843595d7cbb95, UNASSIGN in 225 msec 2023-07-19 19:11:06,161 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-19 19:11:06,161 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c5516418575d9b209a305aaf57dfafa6, UNASSIGN in 226 msec 2023-07-19 19:11:06,162 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793866162"}]},"ts":"1689793866162"} 2023-07-19 19:11:06,164 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-19 19:11:06,199 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-19 19:11:06,203 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 358 msec 2023-07-19 19:11:06,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-19 19:11:06,458 INFO [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-19 19:11:06,463 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-19 19:11:06,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 19:11:06,475 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 19:11:06,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-19 19:11:06,478 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 19:11:06,482 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40791] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-19 19:11:06,485 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportWithTargetName/be9b460914639a1f3e7843595d7cbb95 2023-07-19 19:11:06,485 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportWithTargetName/c5516418575d9b209a305aaf57dfafa6 2023-07-19 19:11:06,489 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportWithTargetName/be9b460914639a1f3e7843595d7cbb95/cf, FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportWithTargetName/be9b460914639a1f3e7843595d7cbb95/recovered.edits] 2023-07-19 19:11:06,489 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportWithTargetName/c5516418575d9b209a305aaf57dfafa6/cf, FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportWithTargetName/c5516418575d9b209a305aaf57dfafa6/recovered.edits] 2023-07-19 19:11:06,499 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportWithTargetName/c5516418575d9b209a305aaf57dfafa6/cf/e666f8897a05458d8ed627203a97fd62 to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testExportWithTargetName/c5516418575d9b209a305aaf57dfafa6/cf/e666f8897a05458d8ed627203a97fd62 2023-07-19 19:11:06,499 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportWithTargetName/be9b460914639a1f3e7843595d7cbb95/cf/20c982c0033c4fb69a8540786454a347 to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testExportWithTargetName/be9b460914639a1f3e7843595d7cbb95/cf/20c982c0033c4fb69a8540786454a347 2023-07-19 19:11:06,505 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportWithTargetName/be9b460914639a1f3e7843595d7cbb95/recovered.edits/9.seqid to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testExportWithTargetName/be9b460914639a1f3e7843595d7cbb95/recovered.edits/9.seqid 2023-07-19 19:11:06,505 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportWithTargetName/c5516418575d9b209a305aaf57dfafa6/recovered.edits/9.seqid to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testExportWithTargetName/c5516418575d9b209a305aaf57dfafa6/recovered.edits/9.seqid 2023-07-19 19:11:06,505 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportWithTargetName/be9b460914639a1f3e7843595d7cbb95 2023-07-19 19:11:06,506 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportWithTargetName/c5516418575d9b209a305aaf57dfafa6 2023-07-19 19:11:06,506 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-19 19:11:06,507 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-19 19:11:06,508 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-19 19:11:06,512 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307191bceebbd1fdb421ca2b4899646fe25f8 to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307191bceebbd1fdb421ca2b4899646fe25f8 2023-07-19 19:11:06,514 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307196f6ad87a6d8e4f50853d70c2ed3709a5 to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307196f6ad87a6d8e4f50853d70c2ed3709a5 2023-07-19 19:11:06,515 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-19 19:11:06,518 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 19:11:06,545 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-19 19:11:06,607 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 19:11:06,609 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 19:11:06,609 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 19:11:06,611 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 19:11:06,612 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-19 19:11:06,614 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 19:11:06,614 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-19 19:11:06,614 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689793845351.be9b460914639a1f3e7843595d7cbb95.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689793866614"}]},"ts":"9223372036854775807"} 2023-07-19 19:11:06,615 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689793845351.c5516418575d9b209a305aaf57dfafa6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689793866614"}]},"ts":"9223372036854775807"} 2023-07-19 19:11:06,617 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 19:11:06,617 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => be9b460914639a1f3e7843595d7cbb95, NAME => 'testtb-testExportWithTargetName,,1689793845351.be9b460914639a1f3e7843595d7cbb95.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c5516418575d9b209a305aaf57dfafa6, NAME => 'testtb-testExportWithTargetName,1,1689793845351.c5516418575d9b209a305aaf57dfafa6.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 19:11:06,618 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-19 19:11:06,618 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689793866618"}]},"ts":"9223372036854775807"} 2023-07-19 19:11:06,620 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-19 19:11:06,631 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:06,631 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-19 19:11:06,631 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 19:11:06,631 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:06,631 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:06,631 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:06,631 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-19 19:11:06,632 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 19:11:06,633 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-19 19:11:06,633 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 19:11:06,633 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-19 19:11:06,633 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 19:11:06,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-19 19:11:06,686 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 19:11:06,688 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 222 msec 2023-07-19 19:11:06,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-19 19:11:06,736 INFO [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-19 19:11:06,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-19 19:11:06,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-19 19:11:06,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-19 19:11:06,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-19 19:11:06,792 INFO [Listener at jenkins-hbase4.apache.org/42871] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=756 (was 706) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/cluster_2c362217-96ff-d8ab-49ae-f9e6c2163f5d/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1054544951_17 at /127.0.0.1:36008 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/cluster_2c362217-96ff-d8ab-49ae-f9e6c2163f5d/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/cluster_2c362217-96ff-d8ab-49ae-f9e6c2163f5d/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1316 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (274932937) connection to jenkins-hbase4.apache.org/172.31.14.131:42871 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (274932937) connection to jenkins-hbase4.apache.org/172.31.14.131:40377 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1164f60d-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/cluster_2c362217-96ff-d8ab-49ae-f9e6c2163f5d/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1164f60d-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1164f60d-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: hconnection-0x1164f60d-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/cluster_2c362217-96ff-d8ab-49ae-f9e6c2163f5d/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1587682170_1 at /127.0.0.1:35986 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1587682170_1 at /127.0.0.1:50976 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1054544951_17 at /127.0.0.1:50998 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/cluster_2c362217-96ff-d8ab-49ae-f9e6c2163f5d/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1054544951_17 at /127.0.0.1:58766 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (274932937) connection to jenkins-hbase4.apache.org/172.31.14.131:41067 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=933 (was 898) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=462 (was 377) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 176) - ProcessCount LEAK? -, AvailableMemoryMB=2948 (was 4765) 2023-07-19 19:11:06,793 WARN [Listener at jenkins-hbase4.apache.org/42871] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-07-19 19:11:06,814 INFO [Listener at jenkins-hbase4.apache.org/42871] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=756, OpenFileDescriptor=933, MaxFileDescriptor=60000, SystemLoadAverage=462, ProcessCount=181, AvailableMemoryMB=2947 2023-07-19 19:11:06,814 WARN [Listener at jenkins-hbase4.apache.org/42871] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-07-19 19:11:06,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-19 19:11:06,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-19 19:11:06,821 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 19:11:06,823 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-19 19:11:06,824 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 19:11:06,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 19:11:06,826 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemState/258124b48c3dff72b2b66d74d64d43bf 2023-07-19 19:11:06,827 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemState/fb98a264d35f77dfa6d65bc61c662ca5 2023-07-19 19:11:06,827 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemState/258124b48c3dff72b2b66d74d64d43bf empty. 2023-07-19 19:11:06,827 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemState/fb98a264d35f77dfa6d65bc61c662ca5 empty. 2023-07-19 19:11:06,828 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemState/fb98a264d35f77dfa6d65bc61c662ca5 2023-07-19 19:11:06,828 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemState/258124b48c3dff72b2b66d74d64d43bf 2023-07-19 19:11:06,828 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-19 19:11:06,840 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-19 19:11:06,842 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => fb98a264d35f77dfa6d65bc61c662ca5, NAME => 'testtb-testExportFileSystemState,1,1689793866816.fb98a264d35f77dfa6d65bc61c662ca5.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp 2023-07-19 19:11:06,842 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 258124b48c3dff72b2b66d74d64d43bf, NAME => 'testtb-testExportFileSystemState,,1689793866816.258124b48c3dff72b2b66d74d64d43bf.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp 2023-07-19 19:11:06,863 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689793866816.fb98a264d35f77dfa6d65bc61c662ca5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:11:06,863 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689793866816.258124b48c3dff72b2b66d74d64d43bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:11:06,865 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing fb98a264d35f77dfa6d65bc61c662ca5, disabling compactions & flushes 2023-07-19 19:11:06,866 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 258124b48c3dff72b2b66d74d64d43bf, disabling compactions & flushes 2023-07-19 19:11:06,866 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689793866816.fb98a264d35f77dfa6d65bc61c662ca5. 2023-07-19 19:11:06,866 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689793866816.258124b48c3dff72b2b66d74d64d43bf. 2023-07-19 19:11:06,866 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689793866816.fb98a264d35f77dfa6d65bc61c662ca5. 2023-07-19 19:11:06,866 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689793866816.258124b48c3dff72b2b66d74d64d43bf. 2023-07-19 19:11:06,866 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689793866816.fb98a264d35f77dfa6d65bc61c662ca5. after waiting 0 ms 2023-07-19 19:11:06,866 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689793866816.258124b48c3dff72b2b66d74d64d43bf. after waiting 0 ms 2023-07-19 19:11:06,866 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689793866816.fb98a264d35f77dfa6d65bc61c662ca5. 2023-07-19 19:11:06,866 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689793866816.258124b48c3dff72b2b66d74d64d43bf. 2023-07-19 19:11:06,866 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689793866816.fb98a264d35f77dfa6d65bc61c662ca5. 2023-07-19 19:11:06,866 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689793866816.258124b48c3dff72b2b66d74d64d43bf. 2023-07-19 19:11:06,866 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for fb98a264d35f77dfa6d65bc61c662ca5: 2023-07-19 19:11:06,866 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 258124b48c3dff72b2b66d74d64d43bf: 2023-07-19 19:11:06,869 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 19:11:06,870 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689793866816.fb98a264d35f77dfa6d65bc61c662ca5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689793866870"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793866870"}]},"ts":"1689793866870"} 2023-07-19 19:11:06,870 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689793866816.258124b48c3dff72b2b66d74d64d43bf.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689793866870"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793866870"}]},"ts":"1689793866870"} 2023-07-19 19:11:06,873 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 19:11:06,874 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 19:11:06,874 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793866874"}]},"ts":"1689793866874"} 2023-07-19 19:11:06,876 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-19 19:11:06,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 19:11:06,930 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 19:11:06,931 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 19:11:06,932 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 19:11:06,932 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 19:11:06,932 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 19:11:06,932 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=258124b48c3dff72b2b66d74d64d43bf, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fb98a264d35f77dfa6d65bc61c662ca5, ASSIGN}] 2023-07-19 19:11:06,935 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fb98a264d35f77dfa6d65bc61c662ca5, ASSIGN 2023-07-19 19:11:06,935 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=258124b48c3dff72b2b66d74d64d43bf, ASSIGN 2023-07-19 19:11:06,937 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fb98a264d35f77dfa6d65bc61c662ca5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40791,1689793835731; forceNewPlan=false, retain=false 2023-07-19 19:11:06,937 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=258124b48c3dff72b2b66d74d64d43bf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45693,1689793835672; forceNewPlan=false, retain=false 2023-07-19 19:11:07,087 INFO [jenkins-hbase4:37769] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 19:11:07,090 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=fb98a264d35f77dfa6d65bc61c662ca5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:07,090 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=258124b48c3dff72b2b66d74d64d43bf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:07,090 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689793866816.fb98a264d35f77dfa6d65bc61c662ca5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689793867089"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793867089"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793867089"}]},"ts":"1689793867089"} 2023-07-19 19:11:07,090 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689793866816.258124b48c3dff72b2b66d74d64d43bf.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689793867089"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793867089"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793867089"}]},"ts":"1689793867089"} 2023-07-19 19:11:07,092 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure fb98a264d35f77dfa6d65bc61c662ca5, server=jenkins-hbase4.apache.org,40791,1689793835731}] 2023-07-19 19:11:07,093 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 258124b48c3dff72b2b66d74d64d43bf, server=jenkins-hbase4.apache.org,45693,1689793835672}] 2023-07-19 19:11:07,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 19:11:07,253 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689793866816.fb98a264d35f77dfa6d65bc61c662ca5. 2023-07-19 19:11:07,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fb98a264d35f77dfa6d65bc61c662ca5, NAME => 'testtb-testExportFileSystemState,1,1689793866816.fb98a264d35f77dfa6d65bc61c662ca5.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 19:11:07,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689793866816.fb98a264d35f77dfa6d65bc61c662ca5. service=AccessControlService 2023-07-19 19:11:07,254 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:11:07,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState fb98a264d35f77dfa6d65bc61c662ca5 2023-07-19 19:11:07,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689793866816.fb98a264d35f77dfa6d65bc61c662ca5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:11:07,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fb98a264d35f77dfa6d65bc61c662ca5 2023-07-19 19:11:07,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fb98a264d35f77dfa6d65bc61c662ca5 2023-07-19 19:11:07,257 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689793866816.258124b48c3dff72b2b66d74d64d43bf. 2023-07-19 19:11:07,257 INFO [StoreOpener-fb98a264d35f77dfa6d65bc61c662ca5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fb98a264d35f77dfa6d65bc61c662ca5 2023-07-19 19:11:07,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 258124b48c3dff72b2b66d74d64d43bf, NAME => 'testtb-testExportFileSystemState,,1689793866816.258124b48c3dff72b2b66d74d64d43bf.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 19:11:07,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689793866816.258124b48c3dff72b2b66d74d64d43bf. service=AccessControlService 2023-07-19 19:11:07,258 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:11:07,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 258124b48c3dff72b2b66d74d64d43bf 2023-07-19 19:11:07,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689793866816.258124b48c3dff72b2b66d74d64d43bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:11:07,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 258124b48c3dff72b2b66d74d64d43bf 2023-07-19 19:11:07,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 258124b48c3dff72b2b66d74d64d43bf 2023-07-19 19:11:07,259 DEBUG [StoreOpener-fb98a264d35f77dfa6d65bc61c662ca5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemState/fb98a264d35f77dfa6d65bc61c662ca5/cf 2023-07-19 19:11:07,259 DEBUG [StoreOpener-fb98a264d35f77dfa6d65bc61c662ca5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemState/fb98a264d35f77dfa6d65bc61c662ca5/cf 2023-07-19 19:11:07,260 INFO [StoreOpener-fb98a264d35f77dfa6d65bc61c662ca5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fb98a264d35f77dfa6d65bc61c662ca5 columnFamilyName cf 2023-07-19 19:11:07,260 INFO [StoreOpener-258124b48c3dff72b2b66d74d64d43bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 258124b48c3dff72b2b66d74d64d43bf 2023-07-19 19:11:07,262 INFO [StoreOpener-fb98a264d35f77dfa6d65bc61c662ca5-1] regionserver.HStore(310): Store=fb98a264d35f77dfa6d65bc61c662ca5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:11:07,264 DEBUG [StoreOpener-258124b48c3dff72b2b66d74d64d43bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemState/258124b48c3dff72b2b66d74d64d43bf/cf 2023-07-19 19:11:07,264 DEBUG [StoreOpener-258124b48c3dff72b2b66d74d64d43bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemState/258124b48c3dff72b2b66d74d64d43bf/cf 2023-07-19 19:11:07,264 INFO [StoreOpener-258124b48c3dff72b2b66d74d64d43bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 258124b48c3dff72b2b66d74d64d43bf columnFamilyName cf 2023-07-19 19:11:07,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemState/fb98a264d35f77dfa6d65bc61c662ca5 2023-07-19 19:11:07,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemState/fb98a264d35f77dfa6d65bc61c662ca5 2023-07-19 19:11:07,266 INFO [StoreOpener-258124b48c3dff72b2b66d74d64d43bf-1] regionserver.HStore(310): Store=258124b48c3dff72b2b66d74d64d43bf/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:11:07,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemState/258124b48c3dff72b2b66d74d64d43bf 2023-07-19 19:11:07,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemState/258124b48c3dff72b2b66d74d64d43bf 2023-07-19 19:11:07,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fb98a264d35f77dfa6d65bc61c662ca5 2023-07-19 19:11:07,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemState/fb98a264d35f77dfa6d65bc61c662ca5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 19:11:07,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 258124b48c3dff72b2b66d74d64d43bf 2023-07-19 19:11:07,274 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fb98a264d35f77dfa6d65bc61c662ca5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59378274, jitterRate=-0.11519476771354675}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 19:11:07,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fb98a264d35f77dfa6d65bc61c662ca5: 2023-07-19 19:11:07,275 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689793866816.fb98a264d35f77dfa6d65bc61c662ca5., pid=30, masterSystemTime=1689793867244 2023-07-19 19:11:07,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689793866816.fb98a264d35f77dfa6d65bc61c662ca5. 2023-07-19 19:11:07,278 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689793866816.fb98a264d35f77dfa6d65bc61c662ca5. 2023-07-19 19:11:07,278 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=fb98a264d35f77dfa6d65bc61c662ca5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:07,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemState/258124b48c3dff72b2b66d74d64d43bf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 19:11:07,279 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689793866816.fb98a264d35f77dfa6d65bc61c662ca5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689793867278"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689793867278"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689793867278"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689793867278"}]},"ts":"1689793867278"} 2023-07-19 19:11:07,279 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 258124b48c3dff72b2b66d74d64d43bf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69061125, jitterRate=0.02909095585346222}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 19:11:07,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 258124b48c3dff72b2b66d74d64d43bf: 2023-07-19 19:11:07,283 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-19 19:11:07,284 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure fb98a264d35f77dfa6d65bc61c662ca5, server=jenkins-hbase4.apache.org,40791,1689793835731 in 189 msec 2023-07-19 19:11:07,285 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fb98a264d35f77dfa6d65bc61c662ca5, ASSIGN in 352 msec 2023-07-19 19:11:07,289 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689793866816.258124b48c3dff72b2b66d74d64d43bf., pid=31, masterSystemTime=1689793867246 2023-07-19 19:11:07,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689793866816.258124b48c3dff72b2b66d74d64d43bf. 2023-07-19 19:11:07,291 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689793866816.258124b48c3dff72b2b66d74d64d43bf. 2023-07-19 19:11:07,292 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=258124b48c3dff72b2b66d74d64d43bf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:07,292 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689793866816.258124b48c3dff72b2b66d74d64d43bf.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689793867292"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689793867292"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689793867292"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689793867292"}]},"ts":"1689793867292"} 2023-07-19 19:11:07,297 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-19 19:11:07,297 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 258124b48c3dff72b2b66d74d64d43bf, server=jenkins-hbase4.apache.org,45693,1689793835672 in 201 msec 2023-07-19 19:11:07,300 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-19 19:11:07,300 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=258124b48c3dff72b2b66d74d64d43bf, ASSIGN in 365 msec 2023-07-19 19:11:07,301 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 19:11:07,301 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793867301"}]},"ts":"1689793867301"} 2023-07-19 19:11:07,303 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-19 19:11:07,306 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 19:11:07,306 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-19 19:11:07,309 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40791] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 19:11:07,311 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:07,311 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:07,311 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:07,311 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:07,313 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 19:11:07,313 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 19:11:07,313 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 19:11:07,313 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 19:11:07,315 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 496 msec 2023-07-19 19:11:07,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 19:11:07,428 INFO [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-19 19:11:07,432 DEBUG [Listener at jenkins-hbase4.apache.org/42871] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-19 19:11:07,432 DEBUG [Listener at jenkins-hbase4.apache.org/42871] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689793866816.258124b48c3dff72b2b66d74d64d43bf. 2023-07-19 19:11:07,435 INFO [Listener at jenkins-hbase4.apache.org/42871] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 19:11:07,445 DEBUG [hconnection-0x46f19b93-shared-pool-10] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:11:07,448 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55286, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:11:07,454 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 19:11:07,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689793867454 (current time:1689793867454). 2023-07-19 19:11:07,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 19:11:07,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(139): Connect 0x20f5bbd6 to 127.0.0.1:58293 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:11:07,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e217cb5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:11:07,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:11:07,464 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59334, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:11:07,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x20f5bbd6 to 127.0.0.1:58293 2023-07-19 19:11:07,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:11:07,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(139): Connect 0x4a430e72 to 127.0.0.1:58293 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:11:07,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47e527e7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:11:07,474 DEBUG [hconnection-0x32d42f7a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:11:07,477 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59336, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:11:07,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4a430e72 to 127.0.0.1:58293 2023-07-19 19:11:07,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:11:07,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 19:11:07,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 19:11:07,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 19:11:07,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 19:11:07,488 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 19:11:07,489 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689794467489 2023-07-19 19:11:07,489 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-19 19:11:07,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 19:11:07,492 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 19:11:07,492 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 19:11:07,492 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 19:11:07,492 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 19:11:07,494 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-19 19:11:07,494 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 19:11:07,495 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689794467495 2023-07-19 19:11:07,515 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,515 INFO [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-19 19:11:07,515 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:07,516 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-19 19:11:07,516 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-19 19:11:07,517 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,517 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,519 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:07,519 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:07,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:07,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:07,519 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:07,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:07,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:07,519 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:07,519 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:07,519 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:07,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:07,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:07,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,523 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:07,523 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 19:11:07,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,527 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,533 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-19 19:11:07,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,533 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 19:11:07,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-19 19:11:07,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,533 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 19:11:07,534 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,534 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,534 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 19:11:07,534 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,534 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 19:11:07,534 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:07,534 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:07,536 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 19:11:07,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-19 19:11:07,536 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 19:11:07,536 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-19 19:11:07,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,536 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-19 19:11:07,536 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40791,1689793835731' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-19 19:11:07,536 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46111,1689793835594' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-19 19:11:07,536 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 19:11:07,538 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,538 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 19:11:07,538 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:07,540 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 19:11:07,540 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-19 19:11:07,540 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45693,1689793835672' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-19 19:11:07,547 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:07,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:07,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:07,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:07,548 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,548 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,549 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:07,549 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,549 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,549 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:11:07,549 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:07,549 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:11:07,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:07,550 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,550 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:11:07,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:07,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:07,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:07,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:07,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40791,1689793835731' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-19 19:11:07,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26032271[Count = 1] remaining members to acquire global barrier 2023-07-19 19:11:07,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:07,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:07,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:07,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:07,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:07,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:07,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:07,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:07,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:07,555 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45693,1689793835672' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-19 19:11:07,555 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26032271[Count = 0] remaining members to acquire global barrier 2023-07-19 19:11:07,555 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 19:11:07,555 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,557 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,557 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,557 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 19:11:07,557 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,557 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:07,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,557 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 19:11:07,557 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:11:07,557 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 19:11:07,557 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:11:07,557 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:07,558 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 19:11:07,557 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689793866816.258124b48c3dff72b2b66d74d64d43bf. 2023-07-19 19:11:07,557 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-19 19:11:07,558 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689793866816.258124b48c3dff72b2b66d74d64d43bf. started... 2023-07-19 19:11:07,558 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46111,1689793835594' in zk 2023-07-19 19:11:07,558 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 258124b48c3dff72b2b66d74d64d43bf: 2023-07-19 19:11:07,558 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689793866816.258124b48c3dff72b2b66d74d64d43bf.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,558 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:11:07,559 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:11:07,559 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689793866816.fb98a264d35f77dfa6d65bc61c662ca5. 2023-07-19 19:11:07,559 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:11:07,559 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689793866816.fb98a264d35f77dfa6d65bc61c662ca5. started... 2023-07-19 19:11:07,559 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 19:11:07,561 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fb98a264d35f77dfa6d65bc61c662ca5: 2023-07-19 19:11:07,561 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689793866816.fb98a264d35f77dfa6d65bc61c662ca5.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,561 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:11:07,561 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 19:11:07,564 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 19:11:07,564 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:07,564 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-19 19:11:07,584 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689793866816.fb98a264d35f77dfa6d65bc61c662ca5. completed. 2023-07-19 19:11:07,584 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689793866816.fb98a264d35f77dfa6d65bc61c662ca5. 2023-07-19 19:11:07,584 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:11:07,584 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:11:07,584 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:07,584 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-19 19:11:07,584 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40791,1689793835731' in zk 2023-07-19 19:11:07,585 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689793866816.258124b48c3dff72b2b66d74d64d43bf. completed. 2023-07-19 19:11:07,585 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689793866816.258124b48c3dff72b2b66d74d64d43bf. 2023-07-19 19:11:07,585 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:11:07,585 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:11:07,585 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:07,585 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-19 19:11:07,585 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45693,1689793835672' in zk 2023-07-19 19:11:07,587 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:07,587 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 19:11:07,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:07,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:07,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:07,587 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:07,588 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-19 19:11:07,589 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:07,589 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 19:11:07,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:07,589 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:07,589 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-19 19:11:07,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:07,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:07,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:07,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:07,592 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:11:07,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:07,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:07,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 19:11:07,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:11:07,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:07,594 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 19:11:07,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:07,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,40791,1689793835731': 2023-07-19 19:11:07,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40791,1689793835731' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 19:11:07,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:07,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:07,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:07,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:07,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:07,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:07,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:07,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:07,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:07,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:07,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:07,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:07,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45693,1689793835672': 2023-07-19 19:11:07,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45693,1689793835672' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 19:11:07,599 INFO [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-19 19:11:07,599 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 19:11:07,599 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 19:11:07,599 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,599 INFO [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 19:11:07,601 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,601 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,601 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:07,601 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,601 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:07,601 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:07,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:07,602 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:07,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:07,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:07,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:07,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:07,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:07,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:07,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:07,603 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:07,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,605 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:07,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:07,606 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:07,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:07,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:07,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:07,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:07,609 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:07,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,609 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:07,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:07,609 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:07,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:07,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:07,613 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:07,613 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,613 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:07,613 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:07,613 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:07,613 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:07,613 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:07,613 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:07,613 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:07,615 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:07,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:07,613 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:07,615 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-19 19:11:07,613 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:07,615 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:07,615 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 19:11:07,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:07,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:07,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:07,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:07,615 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:07,615 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:07,615 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,615 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:07,615 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:07,616 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,616 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,616 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-19 19:11:07,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:07,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:07,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:07,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:07,629 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,630 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,659 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,691 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-19 19:11:07,692 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,692 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:07,692 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689793867489Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689793867629 (+140 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689793867629Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689793867630 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689793867635 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689793867651 (+16 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689793867691 (+40 ms) 2023-07-19 19:11:07,695 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 19:11:07,697 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 205 msec 2023-07-19 19:11:07,794 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:11:07,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 19:11:07,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 19:11:07,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45693] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689793866816.258124b48c3dff72b2b66d74d64d43bf. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 19:11:07,800 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40791] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689793866816.fb98a264d35f77dfa6d65bc61c662ca5. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 19:11:07,805 DEBUG [Listener at jenkins-hbase4.apache.org/42871] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-19 19:11:07,805 DEBUG [Listener at jenkins-hbase4.apache.org/42871] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689793866816.258124b48c3dff72b2b66d74d64d43bf. 2023-07-19 19:11:07,805 INFO [Listener at jenkins-hbase4.apache.org/42871] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 19:11:07,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 19:11:07,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689793867819 (current time:1689793867819). 2023-07-19 19:11:07,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 19:11:07,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(139): Connect 0x00e63161 to 127.0.0.1:58293 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:11:07,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4fb38180, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:11:07,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:11:07,832 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59344, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:11:07,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x00e63161 to 127.0.0.1:58293 2023-07-19 19:11:07,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:11:07,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(139): Connect 0x071d8422 to 127.0.0.1:58293 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:11:07,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65adf840, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:11:07,844 DEBUG [hconnection-0x7ca108d9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:11:07,845 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59358, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:11:07,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x071d8422 to 127.0.0.1:58293 2023-07-19 19:11:07,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:11:07,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 19:11:07,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 19:11:07,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 19:11:07,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 19:11:07,858 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 19:11:07,859 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689794467859 2023-07-19 19:11:07,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 19:11:07,859 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-19 19:11:07,860 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 19:11:07,860 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 19:11:07,862 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 19:11:07,864 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 19:11:07,865 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-07-19 19:11:07,867 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 19:11:07,868 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689794467868 2023-07-19 19:11:07,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-19 19:11:07,885 INFO [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-19 19:11:07,885 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:07,887 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-19 19:11:07,887 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-19 19:11:07,887 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 19:11:07,887 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 19:11:07,889 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:07,889 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:07,889 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:07,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:07,889 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:07,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:07,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:07,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:07,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:07,890 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:07,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:07,890 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:07,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 19:11:07,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 19:11:07,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 19:11:07,891 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:07,891 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 19:11:07,891 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 19:11:07,891 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 19:11:07,891 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 19:11:07,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-19 19:11:07,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 19:11:07,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-19 19:11:07,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 19:11:07,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-19 19:11:07,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 19:11:07,892 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 19:11:07,891 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 19:11:07,892 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 19:11:07,892 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-19 19:11:07,892 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 19:11:07,892 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:07,894 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 19:11:07,894 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-19 19:11:07,894 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-19 19:11:07,894 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 19:11:07,894 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-19 19:11:07,894 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:07,894 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40791,1689793835731' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-19 19:11:07,896 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 19:11:07,896 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-19 19:11:07,896 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45693,1689793835672' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-19 19:11:07,896 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 19:11:07,896 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:07,897 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 19:11:07,897 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-19 19:11:07,897 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46111,1689793835594' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-19 19:11:07,898 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:07,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:07,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:07,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:07,899 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 19:11:07,899 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:07,899 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 19:11:07,900 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 19:11:07,900 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:11:07,900 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 19:11:07,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:07,900 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 19:11:07,900 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 19:11:07,900 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:11:07,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:07,901 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:11:07,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 19:11:07,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:07,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:07,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:07,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:07,903 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40791,1689793835731' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-19 19:11:07,903 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27fd12af[Count = 1] remaining members to acquire global barrier 2023-07-19 19:11:07,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:07,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:07,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:07,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:07,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:07,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 19:11:07,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:07,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:07,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:07,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:07,906 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45693,1689793835672' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-19 19:11:07,906 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27fd12af[Count = 0] remaining members to acquire global barrier 2023-07-19 19:11:07,906 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 19:11:07,907 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 19:11:07,908 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 19:11:07,908 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 19:11:07,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 19:11:07,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 19:11:07,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 19:11:07,908 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 19:11:07,908 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 19:11:07,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 19:11:07,908 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-19 19:11:07,908 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:07,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 19:11:07,909 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 19:11:07,908 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46111,1689793835594' in zk 2023-07-19 19:11:07,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 19:11:07,909 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:11:07,909 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:11:07,909 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689793866816.fb98a264d35f77dfa6d65bc61c662ca5. 2023-07-19 19:11:07,909 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:07,909 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689793866816.fb98a264d35f77dfa6d65bc61c662ca5. started... 2023-07-19 19:11:07,909 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 19:11:07,909 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 19:11:07,909 INFO [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.HRegion(2745): Flushing fb98a264d35f77dfa6d65bc61c662ca5 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-19 19:11:07,910 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:11:07,910 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:11:07,910 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689793866816.258124b48c3dff72b2b66d74d64d43bf. 2023-07-19 19:11:07,910 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689793866816.258124b48c3dff72b2b66d74d64d43bf. started... 2023-07-19 19:11:07,910 INFO [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 258124b48c3dff72b2b66d74d64d43bf 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-19 19:11:07,911 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 19:11:07,911 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:07,911 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-19 19:11:07,936 INFO [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071996444ba10ffe4ea28b2895af2874ee12 to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023071996444ba10ffe4ea28b2895af2874ee12 2023-07-19 19:11:07,942 INFO [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230719edd3163e2c9641cb9776563d758fab1a to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230719edd3163e2c9641cb9776563d758fab1a 2023-07-19 19:11:07,952 INFO [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemState/258124b48c3dff72b2b66d74d64d43bf/.tmp/cf/5655a892adbf41fa86b614bda9cfa621 2023-07-19 19:11:07,957 INFO [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemState/fb98a264d35f77dfa6d65bc61c662ca5/.tmp/cf/4763c44030a94c808fe42bd69c5a6f85 2023-07-19 19:11:07,960 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemState/258124b48c3dff72b2b66d74d64d43bf/.tmp/cf/5655a892adbf41fa86b614bda9cfa621 as hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemState/258124b48c3dff72b2b66d74d64d43bf/cf/5655a892adbf41fa86b614bda9cfa621 2023-07-19 19:11:07,962 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:11:07,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 19:11:07,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:11:07,964 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 19:11:07,967 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemState/fb98a264d35f77dfa6d65bc61c662ca5/.tmp/cf/4763c44030a94c808fe42bd69c5a6f85 as hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemState/fb98a264d35f77dfa6d65bc61c662ca5/cf/4763c44030a94c808fe42bd69c5a6f85 2023-07-19 19:11:07,967 INFO [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemState/258124b48c3dff72b2b66d74d64d43bf/cf/5655a892adbf41fa86b614bda9cfa621, entries=6, sequenceid=6, filesize=5.9 K 2023-07-19 19:11:07,968 INFO [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 258124b48c3dff72b2b66d74d64d43bf in 58ms, sequenceid=6, compaction requested=false 2023-07-19 19:11:07,968 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-19 19:11:07,969 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 258124b48c3dff72b2b66d74d64d43bf: 2023-07-19 19:11:07,969 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689793866816.258124b48c3dff72b2b66d74d64d43bf.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-19 19:11:07,969 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:11:07,969 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemState/258124b48c3dff72b2b66d74d64d43bf/cf/5655a892adbf41fa86b614bda9cfa621] hfiles 2023-07-19 19:11:07,969 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemState/258124b48c3dff72b2b66d74d64d43bf/cf/5655a892adbf41fa86b614bda9cfa621 for snapshot=snaptb0-testExportFileSystemState 2023-07-19 19:11:07,974 INFO [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemState/fb98a264d35f77dfa6d65bc61c662ca5/cf/4763c44030a94c808fe42bd69c5a6f85, entries=44, sequenceid=6, filesize=12.3 K 2023-07-19 19:11:07,976 INFO [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for fb98a264d35f77dfa6d65bc61c662ca5 in 67ms, sequenceid=6, compaction requested=false 2023-07-19 19:11:07,980 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fb98a264d35f77dfa6d65bc61c662ca5: 2023-07-19 19:11:07,980 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689793866816.fb98a264d35f77dfa6d65bc61c662ca5.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-19 19:11:07,980 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:11:07,980 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemState/fb98a264d35f77dfa6d65bc61c662ca5/cf/4763c44030a94c808fe42bd69c5a6f85] hfiles 2023-07-19 19:11:07,981 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemState/fb98a264d35f77dfa6d65bc61c662ca5/cf/4763c44030a94c808fe42bd69c5a6f85 for snapshot=snaptb0-testExportFileSystemState 2023-07-19 19:11:07,994 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689793866816.258124b48c3dff72b2b66d74d64d43bf. completed. 2023-07-19 19:11:07,995 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689793866816.258124b48c3dff72b2b66d74d64d43bf. 2023-07-19 19:11:07,995 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:11:07,995 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:11:07,995 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:07,995 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-19 19:11:07,995 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45693,1689793835672' in zk 2023-07-19 19:11:08,000 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:08,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:08,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:08,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:08,000 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 19:11:08,000 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:08,000 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-19 19:11:08,002 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689793866816.fb98a264d35f77dfa6d65bc61c662ca5. completed. 2023-07-19 19:11:08,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:08,002 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689793866816.fb98a264d35f77dfa6d65bc61c662ca5. 2023-07-19 19:11:08,002 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:11:08,002 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:11:08,002 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:08,002 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-19 19:11:08,002 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40791,1689793835731' in zk 2023-07-19 19:11:08,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:08,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 19:11:08,004 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 19:11:08,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:08,004 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:08,004 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:08,004 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-19 19:11:08,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:08,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:08,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:08,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 19:11:08,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:08,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:08,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:08,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45693,1689793835672': 2023-07-19 19:11:08,009 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45693,1689793835672' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 19:11:08,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:08,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:08,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:08,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:08,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:08,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 19:11:08,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:08,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:08,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:08,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:08,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 19:11:08,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:08,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:08,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:08,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,40791,1689793835731': 2023-07-19 19:11:08,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40791,1689793835731' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 19:11:08,012 INFO [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-19 19:11:08,012 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 19:11:08,012 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 19:11:08,013 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-19 19:11:08,013 INFO [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 19:11:08,015 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 19:11:08,015 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 19:11:08,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 19:11:08,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 19:11:08,015 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 19:11:08,015 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 19:11:08,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 19:11:08,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 19:11:08,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:08,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:08,015 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:08,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 19:11:08,016 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:08,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 19:11:08,015 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:08,015 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:08,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 19:11:08,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:08,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:08,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:08,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:08,017 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:08,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:08,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:08,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:08,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 19:11:08,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 19:11:08,017 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:08,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 19:11:08,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 19:11:08,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:08,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 19:11:08,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:08,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:08,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:08,019 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:08,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:08,019 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:08,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 19:11:08,020 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:08,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:08,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:08,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:08,023 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:08,023 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 19:11:08,023 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:08,023 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:08,023 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:08,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:08,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:08,023 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:08,023 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:08,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:08,023 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:08,023 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:08,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:08,023 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-19 19:11:08,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:08,025 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-19 19:11:08,023 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:08,025 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-19 19:11:08,023 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:08,025 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 19:11:08,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:08,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:08,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:08,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:08,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:08,023 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 19:11:08,025 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:08,025 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 19:11:08,025 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:08,025 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:08,026 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 19:11:08,026 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 19:11:08,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:08,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:08,026 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230719edd3163e2c9641cb9776563d758fab1a, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023071996444ba10ffe4ea28b2895af2874ee12] mob files 2023-07-19 19:11:08,026 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230719edd3163e2c9641cb9776563d758fab1a 2023-07-19 19:11:08,026 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023071996444ba10ffe4ea28b2895af2874ee12 2023-07-19 19:11:08,035 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-19 19:11:08,035 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 19:11:08,056 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-19 19:11:08,078 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-19 19:11:08,078 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 19:11:08,079 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 19:11:08,079 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689793867859Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689793868035 (+176 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689793868035Loading Region manifests for snaptb0-testExportFileSystemState at 1689793868035Writing data manifest for snaptb0-testExportFileSystemState at 1689793868038 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689793868049 (+11 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689793868078 (+29 ms) 2023-07-19 19:11:08,081 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 19:11:08,083 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 220 msec 2023-07-19 19:11:08,164 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:11:08,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 19:11:08,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 19:11:08,166 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793868166 2023-07-19 19:11:08,166 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43367, tgtDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793868166, rawTgtDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793868166, srcFsUri=hdfs://localhost:43367, srcDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978 2023-07-19 19:11:08,191 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43367, inputRoot=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978 2023-07-19 19:11:08,191 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1234745932_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793868166, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793868166/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 19:11:08,191 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43367, inputRoot=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978, snapshotDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-19 19:11:08,206 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793868166/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 19:11:08,236 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:08,237 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:08,237 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:08,238 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:08,238 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:08,238 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:08,238 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:08,308 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/hadoop-3780509780554066644.jar 2023-07-19 19:11:08,309 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:08,309 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:08,310 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:08,310 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:08,310 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:08,310 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:08,311 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 19:11:08,311 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 19:11:08,312 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 19:11:08,312 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 19:11:08,312 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 19:11:08,313 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 19:11:08,313 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 19:11:08,314 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 19:11:08,314 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 19:11:08,314 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 19:11:08,315 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:11:08,315 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:11:08,316 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 19:11:08,316 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:11:08,316 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:11:08,317 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 19:11:08,317 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 19:11:08,909 WARN [Listener at jenkins-hbase4.apache.org/42871] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 19:11:08,912 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-19 19:11:08,915 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-19 19:11:10,391 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 19:11:10,391 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 19:11:10,401 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843898_0001_000001 (auth:SIMPLE) 2023-07-19 19:11:11,196 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843898_0002_000001 (auth:SIMPLE) 2023-07-19 19:11:11,764 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 19:11:15,912 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843898_0002_000001 (auth:SIMPLE) 2023-07-19 19:11:18,164 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843898_0002_000001 (auth:SIMPLE) 2023-07-19 19:11:20,912 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843898_0002_000001 (auth:SIMPLE) 2023-07-19 19:11:22,154 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 19:11:22,157 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 19:11:22,167 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-19 19:11:22,167 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 19:11:22,168 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 19:11:22,168 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1054544951_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-19 19:11:22,168 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(367): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-19 19:11:22,168 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(367): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-19 19:11:22,168 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1054544951_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793868166/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793868166/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-19 19:11:22,169 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(367): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793868166/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-19 19:11:22,169 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(367): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793868166/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-19 19:11:22,178 INFO [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-19 19:11:22,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-19 19:11:22,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-19 19:11:22,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-19 19:11:22,184 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793882184"}]},"ts":"1689793882184"} 2023-07-19 19:11:22,186 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-19 19:11:22,188 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-19 19:11:22,189 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=258124b48c3dff72b2b66d74d64d43bf, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fb98a264d35f77dfa6d65bc61c662ca5, UNASSIGN}] 2023-07-19 19:11:22,191 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=258124b48c3dff72b2b66d74d64d43bf, UNASSIGN 2023-07-19 19:11:22,191 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fb98a264d35f77dfa6d65bc61c662ca5, UNASSIGN 2023-07-19 19:11:22,192 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=258124b48c3dff72b2b66d74d64d43bf, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:22,192 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=fb98a264d35f77dfa6d65bc61c662ca5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:22,193 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689793866816.258124b48c3dff72b2b66d74d64d43bf.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689793882192"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793882192"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793882192"}]},"ts":"1689793882192"} 2023-07-19 19:11:22,193 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689793866816.fb98a264d35f77dfa6d65bc61c662ca5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689793882192"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793882192"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793882192"}]},"ts":"1689793882192"} 2023-07-19 19:11:22,194 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 258124b48c3dff72b2b66d74d64d43bf, server=jenkins-hbase4.apache.org,45693,1689793835672}] 2023-07-19 19:11:22,196 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure fb98a264d35f77dfa6d65bc61c662ca5, server=jenkins-hbase4.apache.org,40791,1689793835731}] 2023-07-19 19:11:22,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-19 19:11:22,348 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 258124b48c3dff72b2b66d74d64d43bf 2023-07-19 19:11:22,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 258124b48c3dff72b2b66d74d64d43bf, disabling compactions & flushes 2023-07-19 19:11:22,349 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689793866816.258124b48c3dff72b2b66d74d64d43bf. 2023-07-19 19:11:22,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689793866816.258124b48c3dff72b2b66d74d64d43bf. 2023-07-19 19:11:22,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689793866816.258124b48c3dff72b2b66d74d64d43bf. after waiting 0 ms 2023-07-19 19:11:22,349 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fb98a264d35f77dfa6d65bc61c662ca5 2023-07-19 19:11:22,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689793866816.258124b48c3dff72b2b66d74d64d43bf. 2023-07-19 19:11:22,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fb98a264d35f77dfa6d65bc61c662ca5, disabling compactions & flushes 2023-07-19 19:11:22,349 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689793866816.fb98a264d35f77dfa6d65bc61c662ca5. 2023-07-19 19:11:22,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689793866816.fb98a264d35f77dfa6d65bc61c662ca5. 2023-07-19 19:11:22,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689793866816.fb98a264d35f77dfa6d65bc61c662ca5. after waiting 0 ms 2023-07-19 19:11:22,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689793866816.fb98a264d35f77dfa6d65bc61c662ca5. 2023-07-19 19:11:22,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemState/258124b48c3dff72b2b66d74d64d43bf/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 19:11:22,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemState/fb98a264d35f77dfa6d65bc61c662ca5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 19:11:22,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:11:22,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:11:22,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689793866816.258124b48c3dff72b2b66d74d64d43bf. 2023-07-19 19:11:22,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689793866816.fb98a264d35f77dfa6d65bc61c662ca5. 2023-07-19 19:11:22,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 258124b48c3dff72b2b66d74d64d43bf: 2023-07-19 19:11:22,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fb98a264d35f77dfa6d65bc61c662ca5: 2023-07-19 19:11:22,385 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fb98a264d35f77dfa6d65bc61c662ca5 2023-07-19 19:11:22,386 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=fb98a264d35f77dfa6d65bc61c662ca5, regionState=CLOSED 2023-07-19 19:11:22,386 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 258124b48c3dff72b2b66d74d64d43bf 2023-07-19 19:11:22,387 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689793866816.fb98a264d35f77dfa6d65bc61c662ca5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689793882386"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793882386"}]},"ts":"1689793882386"} 2023-07-19 19:11:22,387 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=258124b48c3dff72b2b66d74d64d43bf, regionState=CLOSED 2023-07-19 19:11:22,387 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689793866816.258124b48c3dff72b2b66d74d64d43bf.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689793882387"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793882387"}]},"ts":"1689793882387"} 2023-07-19 19:11:22,392 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-19 19:11:22,392 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure fb98a264d35f77dfa6d65bc61c662ca5, server=jenkins-hbase4.apache.org,40791,1689793835731 in 192 msec 2023-07-19 19:11:22,393 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-19 19:11:22,393 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 258124b48c3dff72b2b66d74d64d43bf, server=jenkins-hbase4.apache.org,45693,1689793835672 in 196 msec 2023-07-19 19:11:22,394 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fb98a264d35f77dfa6d65bc61c662ca5, UNASSIGN in 203 msec 2023-07-19 19:11:22,396 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-19 19:11:22,396 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=258124b48c3dff72b2b66d74d64d43bf, UNASSIGN in 204 msec 2023-07-19 19:11:22,398 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793882398"}]},"ts":"1689793882398"} 2023-07-19 19:11:22,400 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-19 19:11:22,402 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-19 19:11:22,405 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 225 msec 2023-07-19 19:11:22,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-19 19:11:22,486 INFO [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-19 19:11:22,487 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-19 19:11:22,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 19:11:22,491 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 19:11:22,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-19 19:11:22,495 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 19:11:22,496 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40791] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-19 19:11:22,500 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 19:11:22,500 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 19:11:22,500 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 19:11:22,500 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 19:11:22,501 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 19:11:22,501 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 19:11:22,501 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 19:11:22,501 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemState/258124b48c3dff72b2b66d74d64d43bf 2023-07-19 19:11:22,501 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemState/fb98a264d35f77dfa6d65bc61c662ca5 2023-07-19 19:11:22,502 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 19:11:22,502 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:22,502 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:22,502 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 19:11:22,502 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-19 19:11:22,502 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 19:11:22,502 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 19:11:22,502 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:22,502 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:22,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-19 19:11:22,504 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemState/fb98a264d35f77dfa6d65bc61c662ca5/cf, FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemState/fb98a264d35f77dfa6d65bc61c662ca5/recovered.edits] 2023-07-19 19:11:22,504 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemState/258124b48c3dff72b2b66d74d64d43bf/cf, FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemState/258124b48c3dff72b2b66d74d64d43bf/recovered.edits] 2023-07-19 19:11:22,509 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemState/fb98a264d35f77dfa6d65bc61c662ca5/cf/4763c44030a94c808fe42bd69c5a6f85 to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testExportFileSystemState/fb98a264d35f77dfa6d65bc61c662ca5/cf/4763c44030a94c808fe42bd69c5a6f85 2023-07-19 19:11:22,509 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemState/258124b48c3dff72b2b66d74d64d43bf/cf/5655a892adbf41fa86b614bda9cfa621 to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testExportFileSystemState/258124b48c3dff72b2b66d74d64d43bf/cf/5655a892adbf41fa86b614bda9cfa621 2023-07-19 19:11:22,512 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemState/fb98a264d35f77dfa6d65bc61c662ca5/recovered.edits/9.seqid to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testExportFileSystemState/fb98a264d35f77dfa6d65bc61c662ca5/recovered.edits/9.seqid 2023-07-19 19:11:22,513 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemState/258124b48c3dff72b2b66d74d64d43bf/recovered.edits/9.seqid to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testExportFileSystemState/258124b48c3dff72b2b66d74d64d43bf/recovered.edits/9.seqid 2023-07-19 19:11:22,513 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemState/fb98a264d35f77dfa6d65bc61c662ca5 2023-07-19 19:11:22,513 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemState/258124b48c3dff72b2b66d74d64d43bf 2023-07-19 19:11:22,513 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-19 19:11:22,514 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-19 19:11:22,515 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-19 19:11:22,519 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230719edd3163e2c9641cb9776563d758fab1a to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230719edd3163e2c9641cb9776563d758fab1a 2023-07-19 19:11:22,520 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023071996444ba10ffe4ea28b2895af2874ee12 to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023071996444ba10ffe4ea28b2895af2874ee12 2023-07-19 19:11:22,521 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-19 19:11:22,524 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 19:11:22,526 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-19 19:11:22,530 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-19 19:11:22,532 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 19:11:22,532 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-19 19:11:22,532 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689793866816.258124b48c3dff72b2b66d74d64d43bf.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689793882532"}]},"ts":"9223372036854775807"} 2023-07-19 19:11:22,532 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689793866816.fb98a264d35f77dfa6d65bc61c662ca5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689793882532"}]},"ts":"9223372036854775807"} 2023-07-19 19:11:22,535 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 19:11:22,535 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 258124b48c3dff72b2b66d74d64d43bf, NAME => 'testtb-testExportFileSystemState,,1689793866816.258124b48c3dff72b2b66d74d64d43bf.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => fb98a264d35f77dfa6d65bc61c662ca5, NAME => 'testtb-testExportFileSystemState,1,1689793866816.fb98a264d35f77dfa6d65bc61c662ca5.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 19:11:22,535 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-19 19:11:22,535 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689793882535"}]},"ts":"9223372036854775807"} 2023-07-19 19:11:22,537 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-19 19:11:22,540 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 19:11:22,541 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 53 msec 2023-07-19 19:11:22,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-19 19:11:22,606 INFO [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-19 19:11:22,616 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-19 19:11:22,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-19 19:11:22,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-19 19:11:22,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-19 19:11:22,658 INFO [Listener at jenkins-hbase4.apache.org/42871] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=766 (was 756) Potentially hanging thread: IPC Client (274932937) connection to jenkins-hbase4.apache.org/172.31.14.131:33207 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1054544951_17 at /127.0.0.1:51876 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1222367512_1 at /127.0.0.1:36944 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2143 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1164f60d-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1054544951_17 at /127.0.0.1:36970 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1164f60d-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1164f60d-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1164f60d-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1054544951_17 at /127.0.0.1:53808 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=922 (was 933), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=443 (was 462), ProcessCount=182 (was 181) - ProcessCount LEAK? -, AvailableMemoryMB=2836 (was 2947) 2023-07-19 19:11:22,659 WARN [Listener at jenkins-hbase4.apache.org/42871] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-19 19:11:22,682 INFO [Listener at jenkins-hbase4.apache.org/42871] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=766, OpenFileDescriptor=922, MaxFileDescriptor=60000, SystemLoadAverage=443, ProcessCount=182, AvailableMemoryMB=2831 2023-07-19 19:11:22,683 WARN [Listener at jenkins-hbase4.apache.org/42871] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-19 19:11:22,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-19 19:11:22,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-19 19:11:22,690 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 19:11:22,690 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-19 19:11:22,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 19:11:22,692 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 19:11:22,695 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testConsecutiveExports/47edc632059d78d86cf0caad862b4f09 2023-07-19 19:11:22,695 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testConsecutiveExports/bfb941114c3274765a58b40ae9845e76 2023-07-19 19:11:22,696 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testConsecutiveExports/47edc632059d78d86cf0caad862b4f09 empty. 2023-07-19 19:11:22,696 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testConsecutiveExports/bfb941114c3274765a58b40ae9845e76 empty. 2023-07-19 19:11:22,696 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testConsecutiveExports/47edc632059d78d86cf0caad862b4f09 2023-07-19 19:11:22,696 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testConsecutiveExports/bfb941114c3274765a58b40ae9845e76 2023-07-19 19:11:22,696 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-19 19:11:22,724 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-19 19:11:22,726 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 47edc632059d78d86cf0caad862b4f09, NAME => 'testtb-testConsecutiveExports,,1689793882684.47edc632059d78d86cf0caad862b4f09.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp 2023-07-19 19:11:22,726 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => bfb941114c3274765a58b40ae9845e76, NAME => 'testtb-testConsecutiveExports,1,1689793882684.bfb941114c3274765a58b40ae9845e76.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp 2023-07-19 19:11:22,761 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689793882684.47edc632059d78d86cf0caad862b4f09.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:11:22,761 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 47edc632059d78d86cf0caad862b4f09, disabling compactions & flushes 2023-07-19 19:11:22,761 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689793882684.47edc632059d78d86cf0caad862b4f09. 2023-07-19 19:11:22,761 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689793882684.47edc632059d78d86cf0caad862b4f09. 2023-07-19 19:11:22,761 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689793882684.47edc632059d78d86cf0caad862b4f09. after waiting 0 ms 2023-07-19 19:11:22,762 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689793882684.47edc632059d78d86cf0caad862b4f09. 2023-07-19 19:11:22,762 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689793882684.47edc632059d78d86cf0caad862b4f09. 2023-07-19 19:11:22,762 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 47edc632059d78d86cf0caad862b4f09: 2023-07-19 19:11:22,762 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689793882684.bfb941114c3274765a58b40ae9845e76.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:11:22,763 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing bfb941114c3274765a58b40ae9845e76, disabling compactions & flushes 2023-07-19 19:11:22,763 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689793882684.bfb941114c3274765a58b40ae9845e76. 2023-07-19 19:11:22,763 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689793882684.bfb941114c3274765a58b40ae9845e76. 2023-07-19 19:11:22,763 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689793882684.bfb941114c3274765a58b40ae9845e76. after waiting 0 ms 2023-07-19 19:11:22,763 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689793882684.bfb941114c3274765a58b40ae9845e76. 2023-07-19 19:11:22,763 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689793882684.bfb941114c3274765a58b40ae9845e76. 2023-07-19 19:11:22,763 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for bfb941114c3274765a58b40ae9845e76: 2023-07-19 19:11:22,767 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 19:11:22,768 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689793882684.47edc632059d78d86cf0caad862b4f09.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689793882768"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793882768"}]},"ts":"1689793882768"} 2023-07-19 19:11:22,768 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689793882684.bfb941114c3274765a58b40ae9845e76.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689793882768"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793882768"}]},"ts":"1689793882768"} 2023-07-19 19:11:22,771 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 19:11:22,772 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 19:11:22,772 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793882772"}]},"ts":"1689793882772"} 2023-07-19 19:11:22,775 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-19 19:11:22,779 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 19:11:22,781 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 19:11:22,781 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 19:11:22,781 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 19:11:22,781 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 19:11:22,781 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=47edc632059d78d86cf0caad862b4f09, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bfb941114c3274765a58b40ae9845e76, ASSIGN}] 2023-07-19 19:11:22,785 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bfb941114c3274765a58b40ae9845e76, ASSIGN 2023-07-19 19:11:22,785 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=47edc632059d78d86cf0caad862b4f09, ASSIGN 2023-07-19 19:11:22,786 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bfb941114c3274765a58b40ae9845e76, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40791,1689793835731; forceNewPlan=false, retain=false 2023-07-19 19:11:22,786 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=47edc632059d78d86cf0caad862b4f09, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46111,1689793835594; forceNewPlan=false, retain=false 2023-07-19 19:11:22,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 19:11:22,937 INFO [jenkins-hbase4:37769] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 19:11:22,939 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=47edc632059d78d86cf0caad862b4f09, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:22,939 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=bfb941114c3274765a58b40ae9845e76, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:22,939 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689793882684.47edc632059d78d86cf0caad862b4f09.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689793882939"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793882939"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793882939"}]},"ts":"1689793882939"} 2023-07-19 19:11:22,940 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689793882684.bfb941114c3274765a58b40ae9845e76.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689793882939"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793882939"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793882939"}]},"ts":"1689793882939"} 2023-07-19 19:11:22,941 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 47edc632059d78d86cf0caad862b4f09, server=jenkins-hbase4.apache.org,46111,1689793835594}] 2023-07-19 19:11:22,942 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure bfb941114c3274765a58b40ae9845e76, server=jenkins-hbase4.apache.org,40791,1689793835731}] 2023-07-19 19:11:22,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 19:11:23,100 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689793882684.bfb941114c3274765a58b40ae9845e76. 2023-07-19 19:11:23,100 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689793882684.47edc632059d78d86cf0caad862b4f09. 2023-07-19 19:11:23,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bfb941114c3274765a58b40ae9845e76, NAME => 'testtb-testConsecutiveExports,1,1689793882684.bfb941114c3274765a58b40ae9845e76.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 19:11:23,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 47edc632059d78d86cf0caad862b4f09, NAME => 'testtb-testConsecutiveExports,,1689793882684.47edc632059d78d86cf0caad862b4f09.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 19:11:23,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689793882684.bfb941114c3274765a58b40ae9845e76. service=AccessControlService 2023-07-19 19:11:23,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689793882684.47edc632059d78d86cf0caad862b4f09. service=AccessControlService 2023-07-19 19:11:23,101 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:11:23,101 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:11:23,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports bfb941114c3274765a58b40ae9845e76 2023-07-19 19:11:23,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 47edc632059d78d86cf0caad862b4f09 2023-07-19 19:11:23,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689793882684.bfb941114c3274765a58b40ae9845e76.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:11:23,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689793882684.47edc632059d78d86cf0caad862b4f09.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:11:23,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bfb941114c3274765a58b40ae9845e76 2023-07-19 19:11:23,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 47edc632059d78d86cf0caad862b4f09 2023-07-19 19:11:23,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bfb941114c3274765a58b40ae9845e76 2023-07-19 19:11:23,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 47edc632059d78d86cf0caad862b4f09 2023-07-19 19:11:23,102 INFO [StoreOpener-47edc632059d78d86cf0caad862b4f09-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 47edc632059d78d86cf0caad862b4f09 2023-07-19 19:11:23,102 INFO [StoreOpener-bfb941114c3274765a58b40ae9845e76-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bfb941114c3274765a58b40ae9845e76 2023-07-19 19:11:23,104 DEBUG [StoreOpener-47edc632059d78d86cf0caad862b4f09-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testConsecutiveExports/47edc632059d78d86cf0caad862b4f09/cf 2023-07-19 19:11:23,104 DEBUG [StoreOpener-bfb941114c3274765a58b40ae9845e76-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testConsecutiveExports/bfb941114c3274765a58b40ae9845e76/cf 2023-07-19 19:11:23,104 DEBUG [StoreOpener-bfb941114c3274765a58b40ae9845e76-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testConsecutiveExports/bfb941114c3274765a58b40ae9845e76/cf 2023-07-19 19:11:23,104 DEBUG [StoreOpener-47edc632059d78d86cf0caad862b4f09-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testConsecutiveExports/47edc632059d78d86cf0caad862b4f09/cf 2023-07-19 19:11:23,104 INFO [StoreOpener-bfb941114c3274765a58b40ae9845e76-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bfb941114c3274765a58b40ae9845e76 columnFamilyName cf 2023-07-19 19:11:23,104 INFO [StoreOpener-47edc632059d78d86cf0caad862b4f09-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 47edc632059d78d86cf0caad862b4f09 columnFamilyName cf 2023-07-19 19:11:23,106 INFO [StoreOpener-bfb941114c3274765a58b40ae9845e76-1] regionserver.HStore(310): Store=bfb941114c3274765a58b40ae9845e76/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:11:23,106 INFO [StoreOpener-47edc632059d78d86cf0caad862b4f09-1] regionserver.HStore(310): Store=47edc632059d78d86cf0caad862b4f09/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:11:23,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testConsecutiveExports/bfb941114c3274765a58b40ae9845e76 2023-07-19 19:11:23,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testConsecutiveExports/47edc632059d78d86cf0caad862b4f09 2023-07-19 19:11:23,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testConsecutiveExports/bfb941114c3274765a58b40ae9845e76 2023-07-19 19:11:23,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testConsecutiveExports/47edc632059d78d86cf0caad862b4f09 2023-07-19 19:11:23,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bfb941114c3274765a58b40ae9845e76 2023-07-19 19:11:23,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 47edc632059d78d86cf0caad862b4f09 2023-07-19 19:11:23,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testConsecutiveExports/bfb941114c3274765a58b40ae9845e76/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 19:11:23,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testConsecutiveExports/47edc632059d78d86cf0caad862b4f09/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 19:11:23,112 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bfb941114c3274765a58b40ae9845e76; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61070357, jitterRate=-0.08998076617717743}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 19:11:23,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bfb941114c3274765a58b40ae9845e76: 2023-07-19 19:11:23,112 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 47edc632059d78d86cf0caad862b4f09; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60336524, jitterRate=-0.10091572999954224}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 19:11:23,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 47edc632059d78d86cf0caad862b4f09: 2023-07-19 19:11:23,113 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689793882684.47edc632059d78d86cf0caad862b4f09., pid=45, masterSystemTime=1689793883093 2023-07-19 19:11:23,113 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689793882684.bfb941114c3274765a58b40ae9845e76., pid=46, masterSystemTime=1689793883094 2023-07-19 19:11:23,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689793882684.47edc632059d78d86cf0caad862b4f09. 2023-07-19 19:11:23,115 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689793882684.47edc632059d78d86cf0caad862b4f09. 2023-07-19 19:11:23,116 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=47edc632059d78d86cf0caad862b4f09, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:23,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689793882684.bfb941114c3274765a58b40ae9845e76. 2023-07-19 19:11:23,116 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689793882684.bfb941114c3274765a58b40ae9845e76. 2023-07-19 19:11:23,116 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689793882684.47edc632059d78d86cf0caad862b4f09.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689793883115"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689793883115"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689793883115"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689793883115"}]},"ts":"1689793883115"} 2023-07-19 19:11:23,116 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=bfb941114c3274765a58b40ae9845e76, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:23,116 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689793882684.bfb941114c3274765a58b40ae9845e76.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689793883116"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689793883116"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689793883116"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689793883116"}]},"ts":"1689793883116"} 2023-07-19 19:11:23,122 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-19 19:11:23,122 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 47edc632059d78d86cf0caad862b4f09, server=jenkins-hbase4.apache.org,46111,1689793835594 in 176 msec 2023-07-19 19:11:23,123 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-19 19:11:23,123 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure bfb941114c3274765a58b40ae9845e76, server=jenkins-hbase4.apache.org,40791,1689793835731 in 176 msec 2023-07-19 19:11:23,123 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=47edc632059d78d86cf0caad862b4f09, ASSIGN in 341 msec 2023-07-19 19:11:23,125 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-19 19:11:23,125 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bfb941114c3274765a58b40ae9845e76, ASSIGN in 342 msec 2023-07-19 19:11:23,126 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 19:11:23,126 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793883126"}]},"ts":"1689793883126"} 2023-07-19 19:11:23,127 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-19 19:11:23,130 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 19:11:23,130 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-19 19:11:23,132 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40791] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-19 19:11:23,133 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:23,134 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:23,134 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:23,134 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:23,136 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 19:11:23,136 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 19:11:23,136 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 19:11:23,136 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 19:11:23,138 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 451 msec 2023-07-19 19:11:23,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 19:11:23,295 INFO [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-19 19:11:23,297 DEBUG [Listener at jenkins-hbase4.apache.org/42871] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-19 19:11:23,297 DEBUG [Listener at jenkins-hbase4.apache.org/42871] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689793882684.47edc632059d78d86cf0caad862b4f09. 2023-07-19 19:11:23,300 INFO [Listener at jenkins-hbase4.apache.org/42871] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 19:11:23,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 19:11:23,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689793883312 (current time:1689793883312). 2023-07-19 19:11:23,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 19:11:23,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(139): Connect 0x0f49a100 to 127.0.0.1:58293 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:11:23,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39d02a9f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:11:23,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:11:23,323 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51746, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:11:23,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f49a100 to 127.0.0.1:58293 2023-07-19 19:11:23,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:11:23,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(139): Connect 0x38b675fe to 127.0.0.1:58293 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:11:23,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ab59249, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:11:23,332 DEBUG [hconnection-0x4289cb52-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:11:23,335 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51762, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:11:23,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x38b675fe to 127.0.0.1:58293 2023-07-19 19:11:23,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:11:23,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-19 19:11:23,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 19:11:23,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 19:11:23,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 19:11:23,345 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 19:11:23,346 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689794483346 2023-07-19 19:11:23,346 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-19 19:11:23,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 19:11:23,348 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 19:11:23,348 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 19:11:23,349 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 19:11:23,349 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 19:11:23,350 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-19 19:11:23,351 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 19:11:23,352 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689794483352 2023-07-19 19:11:23,365 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,365 INFO [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-19 19:11:23,365 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:23,367 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-19 19:11:23,367 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-19 19:11:23,367 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,367 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,369 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:23,369 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:23,369 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:23,369 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:23,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:23,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:23,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:23,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:23,369 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:23,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:23,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:23,369 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:23,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,370 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:23,370 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 19:11:23,370 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,370 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,370 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-19 19:11:23,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-19 19:11:23,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,371 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 19:11:23,371 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 19:11:23,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-19 19:11:23,371 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,371 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 19:11:23,371 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:23,371 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,372 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 19:11:23,372 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 19:11:23,372 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:23,372 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-19 19:11:23,373 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 19:11:23,373 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-19 19:11:23,373 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46111,1689793835594' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-19 19:11:23,371 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 19:11:23,373 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45693,1689793835672' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-19 19:11:23,373 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,374 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 19:11:23,374 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:23,377 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 19:11:23,377 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-19 19:11:23,377 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40791,1689793835731' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-19 19:11:23,378 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:23,378 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:23,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:23,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:23,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:23,379 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,379 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,379 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:11:23,382 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,382 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:23,382 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:23,382 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:11:23,382 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,383 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:11:23,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:23,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:23,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:23,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:23,384 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46111,1689793835594' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-19 19:11:23,384 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13e00db5[Count = 1] remaining members to acquire global barrier 2023-07-19 19:11:23,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:23,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:23,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:23,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:23,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:23,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:23,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:23,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:23,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:23,386 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40791,1689793835731' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-19 19:11:23,386 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13e00db5[Count = 0] remaining members to acquire global barrier 2023-07-19 19:11:23,386 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-19 19:11:23,386 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,388 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,388 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,388 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,388 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 19:11:23,388 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:23,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,388 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 19:11:23,388 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 19:11:23,388 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689793882684.47edc632059d78d86cf0caad862b4f09. 2023-07-19 19:11:23,388 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:11:23,388 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:11:23,388 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:11:23,388 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689793882684.bfb941114c3274765a58b40ae9845e76. 2023-07-19 19:11:23,388 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689793882684.47edc632059d78d86cf0caad862b4f09. started... 2023-07-19 19:11:23,388 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:11:23,388 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:23,389 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 19:11:23,388 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-19 19:11:23,389 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689793882684.bfb941114c3274765a58b40ae9845e76. started... 2023-07-19 19:11:23,389 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45693,1689793835672' in zk 2023-07-19 19:11:23,389 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 47edc632059d78d86cf0caad862b4f09: 2023-07-19 19:11:23,390 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bfb941114c3274765a58b40ae9845e76: 2023-07-19 19:11:23,391 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689793882684.47edc632059d78d86cf0caad862b4f09.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,391 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689793882684.bfb941114c3274765a58b40ae9845e76.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,391 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:11:23,392 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 19:11:23,392 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:11:23,395 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 19:11:23,396 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 19:11:23,396 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:23,396 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-19 19:11:23,411 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689793882684.47edc632059d78d86cf0caad862b4f09. completed. 2023-07-19 19:11:23,411 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689793882684.47edc632059d78d86cf0caad862b4f09. 2023-07-19 19:11:23,411 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:11:23,411 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:11:23,411 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:23,411 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-19 19:11:23,411 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46111,1689793835594' in zk 2023-07-19 19:11:23,414 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:23,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:23,414 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 19:11:23,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:23,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:23,414 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:23,415 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-19 19:11:23,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:23,416 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689793882684.bfb941114c3274765a58b40ae9845e76. completed. 2023-07-19 19:11:23,416 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689793882684.bfb941114c3274765a58b40ae9845e76. 2023-07-19 19:11:23,417 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:11:23,417 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:11:23,417 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:23,417 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-19 19:11:23,417 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40791,1689793835731' in zk 2023-07-19 19:11:23,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:23,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,418 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 19:11:23,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:23,418 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:23,418 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:23,419 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-19 19:11:23,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:23,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:23,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:23,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:23,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:23,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:23,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,46111,1689793835594': 2023-07-19 19:11:23,422 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46111,1689793835594' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-19 19:11:23,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:23,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:23,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:23,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:23,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:23,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:23,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:23,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:23,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:23,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:23,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:23,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:23,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,40791,1689793835731': 2023-07-19 19:11:23,426 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40791,1689793835731' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-19 19:11:23,426 INFO [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-19 19:11:23,426 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 19:11:23,426 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 19:11:23,426 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,426 INFO [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 19:11:23,429 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,429 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,429 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,429 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:23,429 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,429 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:23,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:23,429 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:23,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,429 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:23,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:23,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:23,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:23,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:23,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:23,430 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:23,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:23,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:23,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:23,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,430 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:23,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:23,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:23,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:23,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:23,432 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:23,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:23,433 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:23,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,433 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:23,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:23,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:23,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:23,436 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:23,436 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:23,436 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:23,436 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:23,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:23,436 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:23,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:23,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:23,436 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:23,436 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,436 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:23,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:23,436 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:23,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:23,438 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:23,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:23,436 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,438 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:23,438 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-19 19:11:23,438 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:23,438 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:23,438 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:23,438 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 19:11:23,438 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,438 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:23,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:23,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:23,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:23,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:23,438 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:23,439 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,439 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,439 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-19 19:11:23,447 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,447 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,448 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:11:23,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 19:11:23,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:11:23,449 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 19:11:23,466 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,489 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-19 19:11:23,489 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,490 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:23,490 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689793883346Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689793883447 (+101 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689793883447Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689793883447Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689793883450 (+3 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689793883458 (+8 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689793883489 (+31 ms) 2023-07-19 19:11:23,497 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 19:11:23,499 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 151 msec 2023-07-19 19:11:23,649 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:11:23,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 19:11:23,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 19:11:23,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46111] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689793882684.47edc632059d78d86cf0caad862b4f09. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 19:11:23,655 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40791] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689793882684.bfb941114c3274765a58b40ae9845e76. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 19:11:23,659 DEBUG [Listener at jenkins-hbase4.apache.org/42871] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-19 19:11:23,659 DEBUG [Listener at jenkins-hbase4.apache.org/42871] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689793882684.47edc632059d78d86cf0caad862b4f09. 2023-07-19 19:11:23,659 INFO [Listener at jenkins-hbase4.apache.org/42871] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 19:11:23,670 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 19:11:23,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689793883671 (current time:1689793883671). 2023-07-19 19:11:23,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 19:11:23,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(139): Connect 0x05cfe58d to 127.0.0.1:58293 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:11:23,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7616903, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:11:23,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:11:23,686 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51776, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:11:23,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x05cfe58d to 127.0.0.1:58293 2023-07-19 19:11:23,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:11:23,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(139): Connect 0x771aa336 to 127.0.0.1:58293 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:11:23,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d83d3d5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:11:23,695 DEBUG [hconnection-0x1269a17-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:11:23,698 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51778, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:11:23,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x771aa336 to 127.0.0.1:58293 2023-07-19 19:11:23,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:11:23,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-19 19:11:23,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 19:11:23,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 19:11:23,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 19:11:23,707 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 19:11:23,708 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689794483708 2023-07-19 19:11:23,708 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-19 19:11:23,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 19:11:23,710 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 19:11:23,710 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 19:11:23,711 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 19:11:23,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 19:11:23,712 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-19 19:11:23,713 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 19:11:23,714 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689794483714 2023-07-19 19:11:23,726 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-19 19:11:23,726 INFO [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-19 19:11:23,726 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:23,728 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-19 19:11:23,728 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-19 19:11:23,728 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,728 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,730 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:23,730 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:23,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:23,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:23,730 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:23,730 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:23,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:23,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:23,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:23,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:23,731 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:23,731 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:23,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,731 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:23,731 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 19:11:23,732 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,732 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,732 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-19 19:11:23,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,732 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 19:11:23,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-19 19:11:23,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-19 19:11:23,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,733 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-19 19:11:23,732 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 19:11:23,733 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 19:11:23,734 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 19:11:23,734 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:23,736 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 19:11:23,736 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-19 19:11:23,736 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40791,1689793835731' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-19 19:11:23,736 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-19 19:11:23,736 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-19 19:11:23,736 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 19:11:23,736 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 19:11:23,736 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:23,736 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:23,738 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 19:11:23,739 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-19 19:11:23,739 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 19:11:23,739 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-19 19:11:23,739 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45693,1689793835672' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-19 19:11:23,739 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46111,1689793835594' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-19 19:11:23,740 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:23,740 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:23,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:23,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:23,741 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,742 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,742 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:23,742 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:23,742 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:11:23,742 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,742 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:11:23,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:23,743 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,743 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:11:23,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 19:11:23,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:23,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:23,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:23,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:23,744 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40791,1689793835731' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-19 19:11:23,745 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e9292e1[Count = 1] remaining members to acquire global barrier 2023-07-19 19:11:23,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:23,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:23,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:23,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:23,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:23,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 19:11:23,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:23,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:23,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:23,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:23,748 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46111,1689793835594' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-19 19:11:23,748 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e9292e1[Count = 0] remaining members to acquire global barrier 2023-07-19 19:11:23,748 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-19 19:11:23,748 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,750 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,750 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,750 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,751 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 19:11:23,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,751 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:23,751 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:11:23,751 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:11:23,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,751 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689793882684.47edc632059d78d86cf0caad862b4f09. 2023-07-19 19:11:23,751 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 19:11:23,751 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 19:11:23,751 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:23,751 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 19:11:23,751 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-19 19:11:23,751 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689793882684.47edc632059d78d86cf0caad862b4f09. started... 2023-07-19 19:11:23,751 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45693,1689793835672' in zk 2023-07-19 19:11:23,752 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689793882684.bfb941114c3274765a58b40ae9845e76. 2023-07-19 19:11:23,751 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:11:23,752 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:11:23,752 INFO [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 47edc632059d78d86cf0caad862b4f09 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-19 19:11:23,752 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689793882684.bfb941114c3274765a58b40ae9845e76. started... 2023-07-19 19:11:23,752 INFO [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.HRegion(2745): Flushing bfb941114c3274765a58b40ae9845e76 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-19 19:11:23,753 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 19:11:23,753 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:23,753 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-19 19:11:23,774 INFO [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230719437fbf50d48f4abbaac08f72d04d2538 to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230719437fbf50d48f4abbaac08f72d04d2538 2023-07-19 19:11:23,774 INFO [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307190141876f2f8c4d4f8607b2a59722326f to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307190141876f2f8c4d4f8607b2a59722326f 2023-07-19 19:11:23,798 INFO [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testConsecutiveExports/47edc632059d78d86cf0caad862b4f09/.tmp/cf/26f48b5c34924369b5b63cbce95f3124 2023-07-19 19:11:23,799 INFO [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testConsecutiveExports/bfb941114c3274765a58b40ae9845e76/.tmp/cf/213bf181c7254cdcadc2295e3be9d082 2023-07-19 19:11:23,806 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testConsecutiveExports/47edc632059d78d86cf0caad862b4f09/.tmp/cf/26f48b5c34924369b5b63cbce95f3124 as hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testConsecutiveExports/47edc632059d78d86cf0caad862b4f09/cf/26f48b5c34924369b5b63cbce95f3124 2023-07-19 19:11:23,807 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testConsecutiveExports/bfb941114c3274765a58b40ae9845e76/.tmp/cf/213bf181c7254cdcadc2295e3be9d082 as hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testConsecutiveExports/bfb941114c3274765a58b40ae9845e76/cf/213bf181c7254cdcadc2295e3be9d082 2023-07-19 19:11:23,810 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:11:23,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 19:11:23,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:11:23,812 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 19:11:23,813 INFO [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testConsecutiveExports/bfb941114c3274765a58b40ae9845e76/cf/213bf181c7254cdcadc2295e3be9d082, entries=47, sequenceid=6, filesize=12.7 K 2023-07-19 19:11:23,813 INFO [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testConsecutiveExports/47edc632059d78d86cf0caad862b4f09/cf/26f48b5c34924369b5b63cbce95f3124, entries=3, sequenceid=6, filesize=5.4 K 2023-07-19 19:11:23,814 INFO [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 47edc632059d78d86cf0caad862b4f09 in 62ms, sequenceid=6, compaction requested=false 2023-07-19 19:11:23,814 INFO [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for bfb941114c3274765a58b40ae9845e76 in 62ms, sequenceid=6, compaction requested=false 2023-07-19 19:11:23,814 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-19 19:11:23,814 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-19 19:11:23,817 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 47edc632059d78d86cf0caad862b4f09: 2023-07-19 19:11:23,817 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bfb941114c3274765a58b40ae9845e76: 2023-07-19 19:11:23,817 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689793882684.47edc632059d78d86cf0caad862b4f09.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-19 19:11:23,817 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689793882684.bfb941114c3274765a58b40ae9845e76.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-19 19:11:23,817 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:11:23,817 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:11:23,817 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testConsecutiveExports/47edc632059d78d86cf0caad862b4f09/cf/26f48b5c34924369b5b63cbce95f3124] hfiles 2023-07-19 19:11:23,817 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testConsecutiveExports/bfb941114c3274765a58b40ae9845e76/cf/213bf181c7254cdcadc2295e3be9d082] hfiles 2023-07-19 19:11:23,817 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testConsecutiveExports/bfb941114c3274765a58b40ae9845e76/cf/213bf181c7254cdcadc2295e3be9d082 for snapshot=snaptb0-testConsecutiveExports 2023-07-19 19:11:23,817 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testConsecutiveExports/47edc632059d78d86cf0caad862b4f09/cf/26f48b5c34924369b5b63cbce95f3124 for snapshot=snaptb0-testConsecutiveExports 2023-07-19 19:11:23,832 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689793882684.47edc632059d78d86cf0caad862b4f09. completed. 2023-07-19 19:11:23,832 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689793882684.47edc632059d78d86cf0caad862b4f09. 2023-07-19 19:11:23,832 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:11:23,833 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:11:23,833 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:23,833 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-19 19:11:23,833 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46111,1689793835594' in zk 2023-07-19 19:11:23,834 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:23,834 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 19:11:23,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:23,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:23,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:23,835 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689793882684.bfb941114c3274765a58b40ae9845e76. completed. 2023-07-19 19:11:23,835 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:23,835 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689793882684.bfb941114c3274765a58b40ae9845e76. 2023-07-19 19:11:23,835 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-19 19:11:23,837 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:11:23,837 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:11:23,837 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:23,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:23,837 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-19 19:11:23,837 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40791,1689793835731' in zk 2023-07-19 19:11:23,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:23,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 19:11:23,838 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:23,839 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 19:11:23,839 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:23,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:23,839 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-19 19:11:23,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:23,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:23,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:23,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 19:11:23,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:23,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:23,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:23,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,46111,1689793835594': 2023-07-19 19:11:23,843 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46111,1689793835594' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-19 19:11:23,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:23,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:23,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:23,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:23,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:23,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 19:11:23,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:23,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:23,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:23,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:23,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 19:11:23,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:23,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:23,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:23,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,40791,1689793835731': 2023-07-19 19:11:23,846 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40791,1689793835731' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-19 19:11:23,846 INFO [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-19 19:11:23,846 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 19:11:23,846 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 19:11:23,846 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-19 19:11:23,846 INFO [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 19:11:23,849 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,849 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,849 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:23,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,849 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:23,849 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,849 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:23,849 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:23,849 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:23,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:23,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:23,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:23,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:23,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:23,850 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:23,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:23,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:23,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:23,850 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:23,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 19:11:23,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:23,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 19:11:23,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:23,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:23,852 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:23,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:23,853 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:23,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:23,853 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:23,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 19:11:23,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:23,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:23,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:23,863 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:23,863 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:23,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:23,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:23,863 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:23,863 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:23,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:23,864 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:23,864 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:23,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:23,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:23,864 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-19 19:11:23,863 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:23,866 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-19 19:11:23,863 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:23,863 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,866 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-19 19:11:23,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:23,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:23,866 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 19:11:23,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:23,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:23,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:23,866 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:23,866 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:23,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:23,866 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:23,866 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:23,866 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,867 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:23,867 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:23,867 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,867 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,867 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230719437fbf50d48f4abbaac08f72d04d2538, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307190141876f2f8c4d4f8607b2a59722326f] mob files 2023-07-19 19:11:23,867 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230719437fbf50d48f4abbaac08f72d04d2538 2023-07-19 19:11:23,867 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307190141876f2f8c4d4f8607b2a59722326f 2023-07-19 19:11:23,875 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-19 19:11:23,876 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,901 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,921 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-19 19:11:23,921 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,921 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 19:11:23,921 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689793883708Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689793883875 (+167 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689793883875Loading Region manifests for snaptb0-testConsecutiveExports at 1689793883875Writing data manifest for snaptb0-testConsecutiveExports at 1689793883880 (+5 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689793883894 (+14 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689793883921 (+27 ms) 2023-07-19 19:11:23,924 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 19:11:23,925 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 215 msec 2023-07-19 19:11:24,012 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:11:24,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 19:11:24,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 19:11:24,014 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/local-export-1689793884014 2023-07-19 19:11:24,014 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/local-export-1689793884014, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/local-export-1689793884014, srcFsUri=hdfs://localhost:43367, srcDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978 2023-07-19 19:11:24,040 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43367, inputRoot=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978 2023-07-19 19:11:24,040 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@7074c63, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/local-export-1689793884014, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/local-export-1689793884014/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 19:11:24,040 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43367, inputRoot=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978, snapshotDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-19 19:11:24,049 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/local-export-1689793884014/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 19:11:24,061 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:24,062 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:24,062 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:24,063 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:24,063 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:24,063 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:24,063 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:24,133 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/hadoop-5314238955003215062.jar 2023-07-19 19:11:24,134 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:24,134 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:24,134 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:24,135 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:24,135 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:24,135 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:24,136 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 19:11:24,136 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 19:11:24,136 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 19:11:24,137 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 19:11:24,137 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 19:11:24,137 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 19:11:24,138 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 19:11:24,138 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 19:11:24,138 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 19:11:24,139 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 19:11:24,139 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:11:24,140 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:11:24,140 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 19:11:24,140 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:11:24,140 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:11:24,141 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 19:11:24,141 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 19:11:24,532 WARN [Listener at jenkins-hbase4.apache.org/42871] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 19:11:24,535 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-19 19:11:24,537 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-19 19:11:27,005 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 19:11:27,006 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 19:11:27,009 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843898_0002_000001 (auth:SIMPLE) 2023-07-19 19:11:27,411 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843898_0003_000001 (auth:SIMPLE) 2023-07-19 19:11:27,988 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 19:11:31,869 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843898_0003_000001 (auth:SIMPLE) 2023-07-19 19:11:34,170 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843898_0003_000001 (auth:SIMPLE) 2023-07-19 19:11:37,178 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843898_0003_000001 (auth:SIMPLE) 2023-07-19 19:11:38,721 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 19:11:38,722 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 19:11:38,726 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-19 19:11:38,726 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 19:11:38,727 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 19:11:38,727 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1054544951_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 19:11:38,729 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(367): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 19:11:38,729 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(367): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 19:11:38,729 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@861f440 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/local-export-1689793884014/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/local-export-1689793884014/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 19:11:38,730 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/local-export-1689793884014/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 19:11:38,730 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/local-export-1689793884014/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 19:11:38,731 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/local-export-1689793884014, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/local-export-1689793884014, srcFsUri=hdfs://localhost:43367, srcDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978 2023-07-19 19:11:38,757 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43367, inputRoot=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978 2023-07-19 19:11:38,757 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@1fc88a68, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/local-export-1689793884014, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/local-export-1689793884014/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 19:11:38,757 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43367, inputRoot=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978, snapshotDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-19 19:11:38,771 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/local-export-1689793884014/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 19:11:38,785 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:38,785 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:38,785 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:38,786 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:38,786 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:38,786 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:38,787 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:38,854 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/hadoop-1691353608464513692.jar 2023-07-19 19:11:38,855 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:38,855 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:38,855 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:38,856 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:38,856 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:38,856 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 19:11:38,857 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 19:11:38,857 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 19:11:38,857 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 19:11:38,858 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 19:11:38,858 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 19:11:38,858 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 19:11:38,859 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 19:11:38,859 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 19:11:38,859 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 19:11:38,860 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 19:11:38,860 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:11:38,860 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:11:38,861 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 19:11:38,861 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:11:38,861 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:11:38,862 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 19:11:38,862 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 19:11:39,241 WARN [Listener at jenkins-hbase4.apache.org/42871] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 19:11:39,244 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-19 19:11:39,247 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-19 19:11:43,362 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 19:11:43,363 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 19:11:43,366 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843898_0003_000001 (auth:SIMPLE) 2023-07-19 19:11:44,126 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843898_0004_000001 (auth:SIMPLE) 2023-07-19 19:11:48,653 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843898_0004_000001 (auth:SIMPLE) 2023-07-19 19:11:50,957 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843898_0004_000001 (auth:SIMPLE) 2023-07-19 19:11:54,200 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843898_0004_000001 (auth:SIMPLE) 2023-07-19 19:11:55,463 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 19:11:55,463 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 19:11:55,476 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-19 19:11:55,476 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 19:11:55,476 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 19:11:55,477 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1054544951_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 19:11:55,482 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(367): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 19:11:55,482 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(367): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 19:11:55,482 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@861f440 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/local-export-1689793884014/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/local-export-1689793884014/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 19:11:55,482 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/local-export-1689793884014/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 19:11:55,482 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/local-export-1689793884014/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 19:11:55,496 INFO [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-19 19:11:55,497 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-19 19:11:55,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-19 19:11:55,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-19 19:11:55,504 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793915504"}]},"ts":"1689793915504"} 2023-07-19 19:11:55,507 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-19 19:11:55,509 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-19 19:11:55,510 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=47edc632059d78d86cf0caad862b4f09, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bfb941114c3274765a58b40ae9845e76, UNASSIGN}] 2023-07-19 19:11:55,512 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bfb941114c3274765a58b40ae9845e76, UNASSIGN 2023-07-19 19:11:55,516 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=47edc632059d78d86cf0caad862b4f09, UNASSIGN 2023-07-19 19:11:55,524 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=47edc632059d78d86cf0caad862b4f09, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:55,524 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=bfb941114c3274765a58b40ae9845e76, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:55,524 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689793882684.47edc632059d78d86cf0caad862b4f09.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689793915524"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793915524"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793915524"}]},"ts":"1689793915524"} 2023-07-19 19:11:55,524 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689793882684.bfb941114c3274765a58b40ae9845e76.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689793915524"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793915524"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793915524"}]},"ts":"1689793915524"} 2023-07-19 19:11:55,526 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 47edc632059d78d86cf0caad862b4f09, server=jenkins-hbase4.apache.org,46111,1689793835594}] 2023-07-19 19:11:55,528 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure bfb941114c3274765a58b40ae9845e76, server=jenkins-hbase4.apache.org,40791,1689793835731}] 2023-07-19 19:11:55,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-19 19:11:55,678 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 47edc632059d78d86cf0caad862b4f09 2023-07-19 19:11:55,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 47edc632059d78d86cf0caad862b4f09, disabling compactions & flushes 2023-07-19 19:11:55,679 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689793882684.47edc632059d78d86cf0caad862b4f09. 2023-07-19 19:11:55,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689793882684.47edc632059d78d86cf0caad862b4f09. 2023-07-19 19:11:55,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689793882684.47edc632059d78d86cf0caad862b4f09. after waiting 0 ms 2023-07-19 19:11:55,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689793882684.47edc632059d78d86cf0caad862b4f09. 2023-07-19 19:11:55,683 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close bfb941114c3274765a58b40ae9845e76 2023-07-19 19:11:55,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bfb941114c3274765a58b40ae9845e76, disabling compactions & flushes 2023-07-19 19:11:55,683 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689793882684.bfb941114c3274765a58b40ae9845e76. 2023-07-19 19:11:55,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689793882684.bfb941114c3274765a58b40ae9845e76. 2023-07-19 19:11:55,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689793882684.bfb941114c3274765a58b40ae9845e76. after waiting 0 ms 2023-07-19 19:11:55,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689793882684.bfb941114c3274765a58b40ae9845e76. 2023-07-19 19:11:55,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testConsecutiveExports/47edc632059d78d86cf0caad862b4f09/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 19:11:55,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:11:55,702 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689793882684.47edc632059d78d86cf0caad862b4f09. 2023-07-19 19:11:55,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 47edc632059d78d86cf0caad862b4f09: 2023-07-19 19:11:55,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testConsecutiveExports/bfb941114c3274765a58b40ae9845e76/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 19:11:55,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:11:55,705 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 47edc632059d78d86cf0caad862b4f09 2023-07-19 19:11:55,705 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689793882684.bfb941114c3274765a58b40ae9845e76. 2023-07-19 19:11:55,705 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bfb941114c3274765a58b40ae9845e76: 2023-07-19 19:11:55,706 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=47edc632059d78d86cf0caad862b4f09, regionState=CLOSED 2023-07-19 19:11:55,706 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689793882684.47edc632059d78d86cf0caad862b4f09.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689793915706"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793915706"}]},"ts":"1689793915706"} 2023-07-19 19:11:55,707 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed bfb941114c3274765a58b40ae9845e76 2023-07-19 19:11:55,707 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=bfb941114c3274765a58b40ae9845e76, regionState=CLOSED 2023-07-19 19:11:55,708 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689793882684.bfb941114c3274765a58b40ae9845e76.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689793915707"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793915707"}]},"ts":"1689793915707"} 2023-07-19 19:11:55,711 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-19 19:11:55,711 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 47edc632059d78d86cf0caad862b4f09, server=jenkins-hbase4.apache.org,46111,1689793835594 in 182 msec 2023-07-19 19:11:55,713 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-19 19:11:55,713 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure bfb941114c3274765a58b40ae9845e76, server=jenkins-hbase4.apache.org,40791,1689793835731 in 181 msec 2023-07-19 19:11:55,713 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=47edc632059d78d86cf0caad862b4f09, UNASSIGN in 201 msec 2023-07-19 19:11:55,715 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-19 19:11:55,715 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bfb941114c3274765a58b40ae9845e76, UNASSIGN in 203 msec 2023-07-19 19:11:55,716 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793915716"}]},"ts":"1689793915716"} 2023-07-19 19:11:55,718 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-19 19:11:55,720 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-19 19:11:55,722 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 223 msec 2023-07-19 19:11:55,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-19 19:11:55,807 INFO [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-19 19:11:55,808 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-19 19:11:55,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 19:11:55,820 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 19:11:55,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-19 19:11:55,822 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 19:11:55,834 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40791] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-19 19:11:55,839 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 19:11:55,839 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 19:11:55,839 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 19:11:55,839 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 19:11:55,840 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 19:11:55,840 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 19:11:55,840 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 19:11:55,840 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 19:11:55,841 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 19:11:55,841 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 19:11:55,841 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:55,842 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 19:11:55,842 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 19:11:55,841 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:55,842 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:55,842 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:55,843 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testConsecutiveExports/47edc632059d78d86cf0caad862b4f09 2023-07-19 19:11:55,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-19 19:11:55,847 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testConsecutiveExports/bfb941114c3274765a58b40ae9845e76 2023-07-19 19:11:55,851 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testConsecutiveExports/47edc632059d78d86cf0caad862b4f09/cf, FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testConsecutiveExports/47edc632059d78d86cf0caad862b4f09/recovered.edits] 2023-07-19 19:11:55,852 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testConsecutiveExports/bfb941114c3274765a58b40ae9845e76/cf, FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testConsecutiveExports/bfb941114c3274765a58b40ae9845e76/recovered.edits] 2023-07-19 19:11:55,859 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testConsecutiveExports/47edc632059d78d86cf0caad862b4f09/cf/26f48b5c34924369b5b63cbce95f3124 to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testConsecutiveExports/47edc632059d78d86cf0caad862b4f09/cf/26f48b5c34924369b5b63cbce95f3124 2023-07-19 19:11:55,862 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testConsecutiveExports/bfb941114c3274765a58b40ae9845e76/cf/213bf181c7254cdcadc2295e3be9d082 to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testConsecutiveExports/bfb941114c3274765a58b40ae9845e76/cf/213bf181c7254cdcadc2295e3be9d082 2023-07-19 19:11:55,864 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testConsecutiveExports/47edc632059d78d86cf0caad862b4f09/recovered.edits/9.seqid to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testConsecutiveExports/47edc632059d78d86cf0caad862b4f09/recovered.edits/9.seqid 2023-07-19 19:11:55,865 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testConsecutiveExports/47edc632059d78d86cf0caad862b4f09 2023-07-19 19:11:55,868 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testConsecutiveExports/bfb941114c3274765a58b40ae9845e76/recovered.edits/9.seqid to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testConsecutiveExports/bfb941114c3274765a58b40ae9845e76/recovered.edits/9.seqid 2023-07-19 19:11:55,869 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testConsecutiveExports/bfb941114c3274765a58b40ae9845e76 2023-07-19 19:11:55,869 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-19 19:11:55,870 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-19 19:11:55,871 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-19 19:11:55,879 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230719437fbf50d48f4abbaac08f72d04d2538 to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230719437fbf50d48f4abbaac08f72d04d2538 2023-07-19 19:11:55,880 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307190141876f2f8c4d4f8607b2a59722326f to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307190141876f2f8c4d4f8607b2a59722326f 2023-07-19 19:11:55,881 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-19 19:11:55,884 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 19:11:55,886 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-19 19:11:55,888 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-19 19:11:55,890 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 19:11:55,890 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-19 19:11:55,890 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689793882684.47edc632059d78d86cf0caad862b4f09.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689793915890"}]},"ts":"9223372036854775807"} 2023-07-19 19:11:55,890 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689793882684.bfb941114c3274765a58b40ae9845e76.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689793915890"}]},"ts":"9223372036854775807"} 2023-07-19 19:11:55,892 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 19:11:55,892 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 47edc632059d78d86cf0caad862b4f09, NAME => 'testtb-testConsecutiveExports,,1689793882684.47edc632059d78d86cf0caad862b4f09.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => bfb941114c3274765a58b40ae9845e76, NAME => 'testtb-testConsecutiveExports,1,1689793882684.bfb941114c3274765a58b40ae9845e76.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 19:11:55,892 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-19 19:11:55,892 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689793915892"}]},"ts":"9223372036854775807"} 2023-07-19 19:11:55,894 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-19 19:11:55,896 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 19:11:55,897 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 88 msec 2023-07-19 19:11:55,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-19 19:11:55,945 INFO [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-19 19:11:55,957 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-19 19:11:55,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-19 19:11:55,964 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-19 19:11:55,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-19 19:11:56,008 INFO [Listener at jenkins-hbase4.apache.org/42871] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=746 (was 766), OpenFileDescriptor=895 (was 922), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=381 (was 443), ProcessCount=184 (was 182) - ProcessCount LEAK? -, AvailableMemoryMB=2640 (was 2831) 2023-07-19 19:11:56,008 WARN [Listener at jenkins-hbase4.apache.org/42871] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-07-19 19:11:56,054 INFO [Listener at jenkins-hbase4.apache.org/42871] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=746, OpenFileDescriptor=895, MaxFileDescriptor=60000, SystemLoadAverage=381, ProcessCount=184, AvailableMemoryMB=2608 2023-07-19 19:11:56,054 WARN [Listener at jenkins-hbase4.apache.org/42871] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-07-19 19:11:56,062 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-19 19:11:56,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:56,070 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 19:11:56,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-19 19:11:56,074 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 19:11:56,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 19:11:56,085 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c823d9a30fdea6a180036a5e7f4928f5 2023-07-19 19:11:56,085 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d3944895f133827e1ec03c51efea3e8a 2023-07-19 19:11:56,092 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c823d9a30fdea6a180036a5e7f4928f5 empty. 2023-07-19 19:11:56,092 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d3944895f133827e1ec03c51efea3e8a empty. 2023-07-19 19:11:56,115 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d3944895f133827e1ec03c51efea3e8a 2023-07-19 19:11:56,115 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c823d9a30fdea6a180036a5e7f4928f5 2023-07-19 19:11:56,115 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-19 19:11:56,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 19:11:56,183 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-19 19:11:56,192 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => c823d9a30fdea6a180036a5e7f4928f5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689793916061.c823d9a30fdea6a180036a5e7f4928f5.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp 2023-07-19 19:11:56,195 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => d3944895f133827e1ec03c51efea3e8a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689793916061.d3944895f133827e1ec03c51efea3e8a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp 2023-07-19 19:11:56,235 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689793916061.c823d9a30fdea6a180036a5e7f4928f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:11:56,235 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing c823d9a30fdea6a180036a5e7f4928f5, disabling compactions & flushes 2023-07-19 19:11:56,235 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689793916061.c823d9a30fdea6a180036a5e7f4928f5. 2023-07-19 19:11:56,235 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689793916061.c823d9a30fdea6a180036a5e7f4928f5. 2023-07-19 19:11:56,235 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689793916061.c823d9a30fdea6a180036a5e7f4928f5. after waiting 0 ms 2023-07-19 19:11:56,235 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689793916061.c823d9a30fdea6a180036a5e7f4928f5. 2023-07-19 19:11:56,235 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689793916061.c823d9a30fdea6a180036a5e7f4928f5. 2023-07-19 19:11:56,235 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for c823d9a30fdea6a180036a5e7f4928f5: 2023-07-19 19:11:56,242 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689793916061.d3944895f133827e1ec03c51efea3e8a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:11:56,242 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing d3944895f133827e1ec03c51efea3e8a, disabling compactions & flushes 2023-07-19 19:11:56,242 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689793916061.d3944895f133827e1ec03c51efea3e8a. 2023-07-19 19:11:56,242 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689793916061.d3944895f133827e1ec03c51efea3e8a. 2023-07-19 19:11:56,242 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689793916061.d3944895f133827e1ec03c51efea3e8a. after waiting 0 ms 2023-07-19 19:11:56,242 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689793916061.d3944895f133827e1ec03c51efea3e8a. 2023-07-19 19:11:56,242 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689793916061.d3944895f133827e1ec03c51efea3e8a. 2023-07-19 19:11:56,242 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for d3944895f133827e1ec03c51efea3e8a: 2023-07-19 19:11:56,247 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 19:11:56,248 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689793916061.c823d9a30fdea6a180036a5e7f4928f5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689793916248"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793916248"}]},"ts":"1689793916248"} 2023-07-19 19:11:56,248 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689793916061.d3944895f133827e1ec03c51efea3e8a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689793916248"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793916248"}]},"ts":"1689793916248"} 2023-07-19 19:11:56,264 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 19:11:56,265 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 19:11:56,266 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793916265"}]},"ts":"1689793916265"} 2023-07-19 19:11:56,267 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-19 19:11:56,272 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 19:11:56,274 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 19:11:56,274 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 19:11:56,274 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 19:11:56,274 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 19:11:56,274 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c823d9a30fdea6a180036a5e7f4928f5, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d3944895f133827e1ec03c51efea3e8a, ASSIGN}] 2023-07-19 19:11:56,282 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d3944895f133827e1ec03c51efea3e8a, ASSIGN 2023-07-19 19:11:56,282 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c823d9a30fdea6a180036a5e7f4928f5, ASSIGN 2023-07-19 19:11:56,283 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d3944895f133827e1ec03c51efea3e8a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45693,1689793835672; forceNewPlan=false, retain=false 2023-07-19 19:11:56,283 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c823d9a30fdea6a180036a5e7f4928f5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40791,1689793835731; forceNewPlan=false, retain=false 2023-07-19 19:11:56,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 19:11:56,434 INFO [jenkins-hbase4:37769] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 19:11:56,437 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=c823d9a30fdea6a180036a5e7f4928f5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:56,437 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=d3944895f133827e1ec03c51efea3e8a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:56,438 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689793916061.c823d9a30fdea6a180036a5e7f4928f5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689793916437"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793916437"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793916437"}]},"ts":"1689793916437"} 2023-07-19 19:11:56,438 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689793916061.d3944895f133827e1ec03c51efea3e8a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689793916437"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793916437"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793916437"}]},"ts":"1689793916437"} 2023-07-19 19:11:56,444 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure d3944895f133827e1ec03c51efea3e8a, server=jenkins-hbase4.apache.org,45693,1689793835672}] 2023-07-19 19:11:56,445 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure c823d9a30fdea6a180036a5e7f4928f5, server=jenkins-hbase4.apache.org,40791,1689793835731}] 2023-07-19 19:11:56,610 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689793916061.c823d9a30fdea6a180036a5e7f4928f5. 2023-07-19 19:11:56,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c823d9a30fdea6a180036a5e7f4928f5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689793916061.c823d9a30fdea6a180036a5e7f4928f5.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 19:11:56,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689793916061.c823d9a30fdea6a180036a5e7f4928f5. service=AccessControlService 2023-07-19 19:11:56,611 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:11:56,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion c823d9a30fdea6a180036a5e7f4928f5 2023-07-19 19:11:56,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689793916061.c823d9a30fdea6a180036a5e7f4928f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:11:56,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c823d9a30fdea6a180036a5e7f4928f5 2023-07-19 19:11:56,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c823d9a30fdea6a180036a5e7f4928f5 2023-07-19 19:11:56,616 INFO [StoreOpener-c823d9a30fdea6a180036a5e7f4928f5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c823d9a30fdea6a180036a5e7f4928f5 2023-07-19 19:11:56,621 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689793916061.d3944895f133827e1ec03c51efea3e8a. 2023-07-19 19:11:56,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d3944895f133827e1ec03c51efea3e8a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689793916061.d3944895f133827e1ec03c51efea3e8a.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 19:11:56,621 DEBUG [StoreOpener-c823d9a30fdea6a180036a5e7f4928f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion/c823d9a30fdea6a180036a5e7f4928f5/cf 2023-07-19 19:11:56,621 DEBUG [StoreOpener-c823d9a30fdea6a180036a5e7f4928f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion/c823d9a30fdea6a180036a5e7f4928f5/cf 2023-07-19 19:11:56,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689793916061.d3944895f133827e1ec03c51efea3e8a. service=AccessControlService 2023-07-19 19:11:56,622 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:11:56,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion d3944895f133827e1ec03c51efea3e8a 2023-07-19 19:11:56,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689793916061.d3944895f133827e1ec03c51efea3e8a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:11:56,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d3944895f133827e1ec03c51efea3e8a 2023-07-19 19:11:56,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d3944895f133827e1ec03c51efea3e8a 2023-07-19 19:11:56,622 INFO [StoreOpener-c823d9a30fdea6a180036a5e7f4928f5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c823d9a30fdea6a180036a5e7f4928f5 columnFamilyName cf 2023-07-19 19:11:56,623 INFO [StoreOpener-d3944895f133827e1ec03c51efea3e8a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d3944895f133827e1ec03c51efea3e8a 2023-07-19 19:11:56,629 INFO [StoreOpener-c823d9a30fdea6a180036a5e7f4928f5-1] regionserver.HStore(310): Store=c823d9a30fdea6a180036a5e7f4928f5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:11:56,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion/c823d9a30fdea6a180036a5e7f4928f5 2023-07-19 19:11:56,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion/c823d9a30fdea6a180036a5e7f4928f5 2023-07-19 19:11:56,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c823d9a30fdea6a180036a5e7f4928f5 2023-07-19 19:11:56,652 DEBUG [StoreOpener-d3944895f133827e1ec03c51efea3e8a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion/d3944895f133827e1ec03c51efea3e8a/cf 2023-07-19 19:11:56,652 DEBUG [StoreOpener-d3944895f133827e1ec03c51efea3e8a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion/d3944895f133827e1ec03c51efea3e8a/cf 2023-07-19 19:11:56,653 INFO [StoreOpener-d3944895f133827e1ec03c51efea3e8a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d3944895f133827e1ec03c51efea3e8a columnFamilyName cf 2023-07-19 19:11:56,656 INFO [StoreOpener-d3944895f133827e1ec03c51efea3e8a-1] regionserver.HStore(310): Store=d3944895f133827e1ec03c51efea3e8a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:11:56,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion/c823d9a30fdea6a180036a5e7f4928f5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 19:11:56,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion/d3944895f133827e1ec03c51efea3e8a 2023-07-19 19:11:56,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion/d3944895f133827e1ec03c51efea3e8a 2023-07-19 19:11:56,658 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c823d9a30fdea6a180036a5e7f4928f5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69526764, jitterRate=0.03602951765060425}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 19:11:56,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c823d9a30fdea6a180036a5e7f4928f5: 2023-07-19 19:11:56,660 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689793916061.c823d9a30fdea6a180036a5e7f4928f5., pid=61, masterSystemTime=1689793916598 2023-07-19 19:11:56,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689793916061.c823d9a30fdea6a180036a5e7f4928f5. 2023-07-19 19:11:56,667 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689793916061.c823d9a30fdea6a180036a5e7f4928f5. 2023-07-19 19:11:56,667 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=c823d9a30fdea6a180036a5e7f4928f5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:56,667 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689793916061.c823d9a30fdea6a180036a5e7f4928f5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689793916667"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689793916667"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689793916667"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689793916667"}]},"ts":"1689793916667"} 2023-07-19 19:11:56,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d3944895f133827e1ec03c51efea3e8a 2023-07-19 19:11:56,672 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-19 19:11:56,673 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure c823d9a30fdea6a180036a5e7f4928f5, server=jenkins-hbase4.apache.org,40791,1689793835731 in 225 msec 2023-07-19 19:11:56,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion/d3944895f133827e1ec03c51efea3e8a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 19:11:56,674 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c823d9a30fdea6a180036a5e7f4928f5, ASSIGN in 399 msec 2023-07-19 19:11:56,675 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d3944895f133827e1ec03c51efea3e8a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68975618, jitterRate=0.027816802263259888}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 19:11:56,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d3944895f133827e1ec03c51efea3e8a: 2023-07-19 19:11:56,675 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689793916061.d3944895f133827e1ec03c51efea3e8a., pid=60, masterSystemTime=1689793916598 2023-07-19 19:11:56,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689793916061.d3944895f133827e1ec03c51efea3e8a. 2023-07-19 19:11:56,683 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689793916061.d3944895f133827e1ec03c51efea3e8a. 2023-07-19 19:11:56,684 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=d3944895f133827e1ec03c51efea3e8a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:56,684 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689793916061.d3944895f133827e1ec03c51efea3e8a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689793916684"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689793916684"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689793916684"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689793916684"}]},"ts":"1689793916684"} 2023-07-19 19:11:56,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 19:11:56,692 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-19 19:11:56,692 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure d3944895f133827e1ec03c51efea3e8a, server=jenkins-hbase4.apache.org,45693,1689793835672 in 242 msec 2023-07-19 19:11:56,697 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-19 19:11:56,697 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d3944895f133827e1ec03c51efea3e8a, ASSIGN in 418 msec 2023-07-19 19:11:56,698 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 19:11:56,698 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793916698"}]},"ts":"1689793916698"} 2023-07-19 19:11:56,700 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-19 19:11:56,703 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 19:11:56,703 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-19 19:11:56,706 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40791] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-19 19:11:56,710 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:56,710 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:56,710 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:56,710 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:56,713 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 19:11:56,713 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 19:11:56,713 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 19:11:56,713 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 19:11:56,715 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 648 msec 2023-07-19 19:11:57,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 19:11:57,188 INFO [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-19 19:11:57,191 DEBUG [Listener at jenkins-hbase4.apache.org/42871] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,191 DEBUG [Listener at jenkins-hbase4.apache.org/42871] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689793916061.c823d9a30fdea6a180036a5e7f4928f5. 2023-07-19 19:11:57,193 INFO [Listener at jenkins-hbase4.apache.org/42871] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 19:11:57,219 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 19:11:57,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689793917219 (current time:1689793917219). 2023-07-19 19:11:57,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 19:11:57,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(139): Connect 0x43c44546 to 127.0.0.1:58293 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:11:57,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c7251e2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:11:57,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:11:57,234 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32772, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:11:57,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x43c44546 to 127.0.0.1:58293 2023-07-19 19:11:57,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:11:57,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(139): Connect 0x6d6d4666 to 127.0.0.1:58293 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:11:57,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c62c0f8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:11:57,250 DEBUG [hconnection-0x62f17dd7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:11:57,251 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32780, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:11:57,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6d6d4666 to 127.0.0.1:58293 2023-07-19 19:11:57,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:11:57,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-19 19:11:57,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 19:11:57,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 19:11:57,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 19:11:57,272 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 19:11:57,273 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689794517273 2023-07-19 19:11:57,273 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 19:11:57,276 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 19:11:57,276 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 19:11:57,276 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 19:11:57,279 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 19:11:57,281 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 10 msec 2023-07-19 19:11:57,286 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 19:11:57,287 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689794517287 2023-07-19 19:11:57,303 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,303 INFO [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-19 19:11:57,303 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:57,305 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-19 19:11:57,305 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-19 19:11:57,306 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,306 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,307 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:57,307 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:57,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:57,307 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:57,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:57,307 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:57,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:57,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:57,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:57,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:57,308 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:57,308 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:57,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,309 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,309 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:57,309 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 19:11:57,309 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,309 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-19 19:11:57,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-19 19:11:57,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,309 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 19:11:57,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-19 19:11:57,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,309 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 19:11:57,309 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 19:11:57,318 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,319 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 19:11:57,319 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:57,328 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 19:11:57,328 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 19:11:57,328 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46111,1689793835594' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 19:11:57,331 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,331 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,332 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:11:57,335 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,335 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 19:11:57,335 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,335 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:57,336 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 19:11:57,339 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:57,337 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 19:11:57,341 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 19:11:57,341 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40791,1689793835731' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 19:11:57,341 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 19:11:57,341 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 19:11:57,341 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45693,1689793835672' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 19:11:57,344 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:57,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:57,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:57,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:57,344 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:57,348 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,348 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:11:57,349 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:57,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:57,349 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,355 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,355 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:11:57,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:57,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:57,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:57,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:57,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45693,1689793835672' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 19:11:57,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@113d2de8[Count = 1] remaining members to acquire global barrier 2023-07-19 19:11:57,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:57,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:57,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:57,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:57,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:57,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:57,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:57,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:57,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:57,360 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40791,1689793835731' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 19:11:57,360 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@113d2de8[Count = 0] remaining members to acquire global barrier 2023-07-19 19:11:57,360 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-19 19:11:57,361 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,362 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,362 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,362 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,362 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 19:11:57,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,363 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:57,362 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 19:11:57,363 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 19:11:57,363 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 19:11:57,363 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46111,1689793835594' in zk 2023-07-19 19:11:57,363 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:57,363 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 19:11:57,366 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:11:57,367 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:11:57,367 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689793916061.c823d9a30fdea6a180036a5e7f4928f5. 2023-07-19 19:11:57,367 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:11:57,367 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:11:57,367 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689793916061.d3944895f133827e1ec03c51efea3e8a. 2023-07-19 19:11:57,367 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689793916061.c823d9a30fdea6a180036a5e7f4928f5. started... 2023-07-19 19:11:57,367 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689793916061.d3944895f133827e1ec03c51efea3e8a. started... 2023-07-19 19:11:57,367 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c823d9a30fdea6a180036a5e7f4928f5: 2023-07-19 19:11:57,369 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d3944895f133827e1ec03c51efea3e8a: 2023-07-19 19:11:57,369 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689793916061.c823d9a30fdea6a180036a5e7f4928f5.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,369 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:11:57,369 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 19:11:57,369 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 19:11:57,369 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689793916061.d3944895f133827e1ec03c51efea3e8a.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,370 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:57,370 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:11:57,370 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 19:11:57,370 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 19:11:57,376 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:11:57,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 19:11:57,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:11:57,377 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 19:11:57,452 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689793916061.c823d9a30fdea6a180036a5e7f4928f5. completed. 2023-07-19 19:11:57,452 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689793916061.c823d9a30fdea6a180036a5e7f4928f5. 2023-07-19 19:11:57,452 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:11:57,452 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:11:57,452 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:57,452 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 19:11:57,452 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40791,1689793835731' in zk 2023-07-19 19:11:57,463 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:57,463 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 19:11:57,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:57,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:57,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:57,463 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:57,463 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 19:11:57,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:57,467 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689793916061.d3944895f133827e1ec03c51efea3e8a. completed. 2023-07-19 19:11:57,467 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689793916061.d3944895f133827e1ec03c51efea3e8a. 2023-07-19 19:11:57,467 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:11:57,467 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:11:57,467 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:57,467 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 19:11:57,467 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45693,1689793835672' in zk 2023-07-19 19:11:57,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:57,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,478 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 19:11:57,478 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:57,478 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 19:11:57,487 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:57,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:57,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:57,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:57,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:57,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:57,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:57,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:57,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40791,1689793835731': 2023-07-19 19:11:57,493 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40791,1689793835731' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-19 19:11:57,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:57,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:57,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:57,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:57,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:57,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:57,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:57,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:57,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:57,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:57,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:57,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:57,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,45693,1689793835672': 2023-07-19 19:11:57,500 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45693,1689793835672' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-19 19:11:57,500 INFO [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-19 19:11:57,500 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 19:11:57,500 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 19:11:57,500 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,500 INFO [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 19:11:57,502 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,502 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,502 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:57,503 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:57,502 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:57,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:57,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:57,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:57,503 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,504 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:57,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:57,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:57,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:57,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:57,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:57,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,507 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:57,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,509 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:57,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:57,509 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:57,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:57,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:57,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:57,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:57,516 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:57,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,517 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:57,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:57,520 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:57,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:57,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:57,526 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:57,526 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:57,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:57,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:57,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:57,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:57,528 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:57,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:57,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:57,528 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:57,528 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,528 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:57,528 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:57,529 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:57,529 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,529 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:57,529 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:57,529 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:57,531 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:57,529 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:57,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:57,531 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,531 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,532 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:57,532 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:57,532 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,532 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,532 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 19:11:57,532 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,533 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-19 19:11:57,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:57,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:57,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:57,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:57,563 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,567 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,577 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:11:57,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 19:11:57,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:11:57,580 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 19:11:57,610 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,634 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-19 19:11:57,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,635 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,635 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689793917273Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689793917563 (+290 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689793917563Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689793917564 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689793917580 (+16 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689793917600 (+20 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689793917634 (+34 ms) 2023-07-19 19:11:57,637 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 19:11:57,639 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 363 msec 2023-07-19 19:11:57,880 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:11:57,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 19:11:57,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 19:11:57,884 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40791] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689793916061.c823d9a30fdea6a180036a5e7f4928f5. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 19:11:57,886 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45693] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689793916061.d3944895f133827e1ec03c51efea3e8a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 19:11:57,889 DEBUG [Listener at jenkins-hbase4.apache.org/42871] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,889 DEBUG [Listener at jenkins-hbase4.apache.org/42871] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689793916061.c823d9a30fdea6a180036a5e7f4928f5. 2023-07-19 19:11:57,889 INFO [Listener at jenkins-hbase4.apache.org/42871] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 19:11:57,904 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 19:11:57,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689793917904 (current time:1689793917904). 2023-07-19 19:11:57,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 19:11:57,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(139): Connect 0x0e3ae518 to 127.0.0.1:58293 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:11:57,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@278e8751, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:11:57,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:11:57,923 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32784, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:11:57,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e3ae518 to 127.0.0.1:58293 2023-07-19 19:11:57,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:11:57,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(139): Connect 0x4642acf6 to 127.0.0.1:58293 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:11:57,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f098303, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:11:57,932 DEBUG [hconnection-0x4cee2bbc-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:11:57,935 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32786, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:11:57,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4642acf6 to 127.0.0.1:58293 2023-07-19 19:11:57,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:11:57,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-19 19:11:57,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 19:11:57,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 19:11:57,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 19:11:57,946 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 19:11:57,947 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689794517947 2023-07-19 19:11:57,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 19:11:57,947 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,949 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 19:11:57,949 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 19:11:57,950 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 19:11:57,951 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 19:11:57,958 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 8 msec 2023-07-19 19:11:57,960 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 19:11:57,960 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689794517960 2023-07-19 19:11:57,972 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,972 INFO [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-19 19:11:57,972 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:57,974 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-19 19:11:57,974 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-19 19:11:57,974 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,974 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,976 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:57,976 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:57,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:57,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:57,976 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:57,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:57,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:57,976 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:57,976 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:57,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,977 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:57,977 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,977 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 19:11:57,977 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-19 19:11:57,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-19 19:11:57,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,977 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 19:11:57,978 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 19:11:57,978 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,978 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,978 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 19:11:57,978 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:57,978 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 19:11:57,979 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 19:11:57,980 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 19:11:57,980 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45693,1689793835672' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 19:11:57,979 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:57,981 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 19:11:57,981 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 19:11:57,981 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46111,1689793835594' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 19:11:57,982 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:57,982 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:57,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:57,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:57,982 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,983 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,983 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:11:57,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:57,984 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,984 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:11:57,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:57,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:57,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:57,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:57,986 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45693,1689793835672' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 19:11:57,986 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e9a3d0a[Count = 1] remaining members to acquire global barrier 2023-07-19 19:11:57,986 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:57,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:57,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:57,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,987 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-19 19:11:57,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,988 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 19:11:57,988 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,988 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 19:11:57,988 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:11:57,990 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 19:11:57,990 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 19:11:57,990 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40791,1689793835731' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 19:11:57,992 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,992 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:57,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:57,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:57,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:57,992 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,992 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:11:57,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:57,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:57,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:57,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:57,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:57,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:57,995 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40791,1689793835731' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 19:11:57,995 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e9a3d0a[Count = 0] remaining members to acquire global barrier 2023-07-19 19:11:57,995 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-19 19:11:57,995 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,998 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,998 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,998 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,998 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 19:11:57,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,998 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:57,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:57,998 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:11:57,998 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 19:11:57,999 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:11:57,998 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 19:11:57,999 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 19:11:57,999 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46111,1689793835594' in zk 2023-07-19 19:11:57,999 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689793916061.c823d9a30fdea6a180036a5e7f4928f5. 2023-07-19 19:11:57,999 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:57,999 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 19:11:57,999 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689793916061.c823d9a30fdea6a180036a5e7f4928f5. started... 2023-07-19 19:11:57,999 INFO [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c823d9a30fdea6a180036a5e7f4928f5 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-19 19:11:58,000 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 19:11:58,000 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:58,000 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 19:11:58,004 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:11:58,004 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:11:58,004 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689793916061.d3944895f133827e1ec03c51efea3e8a. 2023-07-19 19:11:58,004 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689793916061.d3944895f133827e1ec03c51efea3e8a. started... 2023-07-19 19:11:58,004 INFO [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d3944895f133827e1ec03c51efea3e8a 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-19 19:11:58,049 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:11:58,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 19:11:58,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:11:58,051 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 19:11:58,251 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:11:58,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 19:11:58,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:11:58,253 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 19:11:58,453 INFO [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230719fc46489f3f5440ca8b49b88689ee803b to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230719fc46489f3f5440ca8b49b88689ee803b 2023-07-19 19:11:58,464 INFO [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion/c823d9a30fdea6a180036a5e7f4928f5/.tmp/cf/83663a8e5902435ba49671ded4bdbd81 2023-07-19 19:11:58,478 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion/c823d9a30fdea6a180036a5e7f4928f5/.tmp/cf/83663a8e5902435ba49671ded4bdbd81 as hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion/c823d9a30fdea6a180036a5e7f4928f5/cf/83663a8e5902435ba49671ded4bdbd81 2023-07-19 19:11:58,479 INFO [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071945814b2beca94021af3117fe1de411dd to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023071945814b2beca94021af3117fe1de411dd 2023-07-19 19:11:58,486 INFO [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion/c823d9a30fdea6a180036a5e7f4928f5/cf/83663a8e5902435ba49671ded4bdbd81, entries=2, sequenceid=6, filesize=5.3 K 2023-07-19 19:11:58,487 INFO [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for c823d9a30fdea6a180036a5e7f4928f5 in 488ms, sequenceid=6, compaction requested=false 2023-07-19 19:11:58,487 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-19 19:11:58,488 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c823d9a30fdea6a180036a5e7f4928f5: 2023-07-19 19:11:58,488 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689793916061.c823d9a30fdea6a180036a5e7f4928f5.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:58,488 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:11:58,488 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion/c823d9a30fdea6a180036a5e7f4928f5/cf/83663a8e5902435ba49671ded4bdbd81] hfiles 2023-07-19 19:11:58,488 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion/c823d9a30fdea6a180036a5e7f4928f5/cf/83663a8e5902435ba49671ded4bdbd81 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:58,492 INFO [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion/d3944895f133827e1ec03c51efea3e8a/.tmp/cf/88602bbfe8f442f09293f10206041ea8 2023-07-19 19:11:58,497 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689793916061.c823d9a30fdea6a180036a5e7f4928f5. completed. 2023-07-19 19:11:58,497 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689793916061.c823d9a30fdea6a180036a5e7f4928f5. 2023-07-19 19:11:58,497 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:11:58,497 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:11:58,497 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:58,497 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 19:11:58,498 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40791,1689793835731' in zk 2023-07-19 19:11:58,499 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion/d3944895f133827e1ec03c51efea3e8a/.tmp/cf/88602bbfe8f442f09293f10206041ea8 as hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion/d3944895f133827e1ec03c51efea3e8a/cf/88602bbfe8f442f09293f10206041ea8 2023-07-19 19:11:58,500 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 19:11:58,500 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:58,500 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 19:11:58,501 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:58,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:58,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:58,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:58,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:58,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:58,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:58,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:58,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:58,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:58,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:58,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:58,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:58,506 INFO [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion/d3944895f133827e1ec03c51efea3e8a/cf/88602bbfe8f442f09293f10206041ea8, entries=48, sequenceid=6, filesize=13.7 K 2023-07-19 19:11:58,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:58,507 INFO [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for d3944895f133827e1ec03c51efea3e8a in 503ms, sequenceid=6, compaction requested=false 2023-07-19 19:11:58,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40791,1689793835731': 2023-07-19 19:11:58,509 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d3944895f133827e1ec03c51efea3e8a: 2023-07-19 19:11:58,509 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40791,1689793835731' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-19 19:11:58,509 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689793916061.d3944895f133827e1ec03c51efea3e8a.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:58,509 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:11:58,509 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion/d3944895f133827e1ec03c51efea3e8a/cf/88602bbfe8f442f09293f10206041ea8] hfiles 2023-07-19 19:11:58,510 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion/d3944895f133827e1ec03c51efea3e8a/cf/88602bbfe8f442f09293f10206041ea8 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:58,524 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689793916061.d3944895f133827e1ec03c51efea3e8a. completed. 2023-07-19 19:11:58,524 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689793916061.d3944895f133827e1ec03c51efea3e8a. 2023-07-19 19:11:58,524 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:11:58,524 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:11:58,524 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:58,525 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 19:11:58,525 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45693,1689793835672' in zk 2023-07-19 19:11:58,527 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 19:11:58,527 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:58,527 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:58,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:58,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:58,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:58,527 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 19:11:58,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:58,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:58,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:58,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:58,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:58,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:58,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:58,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:58,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:58,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:58,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:58,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,45693,1689793835672': 2023-07-19 19:11:58,532 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45693,1689793835672' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-19 19:11:58,532 INFO [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-19 19:11:58,532 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 19:11:58,532 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 19:11:58,532 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:58,532 INFO [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 19:11:58,541 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:58,541 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:58,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:58,541 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:58,541 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:58,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:58,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:58,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:11:58,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:11:58,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:58,541 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:58,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:58,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:58,541 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:58,541 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:58,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:58,542 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:58,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:58,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:58,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:58,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:58,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:58,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:11:58,543 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:58,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:58,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:58,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:58,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:58,543 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:58,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:58,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:11:58,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:58,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:58,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:58,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:58,546 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:58,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:11:58,548 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:58,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:58,549 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:58,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:58,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:58,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:58,552 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:58,552 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:58,552 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:58,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:58,552 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:58,552 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:11:58,552 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:58,554 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:11:58,554 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:58,552 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:58,552 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:11:58,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:58,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:58,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:11:58,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:58,552 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:58,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:11:58,554 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:11:58,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:58,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 19:11:58,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:11:58,555 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-19 19:11:58,554 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:58,554 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:58,557 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:58,557 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:58,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:58,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:58,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:58,557 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:11:58,557 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 19:11:58,558 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:58,558 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:58,558 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:58,558 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:58,558 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:58,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:11:58,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:11:58,559 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023071945814b2beca94021af3117fe1de411dd, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230719fc46489f3f5440ca8b49b88689ee803b] mob files 2023-07-19 19:11:58,559 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023071945814b2beca94021af3117fe1de411dd 2023-07-19 19:11:58,559 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230719fc46489f3f5440ca8b49b88689ee803b 2023-07-19 19:11:58,568 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:58,568 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:58,617 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:58,650 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-19 19:11:58,651 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:58,651 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:11:58,651 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689793917947Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689793918568 (+621 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689793918568Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689793918568Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689793918583 (+15 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689793918599 (+16 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689793918650 (+51 ms) 2023-07-19 19:11:58,654 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 19:11:58,656 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 705 msec 2023-07-19 19:11:59,056 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:11:59,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 19:11:59,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 19:11:59,102 DEBUG [Listener at jenkins-hbase4.apache.org/42871] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 19:11:59,116 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32792, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 19:11:59,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40791] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-19 19:11:59,120 DEBUG [Listener at jenkins-hbase4.apache.org/42871] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 19:11:59,127 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36430, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 19:11:59,127 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45693] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-19 19:11:59,128 DEBUG [Listener at jenkins-hbase4.apache.org/42871] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 19:11:59,131 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56210, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 19:11:59,131 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46111] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-19 19:11:59,153 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 19:11:59,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:11:59,158 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 19:11:59,158 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-19 19:11:59,159 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 19:11:59,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 19:11:59,181 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/014eae3b94f4649f1000fcd090ff82ff 2023-07-19 19:11:59,183 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/014eae3b94f4649f1000fcd090ff82ff empty. 2023-07-19 19:11:59,183 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/014eae3b94f4649f1000fcd090ff82ff 2023-07-19 19:11:59,183 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8146c94d851b929df2556dffbc0b638c 2023-07-19 19:11:59,186 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8146c94d851b929df2556dffbc0b638c empty. 2023-07-19 19:11:59,186 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8146c94d851b929df2556dffbc0b638c 2023-07-19 19:11:59,186 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-19 19:11:59,217 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-19 19:11:59,219 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8146c94d851b929df2556dffbc0b638c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793919153.8146c94d851b929df2556dffbc0b638c.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp 2023-07-19 19:11:59,219 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 014eae3b94f4649f1000fcd090ff82ff, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919153.014eae3b94f4649f1000fcd090ff82ff.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp 2023-07-19 19:11:59,235 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793919153.8146c94d851b929df2556dffbc0b638c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:11:59,235 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 8146c94d851b929df2556dffbc0b638c, disabling compactions & flushes 2023-07-19 19:11:59,235 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793919153.8146c94d851b929df2556dffbc0b638c. 2023-07-19 19:11:59,235 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793919153.8146c94d851b929df2556dffbc0b638c. 2023-07-19 19:11:59,235 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793919153.8146c94d851b929df2556dffbc0b638c. after waiting 0 ms 2023-07-19 19:11:59,235 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793919153.8146c94d851b929df2556dffbc0b638c. 2023-07-19 19:11:59,235 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793919153.8146c94d851b929df2556dffbc0b638c. 2023-07-19 19:11:59,235 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 8146c94d851b929df2556dffbc0b638c: 2023-07-19 19:11:59,241 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919153.014eae3b94f4649f1000fcd090ff82ff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:11:59,241 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 014eae3b94f4649f1000fcd090ff82ff, disabling compactions & flushes 2023-07-19 19:11:59,241 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919153.014eae3b94f4649f1000fcd090ff82ff. 2023-07-19 19:11:59,241 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919153.014eae3b94f4649f1000fcd090ff82ff. 2023-07-19 19:11:59,241 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919153.014eae3b94f4649f1000fcd090ff82ff. after waiting 0 ms 2023-07-19 19:11:59,241 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919153.014eae3b94f4649f1000fcd090ff82ff. 2023-07-19 19:11:59,241 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919153.014eae3b94f4649f1000fcd090ff82ff. 2023-07-19 19:11:59,241 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 014eae3b94f4649f1000fcd090ff82ff: 2023-07-19 19:11:59,243 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 19:11:59,244 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793919153.8146c94d851b929df2556dffbc0b638c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689793919244"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793919244"}]},"ts":"1689793919244"} 2023-07-19 19:11:59,244 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919153.014eae3b94f4649f1000fcd090ff82ff.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689793919244"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793919244"}]},"ts":"1689793919244"} 2023-07-19 19:11:59,247 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 19:11:59,247 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 19:11:59,247 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793919247"}]},"ts":"1689793919247"} 2023-07-19 19:11:59,249 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-19 19:11:59,252 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 19:11:59,253 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 19:11:59,253 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 19:11:59,253 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 19:11:59,253 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 19:11:59,254 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=014eae3b94f4649f1000fcd090ff82ff, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8146c94d851b929df2556dffbc0b638c, ASSIGN}] 2023-07-19 19:11:59,258 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8146c94d851b929df2556dffbc0b638c, ASSIGN 2023-07-19 19:11:59,258 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=014eae3b94f4649f1000fcd090ff82ff, ASSIGN 2023-07-19 19:11:59,259 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8146c94d851b929df2556dffbc0b638c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40791,1689793835731; forceNewPlan=false, retain=false 2023-07-19 19:11:59,259 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=014eae3b94f4649f1000fcd090ff82ff, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45693,1689793835672; forceNewPlan=false, retain=false 2023-07-19 19:11:59,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 19:11:59,409 INFO [jenkins-hbase4:37769] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 19:11:59,413 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=014eae3b94f4649f1000fcd090ff82ff, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:59,413 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=8146c94d851b929df2556dffbc0b638c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:59,413 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919153.014eae3b94f4649f1000fcd090ff82ff.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689793919413"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793919413"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793919413"}]},"ts":"1689793919413"} 2023-07-19 19:11:59,413 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793919153.8146c94d851b929df2556dffbc0b638c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689793919413"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793919413"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793919413"}]},"ts":"1689793919413"} 2023-07-19 19:11:59,415 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 014eae3b94f4649f1000fcd090ff82ff, server=jenkins-hbase4.apache.org,45693,1689793835672}] 2023-07-19 19:11:59,416 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 8146c94d851b929df2556dffbc0b638c, server=jenkins-hbase4.apache.org,40791,1689793835731}] 2023-07-19 19:11:59,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 19:11:59,572 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919153.014eae3b94f4649f1000fcd090ff82ff. 2023-07-19 19:11:59,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 014eae3b94f4649f1000fcd090ff82ff, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919153.014eae3b94f4649f1000fcd090ff82ff.', STARTKEY => '', ENDKEY => '2'} 2023-07-19 19:11:59,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919153.014eae3b94f4649f1000fcd090ff82ff. service=AccessControlService 2023-07-19 19:11:59,574 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:11:59,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 014eae3b94f4649f1000fcd090ff82ff 2023-07-19 19:11:59,574 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793919153.8146c94d851b929df2556dffbc0b638c. 2023-07-19 19:11:59,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8146c94d851b929df2556dffbc0b638c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793919153.8146c94d851b929df2556dffbc0b638c.', STARTKEY => '2', ENDKEY => ''} 2023-07-19 19:11:59,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793919153.8146c94d851b929df2556dffbc0b638c. service=AccessControlService 2023-07-19 19:11:59,575 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:11:59,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 8146c94d851b929df2556dffbc0b638c 2023-07-19 19:11:59,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793919153.8146c94d851b929df2556dffbc0b638c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:11:59,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8146c94d851b929df2556dffbc0b638c 2023-07-19 19:11:59,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8146c94d851b929df2556dffbc0b638c 2023-07-19 19:11:59,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919153.014eae3b94f4649f1000fcd090ff82ff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:11:59,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 014eae3b94f4649f1000fcd090ff82ff 2023-07-19 19:11:59,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 014eae3b94f4649f1000fcd090ff82ff 2023-07-19 19:11:59,583 INFO [StoreOpener-8146c94d851b929df2556dffbc0b638c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8146c94d851b929df2556dffbc0b638c 2023-07-19 19:11:59,589 INFO [StoreOpener-014eae3b94f4649f1000fcd090ff82ff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 014eae3b94f4649f1000fcd090ff82ff 2023-07-19 19:11:59,590 DEBUG [StoreOpener-8146c94d851b929df2556dffbc0b638c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8146c94d851b929df2556dffbc0b638c/cf 2023-07-19 19:11:59,590 DEBUG [StoreOpener-8146c94d851b929df2556dffbc0b638c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8146c94d851b929df2556dffbc0b638c/cf 2023-07-19 19:11:59,590 INFO [StoreOpener-8146c94d851b929df2556dffbc0b638c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8146c94d851b929df2556dffbc0b638c columnFamilyName cf 2023-07-19 19:11:59,591 DEBUG [StoreOpener-014eae3b94f4649f1000fcd090ff82ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/014eae3b94f4649f1000fcd090ff82ff/cf 2023-07-19 19:11:59,591 INFO [StoreOpener-8146c94d851b929df2556dffbc0b638c-1] regionserver.HStore(310): Store=8146c94d851b929df2556dffbc0b638c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:11:59,591 DEBUG [StoreOpener-014eae3b94f4649f1000fcd090ff82ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/014eae3b94f4649f1000fcd090ff82ff/cf 2023-07-19 19:11:59,592 INFO [StoreOpener-014eae3b94f4649f1000fcd090ff82ff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 014eae3b94f4649f1000fcd090ff82ff columnFamilyName cf 2023-07-19 19:11:59,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8146c94d851b929df2556dffbc0b638c 2023-07-19 19:11:59,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8146c94d851b929df2556dffbc0b638c 2023-07-19 19:11:59,594 INFO [StoreOpener-014eae3b94f4649f1000fcd090ff82ff-1] regionserver.HStore(310): Store=014eae3b94f4649f1000fcd090ff82ff/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:11:59,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/014eae3b94f4649f1000fcd090ff82ff 2023-07-19 19:11:59,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/014eae3b94f4649f1000fcd090ff82ff 2023-07-19 19:11:59,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8146c94d851b929df2556dffbc0b638c 2023-07-19 19:11:59,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8146c94d851b929df2556dffbc0b638c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 19:11:59,600 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8146c94d851b929df2556dffbc0b638c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66179495, jitterRate=-0.013848677277565002}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 19:11:59,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8146c94d851b929df2556dffbc0b638c: 2023-07-19 19:11:59,601 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793919153.8146c94d851b929df2556dffbc0b638c., pid=70, masterSystemTime=1689793919568 2023-07-19 19:11:59,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 014eae3b94f4649f1000fcd090ff82ff 2023-07-19 19:11:59,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793919153.8146c94d851b929df2556dffbc0b638c. 2023-07-19 19:11:59,603 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793919153.8146c94d851b929df2556dffbc0b638c. 2023-07-19 19:11:59,604 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=8146c94d851b929df2556dffbc0b638c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:59,604 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793919153.8146c94d851b929df2556dffbc0b638c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689793919604"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689793919604"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689793919604"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689793919604"}]},"ts":"1689793919604"} 2023-07-19 19:11:59,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/014eae3b94f4649f1000fcd090ff82ff/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 19:11:59,605 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 014eae3b94f4649f1000fcd090ff82ff; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70068809, jitterRate=0.0441066175699234}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 19:11:59,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 014eae3b94f4649f1000fcd090ff82ff: 2023-07-19 19:11:59,606 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919153.014eae3b94f4649f1000fcd090ff82ff., pid=69, masterSystemTime=1689793919568 2023-07-19 19:11:59,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919153.014eae3b94f4649f1000fcd090ff82ff. 2023-07-19 19:11:59,607 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919153.014eae3b94f4649f1000fcd090ff82ff. 2023-07-19 19:11:59,608 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=014eae3b94f4649f1000fcd090ff82ff, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:59,608 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919153.014eae3b94f4649f1000fcd090ff82ff.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689793919608"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689793919608"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689793919608"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689793919608"}]},"ts":"1689793919608"} 2023-07-19 19:11:59,608 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-19 19:11:59,608 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 8146c94d851b929df2556dffbc0b638c, server=jenkins-hbase4.apache.org,40791,1689793835731 in 190 msec 2023-07-19 19:11:59,610 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8146c94d851b929df2556dffbc0b638c, ASSIGN in 354 msec 2023-07-19 19:11:59,612 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-19 19:11:59,612 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 014eae3b94f4649f1000fcd090ff82ff, server=jenkins-hbase4.apache.org,45693,1689793835672 in 195 msec 2023-07-19 19:11:59,614 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-19 19:11:59,614 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=014eae3b94f4649f1000fcd090ff82ff, ASSIGN in 358 msec 2023-07-19 19:11:59,615 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 19:11:59,615 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793919615"}]},"ts":"1689793919615"} 2023-07-19 19:11:59,617 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-19 19:11:59,619 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 19:11:59,619 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-19 19:11:59,621 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40791] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-19 19:11:59,623 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:59,623 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:59,623 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:59,623 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:11:59,625 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 19:11:59,625 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 19:11:59,626 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 19:11:59,626 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 19:11:59,626 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 19:11:59,626 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 19:11:59,627 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 471 msec 2023-07-19 19:11:59,627 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 19:11:59,627 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 19:11:59,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 19:11:59,764 INFO [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-19 19:11:59,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 014eae3b94f4649f1000fcd090ff82ff, 8146c94d851b929df2556dffbc0b638c 2023-07-19 19:11:59,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[014eae3b94f4649f1000fcd090ff82ff, 8146c94d851b929df2556dffbc0b638c], force=true 2023-07-19 19:11:59,810 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[014eae3b94f4649f1000fcd090ff82ff, 8146c94d851b929df2556dffbc0b638c], force=true 2023-07-19 19:11:59,810 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[014eae3b94f4649f1000fcd090ff82ff, 8146c94d851b929df2556dffbc0b638c], force=true 2023-07-19 19:11:59,810 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[014eae3b94f4649f1000fcd090ff82ff, 8146c94d851b929df2556dffbc0b638c], force=true 2023-07-19 19:11:59,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 19:11:59,843 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=014eae3b94f4649f1000fcd090ff82ff, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8146c94d851b929df2556dffbc0b638c, UNASSIGN}] 2023-07-19 19:11:59,845 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=014eae3b94f4649f1000fcd090ff82ff, UNASSIGN 2023-07-19 19:11:59,845 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8146c94d851b929df2556dffbc0b638c, UNASSIGN 2023-07-19 19:11:59,847 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=8146c94d851b929df2556dffbc0b638c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:11:59,847 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=014eae3b94f4649f1000fcd090ff82ff, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:11:59,847 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793919153.8146c94d851b929df2556dffbc0b638c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689793919847"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793919847"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793919847"}]},"ts":"1689793919847"} 2023-07-19 19:11:59,847 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919153.014eae3b94f4649f1000fcd090ff82ff.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689793919847"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793919847"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793919847"}]},"ts":"1689793919847"} 2023-07-19 19:11:59,849 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 8146c94d851b929df2556dffbc0b638c, server=jenkins-hbase4.apache.org,40791,1689793835731}] 2023-07-19 19:11:59,850 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure 014eae3b94f4649f1000fcd090ff82ff, server=jenkins-hbase4.apache.org,45693,1689793835672}] 2023-07-19 19:11:59,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 19:12:00,001 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8146c94d851b929df2556dffbc0b638c 2023-07-19 19:12:00,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8146c94d851b929df2556dffbc0b638c, disabling compactions & flushes 2023-07-19 19:12:00,004 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793919153.8146c94d851b929df2556dffbc0b638c. 2023-07-19 19:12:00,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793919153.8146c94d851b929df2556dffbc0b638c. 2023-07-19 19:12:00,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793919153.8146c94d851b929df2556dffbc0b638c. after waiting 0 ms 2023-07-19 19:12:00,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793919153.8146c94d851b929df2556dffbc0b638c. 2023-07-19 19:12:00,004 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 8146c94d851b929df2556dffbc0b638c 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-19 19:12:00,005 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 014eae3b94f4649f1000fcd090ff82ff 2023-07-19 19:12:00,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 014eae3b94f4649f1000fcd090ff82ff, disabling compactions & flushes 2023-07-19 19:12:00,007 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919153.014eae3b94f4649f1000fcd090ff82ff. 2023-07-19 19:12:00,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919153.014eae3b94f4649f1000fcd090ff82ff. 2023-07-19 19:12:00,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919153.014eae3b94f4649f1000fcd090ff82ff. after waiting 0 ms 2023-07-19 19:12:00,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919153.014eae3b94f4649f1000fcd090ff82ff. 2023-07-19 19:12:00,007 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 014eae3b94f4649f1000fcd090ff82ff 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-19 19:12:00,033 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8146c94d851b929df2556dffbc0b638c/.tmp/cf/6b719a61a4de4683bf5c43c7aaac3f58 2023-07-19 19:12:00,036 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/014eae3b94f4649f1000fcd090ff82ff/.tmp/cf/63e5de3568f544cea94c5b28e316626c 2023-07-19 19:12:00,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8146c94d851b929df2556dffbc0b638c/.tmp/cf/6b719a61a4de4683bf5c43c7aaac3f58 as hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8146c94d851b929df2556dffbc0b638c/cf/6b719a61a4de4683bf5c43c7aaac3f58 2023-07-19 19:12:00,046 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/014eae3b94f4649f1000fcd090ff82ff/.tmp/cf/63e5de3568f544cea94c5b28e316626c as hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/014eae3b94f4649f1000fcd090ff82ff/cf/63e5de3568f544cea94c5b28e316626c 2023-07-19 19:12:00,049 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8146c94d851b929df2556dffbc0b638c/cf/6b719a61a4de4683bf5c43c7aaac3f58, entries=1, sequenceid=5, filesize=4.7 K 2023-07-19 19:12:00,050 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 8146c94d851b929df2556dffbc0b638c in 46ms, sequenceid=5, compaction requested=false 2023-07-19 19:12:00,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-19 19:12:00,059 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/014eae3b94f4649f1000fcd090ff82ff/cf/63e5de3568f544cea94c5b28e316626c, entries=1, sequenceid=5, filesize=4.7 K 2023-07-19 19:12:00,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8146c94d851b929df2556dffbc0b638c/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-19 19:12:00,060 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 014eae3b94f4649f1000fcd090ff82ff in 53ms, sequenceid=5, compaction requested=false 2023-07-19 19:12:00,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:12:00,063 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793919153.8146c94d851b929df2556dffbc0b638c. 2023-07-19 19:12:00,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8146c94d851b929df2556dffbc0b638c: 2023-07-19 19:12:00,067 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8146c94d851b929df2556dffbc0b638c 2023-07-19 19:12:00,068 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=8146c94d851b929df2556dffbc0b638c, regionState=CLOSED 2023-07-19 19:12:00,068 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793919153.8146c94d851b929df2556dffbc0b638c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689793920068"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793920068"}]},"ts":"1689793920068"} 2023-07-19 19:12:00,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/014eae3b94f4649f1000fcd090ff82ff/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-19 19:12:00,075 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-19 19:12:00,075 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 8146c94d851b929df2556dffbc0b638c, server=jenkins-hbase4.apache.org,40791,1689793835731 in 223 msec 2023-07-19 19:12:00,076 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8146c94d851b929df2556dffbc0b638c, UNASSIGN in 232 msec 2023-07-19 19:12:00,078 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:12:00,078 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919153.014eae3b94f4649f1000fcd090ff82ff. 2023-07-19 19:12:00,078 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 014eae3b94f4649f1000fcd090ff82ff: 2023-07-19 19:12:00,080 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 014eae3b94f4649f1000fcd090ff82ff 2023-07-19 19:12:00,081 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=014eae3b94f4649f1000fcd090ff82ff, regionState=CLOSED 2023-07-19 19:12:00,081 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919153.014eae3b94f4649f1000fcd090ff82ff.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689793920081"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793920081"}]},"ts":"1689793920081"} 2023-07-19 19:12:00,099 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-19 19:12:00,099 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure 014eae3b94f4649f1000fcd090ff82ff, server=jenkins-hbase4.apache.org,45693,1689793835672 in 232 msec 2023-07-19 19:12:00,102 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-19 19:12:00,102 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=014eae3b94f4649f1000fcd090ff82ff, UNASSIGN in 261 msec 2023-07-19 19:12:00,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 19:12:00,203 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dfd5fe48d2fc80a2f69a5bb7fc20b342/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-19 19:12:00,206 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919153.014eae3b94f4649f1000fcd090ff82ff.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-19 19:12:00,207 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689793919153.8146c94d851b929df2556dffbc0b638c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-19 19:12:00,207 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919154.dfd5fe48d2fc80a2f69a5bb7fc20b342.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-19 19:12:00,276 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dfd5fe48d2fc80a2f69a5bb7fc20b342, ASSIGN}] 2023-07-19 19:12:00,277 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dfd5fe48d2fc80a2f69a5bb7fc20b342, ASSIGN 2023-07-19 19:12:00,278 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dfd5fe48d2fc80a2f69a5bb7fc20b342, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,45693,1689793835672; forceNewPlan=false, retain=false 2023-07-19 19:12:00,400 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843898_0004_000001 (auth:SIMPLE) 2023-07-19 19:12:00,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 19:12:00,428 INFO [jenkins-hbase4:37769] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-19 19:12:00,430 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=dfd5fe48d2fc80a2f69a5bb7fc20b342, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:00,430 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919154.dfd5fe48d2fc80a2f69a5bb7fc20b342.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689793920430"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793920430"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793920430"}]},"ts":"1689793920430"} 2023-07-19 19:12:00,432 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure dfd5fe48d2fc80a2f69a5bb7fc20b342, server=jenkins-hbase4.apache.org,45693,1689793835672}] 2023-07-19 19:12:00,588 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919154.dfd5fe48d2fc80a2f69a5bb7fc20b342. 2023-07-19 19:12:00,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dfd5fe48d2fc80a2f69a5bb7fc20b342, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919154.dfd5fe48d2fc80a2f69a5bb7fc20b342.', STARTKEY => '', ENDKEY => ''} 2023-07-19 19:12:00,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919154.dfd5fe48d2fc80a2f69a5bb7fc20b342. service=AccessControlService 2023-07-19 19:12:00,589 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:12:00,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 dfd5fe48d2fc80a2f69a5bb7fc20b342 2023-07-19 19:12:00,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919154.dfd5fe48d2fc80a2f69a5bb7fc20b342.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:12:00,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dfd5fe48d2fc80a2f69a5bb7fc20b342 2023-07-19 19:12:00,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dfd5fe48d2fc80a2f69a5bb7fc20b342 2023-07-19 19:12:00,590 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dfd5fe48d2fc80a2f69a5bb7fc20b342/.regioninfo 2023-07-19 19:12:00,606 INFO [StoreOpener-dfd5fe48d2fc80a2f69a5bb7fc20b342-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region dfd5fe48d2fc80a2f69a5bb7fc20b342 2023-07-19 19:12:00,607 DEBUG [StoreOpener-dfd5fe48d2fc80a2f69a5bb7fc20b342-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dfd5fe48d2fc80a2f69a5bb7fc20b342/cf 2023-07-19 19:12:00,607 DEBUG [StoreOpener-dfd5fe48d2fc80a2f69a5bb7fc20b342-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dfd5fe48d2fc80a2f69a5bb7fc20b342/cf 2023-07-19 19:12:00,607 INFO [StoreOpener-dfd5fe48d2fc80a2f69a5bb7fc20b342-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dfd5fe48d2fc80a2f69a5bb7fc20b342 columnFamilyName cf 2023-07-19 19:12:00,648 DEBUG [StoreOpener-dfd5fe48d2fc80a2f69a5bb7fc20b342-1] regionserver.HStore(539): loaded hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dfd5fe48d2fc80a2f69a5bb7fc20b342/cf/63e5de3568f544cea94c5b28e316626c.014eae3b94f4649f1000fcd090ff82ff->hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/014eae3b94f4649f1000fcd090ff82ff/cf/63e5de3568f544cea94c5b28e316626c-top 2023-07-19 19:12:00,656 DEBUG [StoreOpener-dfd5fe48d2fc80a2f69a5bb7fc20b342-1] regionserver.HStore(539): loaded hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dfd5fe48d2fc80a2f69a5bb7fc20b342/cf/6b719a61a4de4683bf5c43c7aaac3f58.8146c94d851b929df2556dffbc0b638c->hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8146c94d851b929df2556dffbc0b638c/cf/6b719a61a4de4683bf5c43c7aaac3f58-top 2023-07-19 19:12:00,657 INFO [StoreOpener-dfd5fe48d2fc80a2f69a5bb7fc20b342-1] regionserver.HStore(310): Store=dfd5fe48d2fc80a2f69a5bb7fc20b342/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:12:00,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dfd5fe48d2fc80a2f69a5bb7fc20b342 2023-07-19 19:12:00,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dfd5fe48d2fc80a2f69a5bb7fc20b342 2023-07-19 19:12:00,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dfd5fe48d2fc80a2f69a5bb7fc20b342 2023-07-19 19:12:00,665 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dfd5fe48d2fc80a2f69a5bb7fc20b342; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70543282, jitterRate=0.05117681622505188}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 19:12:00,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dfd5fe48d2fc80a2f69a5bb7fc20b342: 2023-07-19 19:12:00,666 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919154.dfd5fe48d2fc80a2f69a5bb7fc20b342., pid=77, masterSystemTime=1689793920584 2023-07-19 19:12:00,667 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919154.dfd5fe48d2fc80a2f69a5bb7fc20b342.,because compaction is disabled. 2023-07-19 19:12:00,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919154.dfd5fe48d2fc80a2f69a5bb7fc20b342. 2023-07-19 19:12:00,669 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919154.dfd5fe48d2fc80a2f69a5bb7fc20b342. 2023-07-19 19:12:00,669 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=dfd5fe48d2fc80a2f69a5bb7fc20b342, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:00,670 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919154.dfd5fe48d2fc80a2f69a5bb7fc20b342.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689793920669"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689793920669"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689793920669"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689793920669"}]},"ts":"1689793920669"} 2023-07-19 19:12:00,673 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-19 19:12:00,673 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure dfd5fe48d2fc80a2f69a5bb7fc20b342, server=jenkins-hbase4.apache.org,45693,1689793835672 in 240 msec 2023-07-19 19:12:00,675 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-19 19:12:00,675 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dfd5fe48d2fc80a2f69a5bb7fc20b342, ASSIGN in 397 msec 2023-07-19 19:12:00,677 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[014eae3b94f4649f1000fcd090ff82ff, 8146c94d851b929df2556dffbc0b638c], force=true in 874 msec 2023-07-19 19:12:00,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 19:12:00,921 INFO [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-19 19:12:00,922 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-19 19:12:00,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689793920922 (current time:1689793920922). 2023-07-19 19:12:00,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 19:12:00,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(139): Connect 0x0da61f7c to 127.0.0.1:58293 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:12:00,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21a83c54, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:12:00,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:12:00,937 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47964, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:12:00,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0da61f7c to 127.0.0.1:58293 2023-07-19 19:12:00,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:12:00,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(139): Connect 0x71da1150 to 127.0.0.1:58293 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:12:00,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c3aade8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:12:00,978 DEBUG [hconnection-0x2c9072a7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:12:00,979 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47972, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:12:00,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71da1150 to 127.0.0.1:58293 2023-07-19 19:12:00,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:12:00,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-19 19:12:00,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 19:12:00,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-19 19:12:00,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-19 19:12:00,999 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-19 19:12:01,000 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689794521000 2023-07-19 19:12:01,000 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-19 19:12:01,009 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-19 19:12:01,012 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-19 19:12:01,012 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 19:12:01,012 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 19:12:01,014 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 19 msec 2023-07-19 19:12:01,016 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-19 19:12:01,017 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689794521017 2023-07-19 19:12:01,071 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,072 INFO [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-19 19:12:01,072 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:12:01,074 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-19 19:12:01,074 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-19 19:12:01,094 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,094 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,096 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:01,096 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:01,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:01,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:01,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:01,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:01,097 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:01,098 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:01,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:01,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:01,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,099 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:01,099 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 19:12:01,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,100 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,100 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,100 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-19 19:12:01,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-19 19:12:01,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-19 19:12:01,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,101 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-19 19:12:01,101 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-19 19:12:01,100 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-19 19:12:01,102 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,103 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-19 19:12:01,103 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:12:01,104 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-19 19:12:01,104 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-19 19:12:01,104 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46111,1689793835594' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-19 19:12:01,107 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,107 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,107 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:12:01,110 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,111 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-19 19:12:01,111 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:12:01,112 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-19 19:12:01,112 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-19 19:12:01,112 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45693,1689793835672' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-19 19:12:01,112 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:12:01,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-19 19:12:01,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:12:01,114 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,114 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:01,114 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 19:12:01,114 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,114 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:12:01,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:01,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:01,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:01,118 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,118 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-19 19:12:01,118 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:12:01,122 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-19 19:12:01,122 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-19 19:12:01,122 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40791,1689793835731' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-19 19:12:01,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:01,124 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:01,124 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,124 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:12:01,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:01,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:01,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:01,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:01,126 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45693,1689793835672' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-19 19:12:01,126 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d841ec9[Count = 0] remaining members to acquire global barrier 2023-07-19 19:12:01,126 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-19 19:12:01,126 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,128 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,128 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,128 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,128 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-19 19:12:01,128 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-19 19:12:01,128 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,46111,1689793835594' in zk 2023-07-19 19:12:01,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,128 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-19 19:12:01,128 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:01,129 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 19:12:01,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,129 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-19 19:12:01,129 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:12:01,129 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:12:01,129 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-19 19:12:01,129 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919154.dfd5fe48d2fc80a2f69a5bb7fc20b342. 2023-07-19 19:12:01,129 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,40791,1689793835731' in zk 2023-07-19 19:12:01,129 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919154.dfd5fe48d2fc80a2f69a5bb7fc20b342. started... 2023-07-19 19:12:01,132 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dfd5fe48d2fc80a2f69a5bb7fc20b342: 2023-07-19 19:12:01,132 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-19 19:12:01,132 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:12:01,132 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-19 19:12:01,132 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919154.dfd5fe48d2fc80a2f69a5bb7fc20b342.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,134 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:12:01,134 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-19 19:12:01,134 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:12:01,134 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-19 19:12:01,134 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dfd5fe48d2fc80a2f69a5bb7fc20b342/cf/63e5de3568f544cea94c5b28e316626c.014eae3b94f4649f1000fcd090ff82ff->hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/014eae3b94f4649f1000fcd090ff82ff/cf/63e5de3568f544cea94c5b28e316626c-top, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dfd5fe48d2fc80a2f69a5bb7fc20b342/cf/6b719a61a4de4683bf5c43c7aaac3f58.8146c94d851b929df2556dffbc0b638c->hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8146c94d851b929df2556dffbc0b638c/cf/6b719a61a4de4683bf5c43c7aaac3f58-top] hfiles 2023-07-19 19:12:01,135 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dfd5fe48d2fc80a2f69a5bb7fc20b342/cf/63e5de3568f544cea94c5b28e316626c.014eae3b94f4649f1000fcd090ff82ff for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,135 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dfd5fe48d2fc80a2f69a5bb7fc20b342/cf/6b719a61a4de4683bf5c43c7aaac3f58.8146c94d851b929df2556dffbc0b638c for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,162 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919154.dfd5fe48d2fc80a2f69a5bb7fc20b342. completed. 2023-07-19 19:12:01,163 DEBUG [rs(jenkins-hbase4.apache.org,45693,1689793835672)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919154.dfd5fe48d2fc80a2f69a5bb7fc20b342. 2023-07-19 19:12:01,163 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:12:01,163 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:12:01,163 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:01,163 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-19 19:12:01,163 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,45693,1689793835672' in zk 2023-07-19 19:12:01,171 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-19 19:12:01,171 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:01,171 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:12:01,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:01,171 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-19 19:12:01,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:01,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:01,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:01,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:01,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:01,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:01,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:01,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:01,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:01,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:01,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:01,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,45693,1689793835672': 2023-07-19 19:12:01,177 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45693,1689793835672' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-19 19:12:01,177 INFO [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-19 19:12:01,177 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 19:12:01,177 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 19:12:01,177 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,177 INFO [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 19:12:01,183 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,183 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:01,183 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:01,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:01,183 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,184 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:01,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,183 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,190 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:01,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:01,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:01,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:01,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:01,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:01,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:01,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,194 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:01,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:01,195 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:01,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,196 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:01,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:01,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:01,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:01,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:01,198 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:01,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:01,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,199 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:01,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:01,199 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:01,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:01,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:01,203 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:01,203 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:01,203 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:01,203 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:01,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:01,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:01,203 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:01,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:01,203 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:01,203 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:01,204 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:01,204 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:01,204 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:01,204 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,204 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:01,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:01,204 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:01,204 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:01,204 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,204 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:12:01,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:01,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:01,204 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:01,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:01,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:01,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:01,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:01,204 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,204 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,206 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,207 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,248 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,287 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 19:12:01,311 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-19 19:12:01,311 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,312 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,312 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689793921001Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689793921206 (+205 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689793921206Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689793921211 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689793921239 (+28 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689793921311 (+72 ms) 2023-07-19 19:12:01,323 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:12:01,323 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-19 19:12:01,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-19 19:12:01,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 19:12:01,325 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793921325 2023-07-19 19:12:01,325 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43367, tgtDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793921325, rawTgtDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793921325, srcFsUri=hdfs://localhost:43367, srcDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978 2023-07-19 19:12:01,325 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 317 msec 2023-07-19 19:12:01,361 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43367, inputRoot=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978 2023-07-19 19:12:01,361 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1578766558_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793921325, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793921325/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,361 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43367, inputRoot=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978, snapshotDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-19 19:12:01,373 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793921325/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:01,565 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:01,566 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:01,567 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:01,567 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:01,568 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:01,568 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:01,569 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:01,675 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/hadoop-7674326136497111829.jar 2023-07-19 19:12:01,676 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:01,676 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:01,677 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:01,677 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:01,678 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:01,678 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:01,679 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 19:12:01,679 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 19:12:01,680 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 19:12:01,681 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 19:12:01,681 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 19:12:01,682 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 19:12:01,682 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 19:12:01,683 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 19:12:01,683 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 19:12:01,684 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 19:12:01,685 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:12:01,685 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:12:01,686 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 19:12:01,686 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:12:01,687 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:12:01,687 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 19:12:01,688 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 19:12:02,809 WARN [Listener at jenkins-hbase4.apache.org/42871] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 19:12:02,812 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-19 19:12:02,815 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-19 19:12:02,926 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 19:12:02,927 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 19:12:03,386 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843898_0005_000001 (auth:SIMPLE) 2023-07-19 19:12:10,155 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843898_0005_000001 (auth:SIMPLE) 2023-07-19 19:12:12,455 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843898_0005_000001 (auth:SIMPLE) 2023-07-19 19:12:16,048 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843898_0005_000001 (auth:SIMPLE) 2023-07-19 19:12:17,123 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 19:12:17,135 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 19:12:17,158 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:17,158 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 19:12:17,159 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 19:12:17,159 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1054544951_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:17,159 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(367): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-19 19:12:17,159 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(367): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-19 19:12:17,160 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1054544951_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793921325/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793921325/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:17,160 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(367): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793921325/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-19 19:12:17,160 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(367): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793921325/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-19 19:12:17,170 INFO [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:17,171 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:17,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:17,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-19 19:12:17,176 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793937176"}]},"ts":"1689793937176"} 2023-07-19 19:12:17,177 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-19 19:12:17,179 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-19 19:12:17,180 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dfd5fe48d2fc80a2f69a5bb7fc20b342, UNASSIGN}] 2023-07-19 19:12:17,182 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dfd5fe48d2fc80a2f69a5bb7fc20b342, UNASSIGN 2023-07-19 19:12:17,182 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=dfd5fe48d2fc80a2f69a5bb7fc20b342, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:17,183 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919154.dfd5fe48d2fc80a2f69a5bb7fc20b342.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689793937182"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793937182"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793937182"}]},"ts":"1689793937182"} 2023-07-19 19:12:17,184 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure dfd5fe48d2fc80a2f69a5bb7fc20b342, server=jenkins-hbase4.apache.org,45693,1689793835672}] 2023-07-19 19:12:17,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-19 19:12:17,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close dfd5fe48d2fc80a2f69a5bb7fc20b342 2023-07-19 19:12:17,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dfd5fe48d2fc80a2f69a5bb7fc20b342, disabling compactions & flushes 2023-07-19 19:12:17,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919154.dfd5fe48d2fc80a2f69a5bb7fc20b342. 2023-07-19 19:12:17,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919154.dfd5fe48d2fc80a2f69a5bb7fc20b342. 2023-07-19 19:12:17,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919154.dfd5fe48d2fc80a2f69a5bb7fc20b342. after waiting 0 ms 2023-07-19 19:12:17,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919154.dfd5fe48d2fc80a2f69a5bb7fc20b342. 2023-07-19 19:12:17,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dfd5fe48d2fc80a2f69a5bb7fc20b342/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-19 19:12:17,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:12:17,359 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919154.dfd5fe48d2fc80a2f69a5bb7fc20b342. 2023-07-19 19:12:17,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dfd5fe48d2fc80a2f69a5bb7fc20b342: 2023-07-19 19:12:17,362 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed dfd5fe48d2fc80a2f69a5bb7fc20b342 2023-07-19 19:12:17,362 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=dfd5fe48d2fc80a2f69a5bb7fc20b342, regionState=CLOSED 2023-07-19 19:12:17,362 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919154.dfd5fe48d2fc80a2f69a5bb7fc20b342.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689793937362"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793937362"}]},"ts":"1689793937362"} 2023-07-19 19:12:17,366 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-19 19:12:17,366 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure dfd5fe48d2fc80a2f69a5bb7fc20b342, server=jenkins-hbase4.apache.org,45693,1689793835672 in 180 msec 2023-07-19 19:12:17,369 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-19 19:12:17,369 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dfd5fe48d2fc80a2f69a5bb7fc20b342, UNASSIGN in 186 msec 2023-07-19 19:12:17,370 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793937369"}]},"ts":"1689793937369"} 2023-07-19 19:12:17,371 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-19 19:12:17,374 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-19 19:12:17,376 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 204 msec 2023-07-19 19:12:17,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-19 19:12:17,479 INFO [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-19 19:12:17,480 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:17,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:17,484 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:17,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:17,485 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:17,487 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40791] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:17,491 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:17,491 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:17,491 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:17,491 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:17,493 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:17,493 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:17,493 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-19 19:12:17,493 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-19 19:12:17,493 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 19:12:17,494 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-19 19:12:17,493 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-19 19:12:17,493 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 19:12:17,493 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:17,494 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 19:12:17,494 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 19:12:17,494 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dfd5fe48d2fc80a2f69a5bb7fc20b342 2023-07-19 19:12:17,494 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:17,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-19 19:12:17,495 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 19:12:17,495 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 19:12:17,495 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 19:12:17,496 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 19:12:17,497 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dfd5fe48d2fc80a2f69a5bb7fc20b342/cf, FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dfd5fe48d2fc80a2f69a5bb7fc20b342/recovered.edits] 2023-07-19 19:12:17,499 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8146c94d851b929df2556dffbc0b638c 2023-07-19 19:12:17,499 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/014eae3b94f4649f1000fcd090ff82ff 2023-07-19 19:12:17,501 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8146c94d851b929df2556dffbc0b638c/cf, FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8146c94d851b929df2556dffbc0b638c/recovered.edits] 2023-07-19 19:12:17,503 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/014eae3b94f4649f1000fcd090ff82ff/cf, FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/014eae3b94f4649f1000fcd090ff82ff/recovered.edits] 2023-07-19 19:12:17,509 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dfd5fe48d2fc80a2f69a5bb7fc20b342/cf/63e5de3568f544cea94c5b28e316626c.014eae3b94f4649f1000fcd090ff82ff to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dfd5fe48d2fc80a2f69a5bb7fc20b342/cf/63e5de3568f544cea94c5b28e316626c.014eae3b94f4649f1000fcd090ff82ff 2023-07-19 19:12:17,510 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8146c94d851b929df2556dffbc0b638c/cf/6b719a61a4de4683bf5c43c7aaac3f58 to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8146c94d851b929df2556dffbc0b638c/cf/6b719a61a4de4683bf5c43c7aaac3f58 2023-07-19 19:12:17,515 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8146c94d851b929df2556dffbc0b638c/recovered.edits/8.seqid to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8146c94d851b929df2556dffbc0b638c/recovered.edits/8.seqid 2023-07-19 19:12:17,516 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8146c94d851b929df2556dffbc0b638c 2023-07-19 19:12:17,517 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dfd5fe48d2fc80a2f69a5bb7fc20b342/cf/6b719a61a4de4683bf5c43c7aaac3f58.8146c94d851b929df2556dffbc0b638c to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dfd5fe48d2fc80a2f69a5bb7fc20b342/cf/6b719a61a4de4683bf5c43c7aaac3f58.8146c94d851b929df2556dffbc0b638c 2023-07-19 19:12:17,522 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/014eae3b94f4649f1000fcd090ff82ff/cf/63e5de3568f544cea94c5b28e316626c to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/014eae3b94f4649f1000fcd090ff82ff/cf/63e5de3568f544cea94c5b28e316626c 2023-07-19 19:12:17,523 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dfd5fe48d2fc80a2f69a5bb7fc20b342/recovered.edits/12.seqid to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dfd5fe48d2fc80a2f69a5bb7fc20b342/recovered.edits/12.seqid 2023-07-19 19:12:17,524 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dfd5fe48d2fc80a2f69a5bb7fc20b342 2023-07-19 19:12:17,526 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/014eae3b94f4649f1000fcd090ff82ff/recovered.edits/8.seqid to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/014eae3b94f4649f1000fcd090ff82ff/recovered.edits/8.seqid 2023-07-19 19:12:17,527 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/014eae3b94f4649f1000fcd090ff82ff 2023-07-19 19:12:17,527 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-19 19:12:17,531 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:17,539 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-19 19:12:17,542 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-19 19:12:17,547 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:17,547 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-19 19:12:17,547 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919154.dfd5fe48d2fc80a2f69a5bb7fc20b342.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689793937547"}]},"ts":"9223372036854775807"} 2023-07-19 19:12:17,549 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-19 19:12:17,550 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => dfd5fe48d2fc80a2f69a5bb7fc20b342, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689793919154.dfd5fe48d2fc80a2f69a5bb7fc20b342.', STARTKEY => '', ENDKEY => ''}] 2023-07-19 19:12:17,550 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-19 19:12:17,550 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689793937550"}]},"ts":"9223372036854775807"} 2023-07-19 19:12:17,552 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-19 19:12:17,554 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:17,556 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 74 msec 2023-07-19 19:12:17,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-19 19:12:17,596 INFO [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-19 19:12:17,597 INFO [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:17,597 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:17,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:17,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-19 19:12:17,602 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793937602"}]},"ts":"1689793937602"} 2023-07-19 19:12:17,604 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-19 19:12:17,606 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-19 19:12:17,607 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c823d9a30fdea6a180036a5e7f4928f5, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d3944895f133827e1ec03c51efea3e8a, UNASSIGN}] 2023-07-19 19:12:17,609 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c823d9a30fdea6a180036a5e7f4928f5, UNASSIGN 2023-07-19 19:12:17,619 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d3944895f133827e1ec03c51efea3e8a, UNASSIGN 2023-07-19 19:12:17,620 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=c823d9a30fdea6a180036a5e7f4928f5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:17,620 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=d3944895f133827e1ec03c51efea3e8a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:17,620 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689793916061.d3944895f133827e1ec03c51efea3e8a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689793937620"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793937620"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793937620"}]},"ts":"1689793937620"} 2023-07-19 19:12:17,620 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689793916061.c823d9a30fdea6a180036a5e7f4928f5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689793937620"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793937620"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793937620"}]},"ts":"1689793937620"} 2023-07-19 19:12:17,627 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure d3944895f133827e1ec03c51efea3e8a, server=jenkins-hbase4.apache.org,45693,1689793835672}] 2023-07-19 19:12:17,633 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure c823d9a30fdea6a180036a5e7f4928f5, server=jenkins-hbase4.apache.org,40791,1689793835731}] 2023-07-19 19:12:17,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-19 19:12:17,780 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d3944895f133827e1ec03c51efea3e8a 2023-07-19 19:12:17,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d3944895f133827e1ec03c51efea3e8a, disabling compactions & flushes 2023-07-19 19:12:17,780 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689793916061.d3944895f133827e1ec03c51efea3e8a. 2023-07-19 19:12:17,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689793916061.d3944895f133827e1ec03c51efea3e8a. 2023-07-19 19:12:17,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689793916061.d3944895f133827e1ec03c51efea3e8a. after waiting 0 ms 2023-07-19 19:12:17,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689793916061.d3944895f133827e1ec03c51efea3e8a. 2023-07-19 19:12:17,787 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c823d9a30fdea6a180036a5e7f4928f5 2023-07-19 19:12:17,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c823d9a30fdea6a180036a5e7f4928f5, disabling compactions & flushes 2023-07-19 19:12:17,787 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689793916061.c823d9a30fdea6a180036a5e7f4928f5. 2023-07-19 19:12:17,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689793916061.c823d9a30fdea6a180036a5e7f4928f5. 2023-07-19 19:12:17,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689793916061.c823d9a30fdea6a180036a5e7f4928f5. after waiting 0 ms 2023-07-19 19:12:17,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689793916061.c823d9a30fdea6a180036a5e7f4928f5. 2023-07-19 19:12:17,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion/c823d9a30fdea6a180036a5e7f4928f5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 19:12:17,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithMergeRegion/d3944895f133827e1ec03c51efea3e8a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 19:12:17,827 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:12:17,827 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:12:17,829 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689793916061.c823d9a30fdea6a180036a5e7f4928f5. 2023-07-19 19:12:17,829 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c823d9a30fdea6a180036a5e7f4928f5: 2023-07-19 19:12:17,831 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689793916061.d3944895f133827e1ec03c51efea3e8a. 2023-07-19 19:12:17,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d3944895f133827e1ec03c51efea3e8a: 2023-07-19 19:12:17,834 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c823d9a30fdea6a180036a5e7f4928f5 2023-07-19 19:12:17,835 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=c823d9a30fdea6a180036a5e7f4928f5, regionState=CLOSED 2023-07-19 19:12:17,835 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689793916061.c823d9a30fdea6a180036a5e7f4928f5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689793937835"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793937835"}]},"ts":"1689793937835"} 2023-07-19 19:12:17,842 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d3944895f133827e1ec03c51efea3e8a 2023-07-19 19:12:17,843 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=d3944895f133827e1ec03c51efea3e8a, regionState=CLOSED 2023-07-19 19:12:17,843 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689793916061.d3944895f133827e1ec03c51efea3e8a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689793937843"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793937843"}]},"ts":"1689793937843"} 2023-07-19 19:12:17,845 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-19 19:12:17,845 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure c823d9a30fdea6a180036a5e7f4928f5, server=jenkins-hbase4.apache.org,40791,1689793835731 in 204 msec 2023-07-19 19:12:17,861 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c823d9a30fdea6a180036a5e7f4928f5, UNASSIGN in 238 msec 2023-07-19 19:12:17,863 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-19 19:12:17,863 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure d3944895f133827e1ec03c51efea3e8a, server=jenkins-hbase4.apache.org,45693,1689793835672 in 219 msec 2023-07-19 19:12:17,875 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-19 19:12:17,875 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d3944895f133827e1ec03c51efea3e8a, UNASSIGN in 256 msec 2023-07-19 19:12:17,876 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793937875"}]},"ts":"1689793937875"} 2023-07-19 19:12:17,877 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-19 19:12:17,879 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-19 19:12:17,881 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 283 msec 2023-07-19 19:12:17,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-19 19:12:17,906 INFO [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-19 19:12:17,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:17,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:17,912 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:17,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:17,913 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:17,914 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40791] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:17,917 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:17,917 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:17,918 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:17,918 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:17,918 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-19 19:12:17,918 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-19 19:12:17,918 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-19 19:12:17,919 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-19 19:12:17,920 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c823d9a30fdea6a180036a5e7f4928f5 2023-07-19 19:12:17,920 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d3944895f133827e1ec03c51efea3e8a 2023-07-19 19:12:17,921 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:17,921 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:17,921 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:17,921 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:17,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-19 19:12:17,923 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c823d9a30fdea6a180036a5e7f4928f5/cf, FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c823d9a30fdea6a180036a5e7f4928f5/recovered.edits] 2023-07-19 19:12:17,923 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:17,923 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:17,923 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:17,923 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:17,923 DEBUG [HFileArchiver-16] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d3944895f133827e1ec03c51efea3e8a/cf, FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d3944895f133827e1ec03c51efea3e8a/recovered.edits] 2023-07-19 19:12:17,930 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c823d9a30fdea6a180036a5e7f4928f5/cf/83663a8e5902435ba49671ded4bdbd81 to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/c823d9a30fdea6a180036a5e7f4928f5/cf/83663a8e5902435ba49671ded4bdbd81 2023-07-19 19:12:17,931 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d3944895f133827e1ec03c51efea3e8a/cf/88602bbfe8f442f09293f10206041ea8 to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/d3944895f133827e1ec03c51efea3e8a/cf/88602bbfe8f442f09293f10206041ea8 2023-07-19 19:12:17,944 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c823d9a30fdea6a180036a5e7f4928f5/recovered.edits/9.seqid to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/c823d9a30fdea6a180036a5e7f4928f5/recovered.edits/9.seqid 2023-07-19 19:12:17,944 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d3944895f133827e1ec03c51efea3e8a/recovered.edits/9.seqid to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/d3944895f133827e1ec03c51efea3e8a/recovered.edits/9.seqid 2023-07-19 19:12:17,945 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c823d9a30fdea6a180036a5e7f4928f5 2023-07-19 19:12:17,945 DEBUG [HFileArchiver-16] backup.HFileArchiver(596): Deleted hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d3944895f133827e1ec03c51efea3e8a 2023-07-19 19:12:17,946 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-19 19:12:17,947 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-19 19:12:17,948 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-19 19:12:17,952 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023071945814b2beca94021af3117fe1de411dd to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023071945814b2beca94021af3117fe1de411dd 2023-07-19 19:12:17,954 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230719fc46489f3f5440ca8b49b88689ee803b to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230719fc46489f3f5440ca8b49b88689ee803b 2023-07-19 19:12:17,957 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-19 19:12:17,962 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:17,965 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-19 19:12:17,981 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-19 19:12:17,991 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:17,991 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-19 19:12:17,992 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689793916061.c823d9a30fdea6a180036a5e7f4928f5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689793937992"}]},"ts":"9223372036854775807"} 2023-07-19 19:12:17,992 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689793916061.d3944895f133827e1ec03c51efea3e8a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689793937992"}]},"ts":"9223372036854775807"} 2023-07-19 19:12:17,995 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 19:12:17,995 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c823d9a30fdea6a180036a5e7f4928f5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689793916061.c823d9a30fdea6a180036a5e7f4928f5.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => d3944895f133827e1ec03c51efea3e8a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689793916061.d3944895f133827e1ec03c51efea3e8a.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 19:12:17,995 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-19 19:12:17,995 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689793937995"}]},"ts":"9223372036854775807"} 2023-07-19 19:12:17,997 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-19 19:12:18,003 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:18,006 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 96 msec 2023-07-19 19:12:18,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-19 19:12:18,024 INFO [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-19 19:12:18,036 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-19 19:12:18,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:18,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-19 19:12:18,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 19:12:18,045 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-19 19:12:18,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 19:12:18,083 INFO [Listener at jenkins-hbase4.apache.org/42871] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=760 (was 746) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4224 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1054544951_17 at /127.0.0.1:53592 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1164f60d-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2090978155_1 at /127.0.0.1:56060 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1164f60d-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1054544951_17 at /127.0.0.1:56086 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1164f60d-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1164f60d-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2090978155_1 at /127.0.0.1:52716 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1054544951_17 at /127.0.0.1:52726 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1164f60d-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1164f60d-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (274932937) connection to jenkins-hbase4.apache.org/172.31.14.131:38175 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=905 (was 895) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=532 (was 381) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 184), AvailableMemoryMB=2763 (was 2608) - AvailableMemoryMB LEAK? - 2023-07-19 19:12:18,083 WARN [Listener at jenkins-hbase4.apache.org/42871] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-19 19:12:18,109 INFO [Listener at jenkins-hbase4.apache.org/42871] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=760, OpenFileDescriptor=905, MaxFileDescriptor=60000, SystemLoadAverage=532, ProcessCount=181, AvailableMemoryMB=2761 2023-07-19 19:12:18,109 WARN [Listener at jenkins-hbase4.apache.org/42871] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-19 19:12:18,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-19 19:12:18,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 19:12:18,120 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 19:12:18,121 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-19 19:12:18,121 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 19:12:18,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 19:12:18,124 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testEmptyExportFileSystemState/978ea6dc3c9c1062758e11ac6e3f1554 2023-07-19 19:12:18,124 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testEmptyExportFileSystemState/e2488a65d64d016aefaa39e1444aa92d 2023-07-19 19:12:18,125 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testEmptyExportFileSystemState/978ea6dc3c9c1062758e11ac6e3f1554 empty. 2023-07-19 19:12:18,125 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testEmptyExportFileSystemState/e2488a65d64d016aefaa39e1444aa92d empty. 2023-07-19 19:12:18,126 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testEmptyExportFileSystemState/978ea6dc3c9c1062758e11ac6e3f1554 2023-07-19 19:12:18,126 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testEmptyExportFileSystemState/e2488a65d64d016aefaa39e1444aa92d 2023-07-19 19:12:18,126 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-19 19:12:18,166 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-19 19:12:18,167 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 978ea6dc3c9c1062758e11ac6e3f1554, NAME => 'testtb-testEmptyExportFileSystemState,,1689793938111.978ea6dc3c9c1062758e11ac6e3f1554.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp 2023-07-19 19:12:18,168 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => e2488a65d64d016aefaa39e1444aa92d, NAME => 'testtb-testEmptyExportFileSystemState,1,1689793938111.e2488a65d64d016aefaa39e1444aa92d.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp 2023-07-19 19:12:18,223 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689793938111.e2488a65d64d016aefaa39e1444aa92d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:12:18,223 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing e2488a65d64d016aefaa39e1444aa92d, disabling compactions & flushes 2023-07-19 19:12:18,223 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689793938111.e2488a65d64d016aefaa39e1444aa92d. 2023-07-19 19:12:18,223 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689793938111.e2488a65d64d016aefaa39e1444aa92d. 2023-07-19 19:12:18,223 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689793938111.e2488a65d64d016aefaa39e1444aa92d. after waiting 0 ms 2023-07-19 19:12:18,223 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689793938111.e2488a65d64d016aefaa39e1444aa92d. 2023-07-19 19:12:18,223 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689793938111.e2488a65d64d016aefaa39e1444aa92d. 2023-07-19 19:12:18,224 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for e2488a65d64d016aefaa39e1444aa92d: 2023-07-19 19:12:18,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 19:12:18,225 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689793938111.978ea6dc3c9c1062758e11ac6e3f1554.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:12:18,225 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 978ea6dc3c9c1062758e11ac6e3f1554, disabling compactions & flushes 2023-07-19 19:12:18,225 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689793938111.978ea6dc3c9c1062758e11ac6e3f1554. 2023-07-19 19:12:18,225 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689793938111.978ea6dc3c9c1062758e11ac6e3f1554. 2023-07-19 19:12:18,225 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689793938111.978ea6dc3c9c1062758e11ac6e3f1554. after waiting 0 ms 2023-07-19 19:12:18,226 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689793938111.978ea6dc3c9c1062758e11ac6e3f1554. 2023-07-19 19:12:18,226 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689793938111.978ea6dc3c9c1062758e11ac6e3f1554. 2023-07-19 19:12:18,226 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 978ea6dc3c9c1062758e11ac6e3f1554: 2023-07-19 19:12:18,228 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 19:12:18,230 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689793938111.e2488a65d64d016aefaa39e1444aa92d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689793938229"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793938229"}]},"ts":"1689793938229"} 2023-07-19 19:12:18,230 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689793938111.978ea6dc3c9c1062758e11ac6e3f1554.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689793938229"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793938229"}]},"ts":"1689793938229"} 2023-07-19 19:12:18,234 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 19:12:18,235 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 19:12:18,235 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793938235"}]},"ts":"1689793938235"} 2023-07-19 19:12:18,238 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-19 19:12:18,241 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 19:12:18,243 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 19:12:18,243 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 19:12:18,243 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 19:12:18,243 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 19:12:18,243 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=978ea6dc3c9c1062758e11ac6e3f1554, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e2488a65d64d016aefaa39e1444aa92d, ASSIGN}] 2023-07-19 19:12:18,246 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e2488a65d64d016aefaa39e1444aa92d, ASSIGN 2023-07-19 19:12:18,246 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=978ea6dc3c9c1062758e11ac6e3f1554, ASSIGN 2023-07-19 19:12:18,248 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e2488a65d64d016aefaa39e1444aa92d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46111,1689793835594; forceNewPlan=false, retain=false 2023-07-19 19:12:18,248 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=978ea6dc3c9c1062758e11ac6e3f1554, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40791,1689793835731; forceNewPlan=false, retain=false 2023-07-19 19:12:18,398 INFO [jenkins-hbase4:37769] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 19:12:18,403 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=978ea6dc3c9c1062758e11ac6e3f1554, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:18,403 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=e2488a65d64d016aefaa39e1444aa92d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:18,403 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689793938111.978ea6dc3c9c1062758e11ac6e3f1554.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689793938403"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793938403"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793938403"}]},"ts":"1689793938403"} 2023-07-19 19:12:18,403 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689793938111.e2488a65d64d016aefaa39e1444aa92d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689793938403"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793938403"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793938403"}]},"ts":"1689793938403"} 2023-07-19 19:12:18,405 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 978ea6dc3c9c1062758e11ac6e3f1554, server=jenkins-hbase4.apache.org,40791,1689793835731}] 2023-07-19 19:12:18,406 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure e2488a65d64d016aefaa39e1444aa92d, server=jenkins-hbase4.apache.org,46111,1689793835594}] 2023-07-19 19:12:18,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 19:12:18,566 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689793938111.978ea6dc3c9c1062758e11ac6e3f1554. 2023-07-19 19:12:18,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 978ea6dc3c9c1062758e11ac6e3f1554, NAME => 'testtb-testEmptyExportFileSystemState,,1689793938111.978ea6dc3c9c1062758e11ac6e3f1554.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 19:12:18,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689793938111.978ea6dc3c9c1062758e11ac6e3f1554. service=AccessControlService 2023-07-19 19:12:18,566 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689793938111.e2488a65d64d016aefaa39e1444aa92d. 2023-07-19 19:12:18,566 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:12:18,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e2488a65d64d016aefaa39e1444aa92d, NAME => 'testtb-testEmptyExportFileSystemState,1,1689793938111.e2488a65d64d016aefaa39e1444aa92d.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 19:12:18,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 978ea6dc3c9c1062758e11ac6e3f1554 2023-07-19 19:12:18,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689793938111.978ea6dc3c9c1062758e11ac6e3f1554.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:12:18,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 978ea6dc3c9c1062758e11ac6e3f1554 2023-07-19 19:12:18,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 978ea6dc3c9c1062758e11ac6e3f1554 2023-07-19 19:12:18,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689793938111.e2488a65d64d016aefaa39e1444aa92d. service=AccessControlService 2023-07-19 19:12:18,567 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:12:18,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState e2488a65d64d016aefaa39e1444aa92d 2023-07-19 19:12:18,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689793938111.e2488a65d64d016aefaa39e1444aa92d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:12:18,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e2488a65d64d016aefaa39e1444aa92d 2023-07-19 19:12:18,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e2488a65d64d016aefaa39e1444aa92d 2023-07-19 19:12:18,574 INFO [StoreOpener-978ea6dc3c9c1062758e11ac6e3f1554-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 978ea6dc3c9c1062758e11ac6e3f1554 2023-07-19 19:12:18,575 INFO [StoreOpener-e2488a65d64d016aefaa39e1444aa92d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e2488a65d64d016aefaa39e1444aa92d 2023-07-19 19:12:18,576 DEBUG [StoreOpener-978ea6dc3c9c1062758e11ac6e3f1554-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testEmptyExportFileSystemState/978ea6dc3c9c1062758e11ac6e3f1554/cf 2023-07-19 19:12:18,576 DEBUG [StoreOpener-978ea6dc3c9c1062758e11ac6e3f1554-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testEmptyExportFileSystemState/978ea6dc3c9c1062758e11ac6e3f1554/cf 2023-07-19 19:12:18,577 INFO [StoreOpener-978ea6dc3c9c1062758e11ac6e3f1554-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 978ea6dc3c9c1062758e11ac6e3f1554 columnFamilyName cf 2023-07-19 19:12:18,578 DEBUG [StoreOpener-e2488a65d64d016aefaa39e1444aa92d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testEmptyExportFileSystemState/e2488a65d64d016aefaa39e1444aa92d/cf 2023-07-19 19:12:18,578 DEBUG [StoreOpener-e2488a65d64d016aefaa39e1444aa92d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testEmptyExportFileSystemState/e2488a65d64d016aefaa39e1444aa92d/cf 2023-07-19 19:12:18,578 INFO [StoreOpener-e2488a65d64d016aefaa39e1444aa92d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e2488a65d64d016aefaa39e1444aa92d columnFamilyName cf 2023-07-19 19:12:18,578 INFO [StoreOpener-978ea6dc3c9c1062758e11ac6e3f1554-1] regionserver.HStore(310): Store=978ea6dc3c9c1062758e11ac6e3f1554/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:12:18,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testEmptyExportFileSystemState/978ea6dc3c9c1062758e11ac6e3f1554 2023-07-19 19:12:18,580 INFO [StoreOpener-e2488a65d64d016aefaa39e1444aa92d-1] regionserver.HStore(310): Store=e2488a65d64d016aefaa39e1444aa92d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:12:18,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testEmptyExportFileSystemState/978ea6dc3c9c1062758e11ac6e3f1554 2023-07-19 19:12:18,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testEmptyExportFileSystemState/e2488a65d64d016aefaa39e1444aa92d 2023-07-19 19:12:18,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testEmptyExportFileSystemState/e2488a65d64d016aefaa39e1444aa92d 2023-07-19 19:12:18,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 978ea6dc3c9c1062758e11ac6e3f1554 2023-07-19 19:12:18,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e2488a65d64d016aefaa39e1444aa92d 2023-07-19 19:12:18,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testEmptyExportFileSystemState/978ea6dc3c9c1062758e11ac6e3f1554/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 19:12:18,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testEmptyExportFileSystemState/e2488a65d64d016aefaa39e1444aa92d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 19:12:18,591 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 978ea6dc3c9c1062758e11ac6e3f1554; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72209792, jitterRate=0.07600975036621094}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 19:12:18,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 978ea6dc3c9c1062758e11ac6e3f1554: 2023-07-19 19:12:18,592 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e2488a65d64d016aefaa39e1444aa92d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64261874, jitterRate=-0.04242345690727234}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 19:12:18,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e2488a65d64d016aefaa39e1444aa92d: 2023-07-19 19:12:18,592 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689793938111.978ea6dc3c9c1062758e11ac6e3f1554., pid=93, masterSystemTime=1689793938559 2023-07-19 19:12:18,593 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689793938111.e2488a65d64d016aefaa39e1444aa92d., pid=94, masterSystemTime=1689793938559 2023-07-19 19:12:18,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689793938111.978ea6dc3c9c1062758e11ac6e3f1554. 2023-07-19 19:12:18,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689793938111.978ea6dc3c9c1062758e11ac6e3f1554. 2023-07-19 19:12:18,594 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=978ea6dc3c9c1062758e11ac6e3f1554, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:18,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689793938111.e2488a65d64d016aefaa39e1444aa92d. 2023-07-19 19:12:18,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689793938111.e2488a65d64d016aefaa39e1444aa92d. 2023-07-19 19:12:18,595 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689793938111.978ea6dc3c9c1062758e11ac6e3f1554.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689793938594"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689793938594"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689793938594"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689793938594"}]},"ts":"1689793938594"} 2023-07-19 19:12:18,595 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=e2488a65d64d016aefaa39e1444aa92d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:18,595 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689793938111.e2488a65d64d016aefaa39e1444aa92d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689793938595"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689793938595"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689793938595"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689793938595"}]},"ts":"1689793938595"} 2023-07-19 19:12:18,598 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-19 19:12:18,598 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 978ea6dc3c9c1062758e11ac6e3f1554, server=jenkins-hbase4.apache.org,40791,1689793835731 in 191 msec 2023-07-19 19:12:18,599 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-19 19:12:18,599 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure e2488a65d64d016aefaa39e1444aa92d, server=jenkins-hbase4.apache.org,46111,1689793835594 in 191 msec 2023-07-19 19:12:18,599 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=978ea6dc3c9c1062758e11ac6e3f1554, ASSIGN in 355 msec 2023-07-19 19:12:18,600 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-19 19:12:18,600 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e2488a65d64d016aefaa39e1444aa92d, ASSIGN in 356 msec 2023-07-19 19:12:18,601 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 19:12:18,601 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793938601"}]},"ts":"1689793938601"} 2023-07-19 19:12:18,602 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-19 19:12:18,604 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 19:12:18,605 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-19 19:12:18,606 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40791] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 19:12:18,608 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:18,608 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:18,608 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:18,608 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:18,611 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 19:12:18,611 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 19:12:18,611 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 19:12:18,611 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 19:12:18,613 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 499 msec 2023-07-19 19:12:18,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 19:12:18,729 INFO [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-19 19:12:18,731 DEBUG [Listener at jenkins-hbase4.apache.org/42871] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-19 19:12:18,732 DEBUG [Listener at jenkins-hbase4.apache.org/42871] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689793938111.978ea6dc3c9c1062758e11ac6e3f1554. 2023-07-19 19:12:18,733 INFO [Listener at jenkins-hbase4.apache.org/42871] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 19:12:18,750 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 19:12:18,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689793938750 (current time:1689793938750). 2023-07-19 19:12:18,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 19:12:18,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(139): Connect 0x7207ad9e to 127.0.0.1:58293 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:12:18,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64966965, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:12:18,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:12:18,772 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48346, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:12:18,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7207ad9e to 127.0.0.1:58293 2023-07-19 19:12:18,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:12:18,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(139): Connect 0x275ac6ca to 127.0.0.1:58293 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:12:18,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68fef4e2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:12:18,882 DEBUG [hconnection-0x3f7475d9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:12:18,886 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48362, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:12:18,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x275ac6ca to 127.0.0.1:58293 2023-07-19 19:12:18,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:12:18,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 19:12:18,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 19:12:18,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 19:12:18,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 19:12:18,911 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 19:12:18,912 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689794538912 2023-07-19 19:12:18,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 19:12:18,912 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-19 19:12:18,914 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 19:12:18,914 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 19:12:18,916 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 19:12:18,916 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 19:12:18,917 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-19 19:12:18,921 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 19:12:18,922 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689794538922 2023-07-19 19:12:18,943 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:18,943 INFO [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-19 19:12:18,943 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:12:18,944 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-19 19:12:18,945 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-19 19:12:18,945 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:18,945 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:18,950 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:18,950 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:18,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:18,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:18,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:18,951 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:18,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:18,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:18,951 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:18,951 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:18,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:18,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-19 19:12:18,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:18,952 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 19:12:18,952 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:18,952 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:18,952 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:18,953 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:18,953 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 19:12:18,953 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:12:18,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-19 19:12:18,955 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:18,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:18,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:18,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:18,955 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 19:12:18,955 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 19:12:18,955 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 19:12:18,955 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 19:12:18,955 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40791,1689793835731' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 19:12:18,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:18,956 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:18,957 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:18,957 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:18,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:18,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:18,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:18,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-19 19:12:18,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:18,958 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 19:12:18,958 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:18,959 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 19:12:18,959 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:12:18,959 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:18,959 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:12:18,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:18,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:18,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:18,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:18,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:18,960 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40791,1689793835731' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 19:12:18,960 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@773b9802[Count = 1] remaining members to acquire global barrier 2023-07-19 19:12:18,963 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:18,968 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 19:12:18,968 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 19:12:18,968 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45693,1689793835672' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 19:12:18,970 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 19:12:18,971 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:12:18,972 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 19:12:18,972 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 19:12:18,972 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46111,1689793835594' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 19:12:18,973 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:18,973 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:18,973 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:12:18,974 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:18,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:18,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:18,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:18,975 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:18,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:18,976 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:18,976 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:12:18,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:18,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:18,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:18,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:18,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:18,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:18,982 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46111,1689793835594' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 19:12:18,983 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@773b9802[Count = 0] remaining members to acquire global barrier 2023-07-19 19:12:18,983 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 19:12:18,983 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:18,984 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:18,984 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:18,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:18,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:18,984 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:18,984 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 19:12:18,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:18,985 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:18,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:18,985 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:12:18,985 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:12:18,985 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689793938111.978ea6dc3c9c1062758e11ac6e3f1554. 2023-07-19 19:12:18,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:18,985 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689793938111.978ea6dc3c9c1062758e11ac6e3f1554. started... 2023-07-19 19:12:18,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:18,985 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:18,985 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 19:12:18,985 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 19:12:18,985 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 19:12:18,985 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 19:12:18,985 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45693,1689793835672' in zk 2023-07-19 19:12:18,985 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 978ea6dc3c9c1062758e11ac6e3f1554: 2023-07-19 19:12:18,986 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689793938111.978ea6dc3c9c1062758e11ac6e3f1554.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:18,986 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:12:18,986 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 19:12:18,986 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:12:18,986 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:12:18,987 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689793938111.e2488a65d64d016aefaa39e1444aa92d. 2023-07-19 19:12:18,987 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689793938111.e2488a65d64d016aefaa39e1444aa92d. started... 2023-07-19 19:12:18,989 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e2488a65d64d016aefaa39e1444aa92d: 2023-07-19 19:12:18,989 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 19:12:18,989 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:12:18,989 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 19:12:18,991 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689793938111.e2488a65d64d016aefaa39e1444aa92d.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:18,991 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:12:18,991 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 19:12:19,014 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:12:19,016 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689793938111.e2488a65d64d016aefaa39e1444aa92d. completed. 2023-07-19 19:12:19,016 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689793938111.e2488a65d64d016aefaa39e1444aa92d. 2023-07-19 19:12:19,016 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:12:19,016 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:12:19,016 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:19,016 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 19:12:19,016 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46111,1689793835594' in zk 2023-07-19 19:12:19,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 19:12:19,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:12:19,017 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 19:12:19,020 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 19:12:19,020 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:12:19,020 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:19,020 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 19:12:19,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:19,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:19,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:19,023 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689793938111.978ea6dc3c9c1062758e11ac6e3f1554. completed. 2023-07-19 19:12:19,023 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689793938111.978ea6dc3c9c1062758e11ac6e3f1554. 2023-07-19 19:12:19,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:19,023 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:12:19,023 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:12:19,023 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:19,023 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 19:12:19,023 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40791,1689793835731' in zk 2023-07-19 19:12:19,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:19,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,025 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:19,025 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 19:12:19,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:19,025 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:12:19,025 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 19:12:19,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:19,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:19,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:19,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:19,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:19,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:19,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,46111,1689793835594': 2023-07-19 19:12:19,030 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46111,1689793835594' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 19:12:19,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:19,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:19,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:19,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:19,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:19,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:19,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:19,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:19,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:19,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:19,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:19,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:19,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40791,1689793835731': 2023-07-19 19:12:19,038 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40791,1689793835731' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 19:12:19,038 INFO [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-19 19:12:19,038 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 19:12:19,038 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 19:12:19,038 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,038 INFO [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 19:12:19,040 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,040 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:19,040 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,040 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,040 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:19,040 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:19,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,040 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:19,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:19,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:19,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:19,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:19,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:19,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:19,043 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:19,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:19,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,044 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:19,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,044 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:19,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:19,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:19,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:19,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:19,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,046 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:19,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:19,047 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:19,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:19,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:19,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:19,047 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:19,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:19,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,050 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:19,050 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:19,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:19,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:19,050 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:19,051 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:19,050 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:19,051 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:19,051 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:19,051 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:19,051 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:19,051 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:19,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:19,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:19,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:19,051 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:19,051 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:12:19,051 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:19,051 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-19 19:12:19,053 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:19,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,053 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:19,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 19:12:19,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:19,053 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:19,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:19,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:19,053 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:19,053 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,054 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,054 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-19 19:12:19,089 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,090 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,147 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,201 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-19 19:12:19,201 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,202 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,202 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689793938912Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689793939089 (+177 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689793939089Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689793939090 (+1 ms)Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689793939093 (+3 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689793939140 (+47 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689793939201 (+61 ms) 2023-07-19 19:12:19,207 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 19:12:19,209 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 293 msec 2023-07-19 19:12:19,217 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:12:19,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 19:12:19,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 19:12:19,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40791] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689793938111.978ea6dc3c9c1062758e11ac6e3f1554. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 19:12:19,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46111] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689793938111.e2488a65d64d016aefaa39e1444aa92d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 19:12:19,236 DEBUG [Listener at jenkins-hbase4.apache.org/42871] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-19 19:12:19,236 DEBUG [Listener at jenkins-hbase4.apache.org/42871] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689793938111.978ea6dc3c9c1062758e11ac6e3f1554. 2023-07-19 19:12:19,236 INFO [Listener at jenkins-hbase4.apache.org/42871] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 19:12:19,253 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 19:12:19,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689793939253 (current time:1689793939253). 2023-07-19 19:12:19,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 19:12:19,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(139): Connect 0x420c8eab to 127.0.0.1:58293 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:12:19,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ecaf18e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:12:19,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:12:19,277 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48376, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:12:19,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x420c8eab to 127.0.0.1:58293 2023-07-19 19:12:19,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:12:19,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(139): Connect 0x40b74fd8 to 127.0.0.1:58293 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:12:19,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6668f8b3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:12:19,293 DEBUG [hconnection-0x6fa73371-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:12:19,297 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48388, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:12:19,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x40b74fd8 to 127.0.0.1:58293 2023-07-19 19:12:19,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:12:19,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 19:12:19,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 19:12:19,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 19:12:19,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 19:12:19,308 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 19:12:19,309 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689794539309 2023-07-19 19:12:19,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 19:12:19,309 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-19 19:12:19,311 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 19:12:19,311 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 19:12:19,312 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 19:12:19,313 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 19:12:19,315 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-19 19:12:19,316 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 19:12:19,316 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689794539316 2023-07-19 19:12:19,328 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,328 INFO [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-19 19:12:19,328 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:12:19,329 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-19 19:12:19,329 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-19 19:12:19,330 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,330 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,332 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:19,332 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:19,332 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:19,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:19,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:19,332 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:19,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:19,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:19,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:19,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:19,333 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:19,333 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:19,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,334 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,334 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:19,334 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 19:12:19,334 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-19 19:12:19,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-19 19:12:19,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,335 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 19:12:19,335 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 19:12:19,335 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,335 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,335 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,335 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 19:12:19,335 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:12:19,335 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 19:12:19,337 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:12:19,337 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 19:12:19,338 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 19:12:19,339 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 19:12:19,338 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 19:12:19,339 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45693,1689793835672' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 19:12:19,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-19 19:12:19,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,339 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46111,1689793835594' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 19:12:19,339 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 19:12:19,339 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,339 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 19:12:19,339 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:12:19,344 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 19:12:19,344 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 19:12:19,344 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40791,1689793835731' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 19:12:19,344 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,345 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,345 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,345 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:12:19,345 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:19,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:19,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:19,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:19,346 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:19,346 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,346 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:12:19,346 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:19,346 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:19,346 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:12:19,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:19,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:19,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:19,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:19,348 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46111,1689793835594' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 19:12:19,348 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f11a960[Count = 1] remaining members to acquire global barrier 2023-07-19 19:12:19,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:19,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:19,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:19,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:19,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:19,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:19,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:19,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:19,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:19,351 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40791,1689793835731' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 19:12:19,351 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f11a960[Count = 0] remaining members to acquire global barrier 2023-07-19 19:12:19,351 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 19:12:19,351 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,356 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,356 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,356 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,357 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 19:12:19,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,357 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:19,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,357 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:12:19,357 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:12:19,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,357 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689793938111.978ea6dc3c9c1062758e11ac6e3f1554. 2023-07-19 19:12:19,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,357 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689793938111.978ea6dc3c9c1062758e11ac6e3f1554. started... 2023-07-19 19:12:19,357 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:19,357 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 19:12:19,357 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 19:12:19,357 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 19:12:19,357 INFO [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 978ea6dc3c9c1062758e11ac6e3f1554 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-19 19:12:19,358 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:12:19,358 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:12:19,358 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689793938111.e2488a65d64d016aefaa39e1444aa92d. 2023-07-19 19:12:19,357 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 19:12:19,358 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689793938111.e2488a65d64d016aefaa39e1444aa92d. started... 2023-07-19 19:12:19,358 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45693,1689793835672' in zk 2023-07-19 19:12:19,358 INFO [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e2488a65d64d016aefaa39e1444aa92d 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-19 19:12:19,360 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 19:12:19,361 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:12:19,361 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 19:12:19,389 INFO [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230719e89c9704720f4ebfb9ac9bc7e2544158 to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230719e89c9704720f4ebfb9ac9bc7e2544158 2023-07-19 19:12:19,389 INFO [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307196afc3feeaa474c73833097d80c909e20 to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307196afc3feeaa474c73833097d80c909e20 2023-07-19 19:12:19,400 INFO [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testEmptyExportFileSystemState/978ea6dc3c9c1062758e11ac6e3f1554/.tmp/cf/2cdd2ea323b242ee84ff91c75933a8d2 2023-07-19 19:12:19,400 INFO [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testEmptyExportFileSystemState/e2488a65d64d016aefaa39e1444aa92d/.tmp/cf/6f034245729f42bc8bbec31eda7c548f 2023-07-19 19:12:19,411 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:12:19,411 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testEmptyExportFileSystemState/e2488a65d64d016aefaa39e1444aa92d/.tmp/cf/6f034245729f42bc8bbec31eda7c548f as hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testEmptyExportFileSystemState/e2488a65d64d016aefaa39e1444aa92d/cf/6f034245729f42bc8bbec31eda7c548f 2023-07-19 19:12:19,411 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testEmptyExportFileSystemState/978ea6dc3c9c1062758e11ac6e3f1554/.tmp/cf/2cdd2ea323b242ee84ff91c75933a8d2 as hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testEmptyExportFileSystemState/978ea6dc3c9c1062758e11ac6e3f1554/cf/2cdd2ea323b242ee84ff91c75933a8d2 2023-07-19 19:12:19,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 19:12:19,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:12:19,418 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 19:12:19,418 INFO [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testEmptyExportFileSystemState/e2488a65d64d016aefaa39e1444aa92d/cf/6f034245729f42bc8bbec31eda7c548f, entries=47, sequenceid=6, filesize=13.1 K 2023-07-19 19:12:19,419 INFO [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testEmptyExportFileSystemState/978ea6dc3c9c1062758e11ac6e3f1554/cf/2cdd2ea323b242ee84ff91c75933a8d2, entries=3, sequenceid=6, filesize=5.4 K 2023-07-19 19:12:19,419 INFO [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for e2488a65d64d016aefaa39e1444aa92d in 61ms, sequenceid=6, compaction requested=false 2023-07-19 19:12:19,419 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-19 19:12:19,420 INFO [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 978ea6dc3c9c1062758e11ac6e3f1554 in 63ms, sequenceid=6, compaction requested=false 2023-07-19 19:12:19,420 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e2488a65d64d016aefaa39e1444aa92d: 2023-07-19 19:12:19,422 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 978ea6dc3c9c1062758e11ac6e3f1554: 2023-07-19 19:12:19,422 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689793938111.e2488a65d64d016aefaa39e1444aa92d.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,422 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:12:19,422 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689793938111.978ea6dc3c9c1062758e11ac6e3f1554.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,422 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testEmptyExportFileSystemState/e2488a65d64d016aefaa39e1444aa92d/cf/6f034245729f42bc8bbec31eda7c548f] hfiles 2023-07-19 19:12:19,422 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testEmptyExportFileSystemState/e2488a65d64d016aefaa39e1444aa92d/cf/6f034245729f42bc8bbec31eda7c548f for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,423 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:12:19,424 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testEmptyExportFileSystemState/978ea6dc3c9c1062758e11ac6e3f1554/cf/2cdd2ea323b242ee84ff91c75933a8d2] hfiles 2023-07-19 19:12:19,424 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testEmptyExportFileSystemState/978ea6dc3c9c1062758e11ac6e3f1554/cf/2cdd2ea323b242ee84ff91c75933a8d2 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,442 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689793938111.e2488a65d64d016aefaa39e1444aa92d. completed. 2023-07-19 19:12:19,442 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689793938111.e2488a65d64d016aefaa39e1444aa92d. 2023-07-19 19:12:19,442 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:12:19,442 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:12:19,442 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:19,442 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 19:12:19,442 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46111,1689793835594' in zk 2023-07-19 19:12:19,444 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:19,444 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 19:12:19,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:19,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:19,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:19,444 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:12:19,444 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 19:12:19,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:19,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:19,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:19,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:19,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:19,450 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689793938111.978ea6dc3c9c1062758e11ac6e3f1554. completed. 2023-07-19 19:12:19,450 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689793938111.978ea6dc3c9c1062758e11ac6e3f1554. 2023-07-19 19:12:19,450 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:12:19,450 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:12:19,450 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:19,450 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 19:12:19,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:19,450 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40791,1689793835731' in zk 2023-07-19 19:12:19,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:19,453 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:19,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:19,453 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 19:12:19,453 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:12:19,453 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 19:12:19,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,46111,1689793835594': 2023-07-19 19:12:19,456 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46111,1689793835594' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 19:12:19,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:19,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:19,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:19,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:19,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:19,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:19,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:19,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:19,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:19,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:19,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:19,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:19,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40791,1689793835731': 2023-07-19 19:12:19,459 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40791,1689793835731' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 19:12:19,459 INFO [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-19 19:12:19,460 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 19:12:19,460 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 19:12:19,460 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,460 INFO [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 19:12:19,461 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,461 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,461 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,462 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,462 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:19,461 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:19,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,461 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:19,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:19,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:19,463 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:19,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:19,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:19,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:19,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:19,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:19,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:19,464 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:19,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:19,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,465 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:19,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:19,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:19,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:19,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:19,467 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:19,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:19,467 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:19,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,468 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:19,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:19,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:19,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:19,471 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:19,471 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:19,471 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:19,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:19,471 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:19,471 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:19,471 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,471 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:19,471 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:19,471 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:12:19,471 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:19,471 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:19,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:19,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:19,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:19,471 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:19,471 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-19 19:12:19,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:19,473 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,473 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:19,473 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 19:12:19,473 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,471 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:19,473 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:19,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:19,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:19,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:19,473 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:19,474 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,474 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:19,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:19,474 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307196afc3feeaa474c73833097d80c909e20, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230719e89c9704720f4ebfb9ac9bc7e2544158] mob files 2023-07-19 19:12:19,474 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307196afc3feeaa474c73833097d80c909e20 2023-07-19 19:12:19,474 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230719e89c9704720f4ebfb9ac9bc7e2544158 2023-07-19 19:12:19,486 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,487 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,512 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,547 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-19 19:12:19,547 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,548 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,548 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689793939309Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689793939486 (+177 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689793939486Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689793939486Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689793939493 (+7 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689793939504 (+11 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689793939547 (+43 ms) 2023-07-19 19:12:19,555 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 19:12:19,558 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 244 msec 2023-07-19 19:12:19,618 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:12:19,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 19:12:19,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 19:12:19,620 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793939620 2023-07-19 19:12:19,620 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43367, tgtDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793939620, rawTgtDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793939620, srcFsUri=hdfs://localhost:43367, srcDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978 2023-07-19 19:12:19,649 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43367, inputRoot=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978 2023-07-19 19:12:19,649 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-820022387_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793939620, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793939620/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,649 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43367, inputRoot=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978, snapshotDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-19 19:12:19,662 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793939620/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:19,701 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:19,701 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:19,701 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:19,702 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:19,702 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:19,702 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:19,703 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:19,785 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/hadoop-7365253721494843964.jar 2023-07-19 19:12:19,785 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:19,786 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:19,786 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:19,787 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:19,787 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:19,787 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:19,788 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 19:12:19,788 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 19:12:19,788 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 19:12:19,789 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 19:12:19,789 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 19:12:19,789 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 19:12:19,790 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 19:12:19,790 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 19:12:19,790 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 19:12:19,791 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 19:12:19,792 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:12:19,792 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:12:19,792 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 19:12:19,793 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:12:19,793 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:12:19,793 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 19:12:19,794 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 19:12:21,678 WARN [Listener at jenkins-hbase4.apache.org/42871] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 19:12:21,682 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-19 19:12:22,281 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 19:12:22,282 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 19:12:22,284 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843898_0005_000001 (auth:SIMPLE) 2023-07-19 19:12:22,428 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843898_0006_000001 (auth:SIMPLE) 2023-07-19 19:12:22,984 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 19:12:28,755 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843898_0006_000001 (auth:SIMPLE) 2023-07-19 19:12:31,920 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 19:12:31,924 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 19:12:31,932 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:31,933 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 19:12:31,933 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 19:12:31,934 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1054544951_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:31,934 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(367): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-19 19:12:31,934 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(367): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-19 19:12:31,934 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1054544951_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793939620/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793939620/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:31,935 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(367): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793939620/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-19 19:12:31,935 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(367): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793939620/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-19 19:12:31,944 INFO [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-19 19:12:31,945 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-19 19:12:31,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 19:12:31,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-19 19:12:31,952 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793951952"}]},"ts":"1689793951952"} 2023-07-19 19:12:31,954 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-19 19:12:31,957 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-19 19:12:31,958 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=978ea6dc3c9c1062758e11ac6e3f1554, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e2488a65d64d016aefaa39e1444aa92d, UNASSIGN}] 2023-07-19 19:12:31,960 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=978ea6dc3c9c1062758e11ac6e3f1554, UNASSIGN 2023-07-19 19:12:31,960 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e2488a65d64d016aefaa39e1444aa92d, UNASSIGN 2023-07-19 19:12:31,961 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=978ea6dc3c9c1062758e11ac6e3f1554, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:31,962 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689793938111.978ea6dc3c9c1062758e11ac6e3f1554.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689793951961"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793951961"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793951961"}]},"ts":"1689793951961"} 2023-07-19 19:12:31,962 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=e2488a65d64d016aefaa39e1444aa92d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:31,962 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689793938111.e2488a65d64d016aefaa39e1444aa92d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689793951962"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793951962"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793951962"}]},"ts":"1689793951962"} 2023-07-19 19:12:31,963 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 978ea6dc3c9c1062758e11ac6e3f1554, server=jenkins-hbase4.apache.org,40791,1689793835731}] 2023-07-19 19:12:31,964 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure e2488a65d64d016aefaa39e1444aa92d, server=jenkins-hbase4.apache.org,46111,1689793835594}] 2023-07-19 19:12:32,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-19 19:12:32,118 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 978ea6dc3c9c1062758e11ac6e3f1554 2023-07-19 19:12:32,118 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e2488a65d64d016aefaa39e1444aa92d 2023-07-19 19:12:32,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 978ea6dc3c9c1062758e11ac6e3f1554, disabling compactions & flushes 2023-07-19 19:12:32,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e2488a65d64d016aefaa39e1444aa92d, disabling compactions & flushes 2023-07-19 19:12:32,118 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689793938111.978ea6dc3c9c1062758e11ac6e3f1554. 2023-07-19 19:12:32,119 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689793938111.e2488a65d64d016aefaa39e1444aa92d. 2023-07-19 19:12:32,119 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689793938111.978ea6dc3c9c1062758e11ac6e3f1554. 2023-07-19 19:12:32,119 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689793938111.e2488a65d64d016aefaa39e1444aa92d. 2023-07-19 19:12:32,119 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689793938111.978ea6dc3c9c1062758e11ac6e3f1554. after waiting 0 ms 2023-07-19 19:12:32,119 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689793938111.978ea6dc3c9c1062758e11ac6e3f1554. 2023-07-19 19:12:32,119 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689793938111.e2488a65d64d016aefaa39e1444aa92d. after waiting 0 ms 2023-07-19 19:12:32,119 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689793938111.e2488a65d64d016aefaa39e1444aa92d. 2023-07-19 19:12:32,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testEmptyExportFileSystemState/978ea6dc3c9c1062758e11ac6e3f1554/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 19:12:32,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:12:32,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testEmptyExportFileSystemState/e2488a65d64d016aefaa39e1444aa92d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 19:12:32,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:12:32,144 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689793938111.978ea6dc3c9c1062758e11ac6e3f1554. 2023-07-19 19:12:32,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 978ea6dc3c9c1062758e11ac6e3f1554: 2023-07-19 19:12:32,144 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689793938111.e2488a65d64d016aefaa39e1444aa92d. 2023-07-19 19:12:32,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e2488a65d64d016aefaa39e1444aa92d: 2023-07-19 19:12:32,146 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e2488a65d64d016aefaa39e1444aa92d 2023-07-19 19:12:32,147 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=e2488a65d64d016aefaa39e1444aa92d, regionState=CLOSED 2023-07-19 19:12:32,147 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689793938111.e2488a65d64d016aefaa39e1444aa92d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689793952147"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793952147"}]},"ts":"1689793952147"} 2023-07-19 19:12:32,147 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 978ea6dc3c9c1062758e11ac6e3f1554 2023-07-19 19:12:32,147 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=978ea6dc3c9c1062758e11ac6e3f1554, regionState=CLOSED 2023-07-19 19:12:32,148 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689793938111.978ea6dc3c9c1062758e11ac6e3f1554.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689793952147"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793952147"}]},"ts":"1689793952147"} 2023-07-19 19:12:32,157 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-19 19:12:32,157 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-19 19:12:32,157 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 978ea6dc3c9c1062758e11ac6e3f1554, server=jenkins-hbase4.apache.org,40791,1689793835731 in 186 msec 2023-07-19 19:12:32,157 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure e2488a65d64d016aefaa39e1444aa92d, server=jenkins-hbase4.apache.org,46111,1689793835594 in 185 msec 2023-07-19 19:12:32,158 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e2488a65d64d016aefaa39e1444aa92d, UNASSIGN in 199 msec 2023-07-19 19:12:32,159 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-19 19:12:32,159 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=978ea6dc3c9c1062758e11ac6e3f1554, UNASSIGN in 199 msec 2023-07-19 19:12:32,160 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793952159"}]},"ts":"1689793952159"} 2023-07-19 19:12:32,161 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-19 19:12:32,163 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-19 19:12:32,165 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 219 msec 2023-07-19 19:12:32,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-19 19:12:32,254 INFO [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-19 19:12:32,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-19 19:12:32,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 19:12:32,258 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 19:12:32,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-19 19:12:32,259 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 19:12:32,260 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40791] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-19 19:12:32,263 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 19:12:32,263 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 19:12:32,263 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 19:12:32,263 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 19:12:32,263 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testEmptyExportFileSystemState/e2488a65d64d016aefaa39e1444aa92d 2023-07-19 19:12:32,263 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testEmptyExportFileSystemState/978ea6dc3c9c1062758e11ac6e3f1554 2023-07-19 19:12:32,264 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 19:12:32,263 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 19:12:32,266 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testEmptyExportFileSystemState/e2488a65d64d016aefaa39e1444aa92d/cf, FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testEmptyExportFileSystemState/e2488a65d64d016aefaa39e1444aa92d/recovered.edits] 2023-07-19 19:12:32,266 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testEmptyExportFileSystemState/978ea6dc3c9c1062758e11ac6e3f1554/cf, FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testEmptyExportFileSystemState/978ea6dc3c9c1062758e11ac6e3f1554/recovered.edits] 2023-07-19 19:12:32,269 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 19:12:32,269 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:32,269 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:32,269 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-19 19:12:32,269 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:32,269 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 19:12:32,269 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-19 19:12:32,269 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 19:12:32,269 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 19:12:32,269 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:32,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-19 19:12:32,272 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testEmptyExportFileSystemState/978ea6dc3c9c1062758e11ac6e3f1554/cf/2cdd2ea323b242ee84ff91c75933a8d2 to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testEmptyExportFileSystemState/978ea6dc3c9c1062758e11ac6e3f1554/cf/2cdd2ea323b242ee84ff91c75933a8d2 2023-07-19 19:12:32,272 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testEmptyExportFileSystemState/e2488a65d64d016aefaa39e1444aa92d/cf/6f034245729f42bc8bbec31eda7c548f to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testEmptyExportFileSystemState/e2488a65d64d016aefaa39e1444aa92d/cf/6f034245729f42bc8bbec31eda7c548f 2023-07-19 19:12:32,275 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testEmptyExportFileSystemState/e2488a65d64d016aefaa39e1444aa92d/recovered.edits/9.seqid to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testEmptyExportFileSystemState/e2488a65d64d016aefaa39e1444aa92d/recovered.edits/9.seqid 2023-07-19 19:12:32,276 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testEmptyExportFileSystemState/978ea6dc3c9c1062758e11ac6e3f1554/recovered.edits/9.seqid to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testEmptyExportFileSystemState/978ea6dc3c9c1062758e11ac6e3f1554/recovered.edits/9.seqid 2023-07-19 19:12:32,276 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testEmptyExportFileSystemState/e2488a65d64d016aefaa39e1444aa92d 2023-07-19 19:12:32,277 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testEmptyExportFileSystemState/978ea6dc3c9c1062758e11ac6e3f1554 2023-07-19 19:12:32,277 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-19 19:12:32,277 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-19 19:12:32,278 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-19 19:12:32,283 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307196afc3feeaa474c73833097d80c909e20 to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307196afc3feeaa474c73833097d80c909e20 2023-07-19 19:12:32,285 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230719e89c9704720f4ebfb9ac9bc7e2544158 to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230719e89c9704720f4ebfb9ac9bc7e2544158 2023-07-19 19:12:32,285 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-19 19:12:32,288 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 19:12:32,290 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-19 19:12:32,292 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-19 19:12:32,293 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 19:12:32,293 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-19 19:12:32,294 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689793938111.978ea6dc3c9c1062758e11ac6e3f1554.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689793952293"}]},"ts":"9223372036854775807"} 2023-07-19 19:12:32,294 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689793938111.e2488a65d64d016aefaa39e1444aa92d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689793952293"}]},"ts":"9223372036854775807"} 2023-07-19 19:12:32,295 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 19:12:32,295 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 978ea6dc3c9c1062758e11ac6e3f1554, NAME => 'testtb-testEmptyExportFileSystemState,,1689793938111.978ea6dc3c9c1062758e11ac6e3f1554.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e2488a65d64d016aefaa39e1444aa92d, NAME => 'testtb-testEmptyExportFileSystemState,1,1689793938111.e2488a65d64d016aefaa39e1444aa92d.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 19:12:32,295 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-19 19:12:32,295 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689793952295"}]},"ts":"9223372036854775807"} 2023-07-19 19:12:32,297 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-19 19:12:32,298 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 19:12:32,299 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 45 msec 2023-07-19 19:12:32,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-19 19:12:32,372 INFO [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-19 19:12:32,381 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-19 19:12:32,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:32,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-19 19:12:32,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-19 19:12:32,427 INFO [Listener at jenkins-hbase4.apache.org/42871] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=762 (was 760) Potentially hanging thread: Thread-4909 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1054544951_17 at /127.0.0.1:60378 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (274932937) connection to jenkins-hbase4.apache.org/172.31.14.131:36731 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x1164f60d-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1872893059_1 at /127.0.0.1:39150 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1054544951_17 at /127.0.0.1:36332 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (274932937) connection to jenkins-hbase4.apache.org/172.31.14.131:36017 from appattempt_1689793843898_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1054544951_17 at /127.0.0.1:45008 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1164f60d-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1872893059_1 at /127.0.0.1:52288 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1164f60d-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1164f60d-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=906 (was 905) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=601 (was 532) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 181), AvailableMemoryMB=1973 (was 2761) 2023-07-19 19:12:32,428 WARN [Listener at jenkins-hbase4.apache.org/42871] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-19 19:12:32,455 INFO [Listener at jenkins-hbase4.apache.org/42871] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=762, OpenFileDescriptor=904, MaxFileDescriptor=60000, SystemLoadAverage=601, ProcessCount=181, AvailableMemoryMB=1971 2023-07-19 19:12:32,455 WARN [Listener at jenkins-hbase4.apache.org/42871] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-19 19:12:32,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-19 19:12:32,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:32,461 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 19:12:32,461 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-19 19:12:32,462 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 19:12:32,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 19:12:32,464 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d58887d6a09503adc64d91b264e86133 2023-07-19 19:12:32,464 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/05862531789adc5dc35e07b0f578ba9b 2023-07-19 19:12:32,465 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d58887d6a09503adc64d91b264e86133 empty. 2023-07-19 19:12:32,465 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/05862531789adc5dc35e07b0f578ba9b empty. 2023-07-19 19:12:32,465 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d58887d6a09503adc64d91b264e86133 2023-07-19 19:12:32,465 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/05862531789adc5dc35e07b0f578ba9b 2023-07-19 19:12:32,465 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-19 19:12:32,488 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-19 19:12:32,489 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => d58887d6a09503adc64d91b264e86133, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689793952457.d58887d6a09503adc64d91b264e86133.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp 2023-07-19 19:12:32,490 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 05862531789adc5dc35e07b0f578ba9b, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689793952457.05862531789adc5dc35e07b0f578ba9b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp 2023-07-19 19:12:32,549 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689793952457.d58887d6a09503adc64d91b264e86133.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:12:32,549 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing d58887d6a09503adc64d91b264e86133, disabling compactions & flushes 2023-07-19 19:12:32,550 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689793952457.d58887d6a09503adc64d91b264e86133. 2023-07-19 19:12:32,550 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689793952457.d58887d6a09503adc64d91b264e86133. 2023-07-19 19:12:32,550 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689793952457.d58887d6a09503adc64d91b264e86133. after waiting 0 ms 2023-07-19 19:12:32,550 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689793952457.d58887d6a09503adc64d91b264e86133. 2023-07-19 19:12:32,550 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689793952457.d58887d6a09503adc64d91b264e86133. 2023-07-19 19:12:32,550 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for d58887d6a09503adc64d91b264e86133: 2023-07-19 19:12:32,550 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689793952457.05862531789adc5dc35e07b0f578ba9b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:12:32,550 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 05862531789adc5dc35e07b0f578ba9b, disabling compactions & flushes 2023-07-19 19:12:32,550 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689793952457.05862531789adc5dc35e07b0f578ba9b. 2023-07-19 19:12:32,550 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689793952457.05862531789adc5dc35e07b0f578ba9b. 2023-07-19 19:12:32,550 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689793952457.05862531789adc5dc35e07b0f578ba9b. after waiting 0 ms 2023-07-19 19:12:32,550 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689793952457.05862531789adc5dc35e07b0f578ba9b. 2023-07-19 19:12:32,550 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689793952457.05862531789adc5dc35e07b0f578ba9b. 2023-07-19 19:12:32,550 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 05862531789adc5dc35e07b0f578ba9b: 2023-07-19 19:12:32,558 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 19:12:32,559 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689793952457.d58887d6a09503adc64d91b264e86133.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689793952559"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793952559"}]},"ts":"1689793952559"} 2023-07-19 19:12:32,560 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689793952457.05862531789adc5dc35e07b0f578ba9b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689793952559"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793952559"}]},"ts":"1689793952559"} 2023-07-19 19:12:32,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 19:12:32,573 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 19:12:32,574 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 19:12:32,574 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793952574"}]},"ts":"1689793952574"} 2023-07-19 19:12:32,576 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-19 19:12:32,580 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 19:12:32,584 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 19:12:32,584 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 19:12:32,584 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 19:12:32,584 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 19:12:32,584 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d58887d6a09503adc64d91b264e86133, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=05862531789adc5dc35e07b0f578ba9b, ASSIGN}] 2023-07-19 19:12:32,588 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d58887d6a09503adc64d91b264e86133, ASSIGN 2023-07-19 19:12:32,589 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d58887d6a09503adc64d91b264e86133, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46111,1689793835594; forceNewPlan=false, retain=false 2023-07-19 19:12:32,589 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=05862531789adc5dc35e07b0f578ba9b, ASSIGN 2023-07-19 19:12:32,591 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=05862531789adc5dc35e07b0f578ba9b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40791,1689793835731; forceNewPlan=false, retain=false 2023-07-19 19:12:32,739 INFO [jenkins-hbase4:37769] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 19:12:32,743 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=d58887d6a09503adc64d91b264e86133, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:32,743 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=05862531789adc5dc35e07b0f578ba9b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:32,743 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689793952457.d58887d6a09503adc64d91b264e86133.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689793952743"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793952743"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793952743"}]},"ts":"1689793952743"} 2023-07-19 19:12:32,743 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689793952457.05862531789adc5dc35e07b0f578ba9b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689793952743"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793952743"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793952743"}]},"ts":"1689793952743"} 2023-07-19 19:12:32,745 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure d58887d6a09503adc64d91b264e86133, server=jenkins-hbase4.apache.org,46111,1689793835594}] 2023-07-19 19:12:32,746 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 05862531789adc5dc35e07b0f578ba9b, server=jenkins-hbase4.apache.org,40791,1689793835731}] 2023-07-19 19:12:32,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 19:12:32,916 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689793952457.d58887d6a09503adc64d91b264e86133. 2023-07-19 19:12:32,917 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689793952457.05862531789adc5dc35e07b0f578ba9b. 2023-07-19 19:12:32,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d58887d6a09503adc64d91b264e86133, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689793952457.d58887d6a09503adc64d91b264e86133.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 19:12:32,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 05862531789adc5dc35e07b0f578ba9b, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689793952457.05862531789adc5dc35e07b0f578ba9b.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 19:12:32,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689793952457.d58887d6a09503adc64d91b264e86133. service=AccessControlService 2023-07-19 19:12:32,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689793952457.05862531789adc5dc35e07b0f578ba9b. service=AccessControlService 2023-07-19 19:12:32,917 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:12:32,917 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 19:12:32,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp d58887d6a09503adc64d91b264e86133 2023-07-19 19:12:32,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689793952457.d58887d6a09503adc64d91b264e86133.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:12:32,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 05862531789adc5dc35e07b0f578ba9b 2023-07-19 19:12:32,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d58887d6a09503adc64d91b264e86133 2023-07-19 19:12:32,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689793952457.05862531789adc5dc35e07b0f578ba9b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 19:12:32,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d58887d6a09503adc64d91b264e86133 2023-07-19 19:12:32,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 05862531789adc5dc35e07b0f578ba9b 2023-07-19 19:12:32,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 05862531789adc5dc35e07b0f578ba9b 2023-07-19 19:12:32,920 INFO [StoreOpener-d58887d6a09503adc64d91b264e86133-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d58887d6a09503adc64d91b264e86133 2023-07-19 19:12:32,920 INFO [StoreOpener-05862531789adc5dc35e07b0f578ba9b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 05862531789adc5dc35e07b0f578ba9b 2023-07-19 19:12:32,921 DEBUG [StoreOpener-05862531789adc5dc35e07b0f578ba9b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithSkipTmp/05862531789adc5dc35e07b0f578ba9b/cf 2023-07-19 19:12:32,921 DEBUG [StoreOpener-d58887d6a09503adc64d91b264e86133-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithSkipTmp/d58887d6a09503adc64d91b264e86133/cf 2023-07-19 19:12:32,921 DEBUG [StoreOpener-d58887d6a09503adc64d91b264e86133-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithSkipTmp/d58887d6a09503adc64d91b264e86133/cf 2023-07-19 19:12:32,921 DEBUG [StoreOpener-05862531789adc5dc35e07b0f578ba9b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithSkipTmp/05862531789adc5dc35e07b0f578ba9b/cf 2023-07-19 19:12:32,922 INFO [StoreOpener-d58887d6a09503adc64d91b264e86133-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d58887d6a09503adc64d91b264e86133 columnFamilyName cf 2023-07-19 19:12:32,922 INFO [StoreOpener-05862531789adc5dc35e07b0f578ba9b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 05862531789adc5dc35e07b0f578ba9b columnFamilyName cf 2023-07-19 19:12:32,923 INFO [StoreOpener-d58887d6a09503adc64d91b264e86133-1] regionserver.HStore(310): Store=d58887d6a09503adc64d91b264e86133/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:12:32,924 INFO [StoreOpener-05862531789adc5dc35e07b0f578ba9b-1] regionserver.HStore(310): Store=05862531789adc5dc35e07b0f578ba9b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 19:12:32,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithSkipTmp/d58887d6a09503adc64d91b264e86133 2023-07-19 19:12:32,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithSkipTmp/d58887d6a09503adc64d91b264e86133 2023-07-19 19:12:32,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithSkipTmp/05862531789adc5dc35e07b0f578ba9b 2023-07-19 19:12:32,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithSkipTmp/05862531789adc5dc35e07b0f578ba9b 2023-07-19 19:12:32,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d58887d6a09503adc64d91b264e86133 2023-07-19 19:12:32,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 05862531789adc5dc35e07b0f578ba9b 2023-07-19 19:12:32,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithSkipTmp/d58887d6a09503adc64d91b264e86133/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 19:12:32,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithSkipTmp/05862531789adc5dc35e07b0f578ba9b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 19:12:32,931 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d58887d6a09503adc64d91b264e86133; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68084346, jitterRate=0.0145358145236969}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 19:12:32,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d58887d6a09503adc64d91b264e86133: 2023-07-19 19:12:32,931 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 05862531789adc5dc35e07b0f578ba9b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70234342, jitterRate=0.046573251485824585}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 19:12:32,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 05862531789adc5dc35e07b0f578ba9b: 2023-07-19 19:12:32,932 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689793952457.d58887d6a09503adc64d91b264e86133., pid=108, masterSystemTime=1689793952913 2023-07-19 19:12:32,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689793952457.d58887d6a09503adc64d91b264e86133. 2023-07-19 19:12:32,934 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689793952457.d58887d6a09503adc64d91b264e86133. 2023-07-19 19:12:32,934 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=d58887d6a09503adc64d91b264e86133, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:32,935 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689793952457.d58887d6a09503adc64d91b264e86133.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689793952934"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689793952934"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689793952934"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689793952934"}]},"ts":"1689793952934"} 2023-07-19 19:12:32,935 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689793952457.05862531789adc5dc35e07b0f578ba9b., pid=109, masterSystemTime=1689793952913 2023-07-19 19:12:32,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689793952457.05862531789adc5dc35e07b0f578ba9b. 2023-07-19 19:12:32,936 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689793952457.05862531789adc5dc35e07b0f578ba9b. 2023-07-19 19:12:32,937 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=05862531789adc5dc35e07b0f578ba9b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:32,937 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689793952457.05862531789adc5dc35e07b0f578ba9b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689793952937"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689793952937"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689793952937"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689793952937"}]},"ts":"1689793952937"} 2023-07-19 19:12:32,939 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-19 19:12:32,939 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure d58887d6a09503adc64d91b264e86133, server=jenkins-hbase4.apache.org,46111,1689793835594 in 192 msec 2023-07-19 19:12:32,940 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-19 19:12:32,940 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 05862531789adc5dc35e07b0f578ba9b, server=jenkins-hbase4.apache.org,40791,1689793835731 in 192 msec 2023-07-19 19:12:32,941 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d58887d6a09503adc64d91b264e86133, ASSIGN in 355 msec 2023-07-19 19:12:32,942 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-19 19:12:32,942 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=05862531789adc5dc35e07b0f578ba9b, ASSIGN in 356 msec 2023-07-19 19:12:32,943 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 19:12:32,943 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793952943"}]},"ts":"1689793952943"} 2023-07-19 19:12:32,944 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-19 19:12:32,947 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 19:12:32,947 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-19 19:12:32,949 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40791] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-19 19:12:32,950 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:32,950 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:32,950 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:32,950 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:32,952 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 19:12:32,953 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 19:12:32,952 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 19:12:32,954 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 496 msec 2023-07-19 19:12:32,952 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 19:12:33,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 19:12:33,068 INFO [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-19 19:12:33,070 DEBUG [Listener at jenkins-hbase4.apache.org/42871] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,071 DEBUG [Listener at jenkins-hbase4.apache.org/42871] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689793952457.d58887d6a09503adc64d91b264e86133. 2023-07-19 19:12:33,072 INFO [Listener at jenkins-hbase4.apache.org/42871] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 19:12:33,084 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 19:12:33,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689793953084 (current time:1689793953084). 2023-07-19 19:12:33,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 19:12:33,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(139): Connect 0x0075823f to 127.0.0.1:58293 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:12:33,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7649775, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:12:33,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:12:33,097 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47942, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:12:33,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0075823f to 127.0.0.1:58293 2023-07-19 19:12:33,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:12:33,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(139): Connect 0x198f229b to 127.0.0.1:58293 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:12:33,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35472fef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:12:33,107 DEBUG [hconnection-0x163bc90d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:12:33,109 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47946, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:12:33,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x198f229b to 127.0.0.1:58293 2023-07-19 19:12:33,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:12:33,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-19 19:12:33,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 19:12:33,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 19:12:33,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 19:12:33,120 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 19:12:33,120 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689794553120 2023-07-19 19:12:33,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 19:12:33,120 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,122 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 19:12:33,122 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 19:12:33,123 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 19:12:33,123 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 19:12:33,124 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-07-19 19:12:33,125 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 19:12:33,127 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689794553127 2023-07-19 19:12:33,136 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,136 INFO [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-19 19:12:33,136 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:12:33,138 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-19 19:12:33,138 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-19 19:12:33,222 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:12:33,225 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,225 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 19:12:33,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:12:33,226 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 19:12:33,227 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:33,227 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:33,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:33,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:33,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:33,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:33,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,228 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:33,229 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,229 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,229 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:33,229 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:33,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-19 19:12:33,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,229 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 19:12:33,229 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:33,229 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 19:12:33,230 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,230 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 19:12:33,230 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:12:33,231 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 19:12:33,232 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 19:12:33,232 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40791,1689793835731' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 19:12:33,232 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:33,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:33,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:33,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,233 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-19 19:12:33,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,233 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 19:12:33,234 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,235 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 19:12:33,235 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:12:33,236 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 19:12:33,236 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 19:12:33,236 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46111,1689793835594' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 19:12:33,242 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-19 19:12:33,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,242 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 19:12:33,243 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:33,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:33,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:33,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:33,243 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,243 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,243 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:33,243 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:12:33,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:33,244 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,244 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:12:33,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:33,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:33,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:33,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:33,246 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40791,1689793835731' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 19:12:33,246 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ecb7e5[Count = 1] remaining members to acquire global barrier 2023-07-19 19:12:33,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:33,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:33,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:33,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:33,246 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,247 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 19:12:33,247 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:12:33,248 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 19:12:33,248 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 19:12:33,248 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45693,1689793835672' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 19:12:33,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:33,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:33,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:33,251 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,251 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,251 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:12:33,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:33,252 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46111,1689793835594' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 19:12:33,252 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ecb7e5[Count = 0] remaining members to acquire global barrier 2023-07-19 19:12:33,252 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-19 19:12:33,252 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,254 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,254 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,254 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 19:12:33,254 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 19:12:33,254 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45693,1689793835672' in zk 2023-07-19 19:12:33,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,254 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 19:12:33,254 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:33,255 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:33,255 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 19:12:33,255 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,255 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 19:12:33,257 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 19:12:33,257 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:12:33,257 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 19:12:33,262 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:12:33,265 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:12:33,265 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689793952457.05862531789adc5dc35e07b0f578ba9b. 2023-07-19 19:12:33,265 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689793952457.05862531789adc5dc35e07b0f578ba9b. started... 2023-07-19 19:12:33,265 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689793952457.d58887d6a09503adc64d91b264e86133. 2023-07-19 19:12:33,265 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689793952457.d58887d6a09503adc64d91b264e86133. started... 2023-07-19 19:12:33,265 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:12:33,267 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:12:33,267 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 05862531789adc5dc35e07b0f578ba9b: 2023-07-19 19:12:33,269 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d58887d6a09503adc64d91b264e86133: 2023-07-19 19:12:33,269 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689793952457.05862531789adc5dc35e07b0f578ba9b.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,270 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:12:33,270 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689793952457.d58887d6a09503adc64d91b264e86133.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,271 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 19:12:33,271 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:12:33,271 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 19:12:33,309 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689793952457.05862531789adc5dc35e07b0f578ba9b. completed. 2023-07-19 19:12:33,309 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689793952457.05862531789adc5dc35e07b0f578ba9b. 2023-07-19 19:12:33,310 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:12:33,310 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:12:33,310 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:33,310 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 19:12:33,310 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689793952457.d58887d6a09503adc64d91b264e86133. completed. 2023-07-19 19:12:33,310 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40791,1689793835731' in zk 2023-07-19 19:12:33,310 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689793952457.d58887d6a09503adc64d91b264e86133. 2023-07-19 19:12:33,310 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:12:33,310 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:12:33,310 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:33,310 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 19:12:33,310 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46111,1689793835594' in zk 2023-07-19 19:12:33,312 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 19:12:33,312 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:12:33,312 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 19:12:33,313 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:33,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:33,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:33,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:33,314 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 19:12:33,314 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:12:33,314 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:33,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:33,314 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 19:12:33,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:33,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:33,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:33,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:33,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:33,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:33,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:33,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:33,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40791,1689793835731': 2023-07-19 19:12:33,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40791,1689793835731' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-19 19:12:33,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:33,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:33,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:33,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:33,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:33,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:33,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:33,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:33,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:33,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:33,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:33,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:33,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,46111,1689793835594': 2023-07-19 19:12:33,330 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46111,1689793835594' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-19 19:12:33,330 INFO [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-19 19:12:33,330 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 19:12:33,330 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 19:12:33,330 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,330 INFO [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 19:12:33,333 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,333 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:33,333 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,333 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:33,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,333 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,334 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:33,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,334 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:33,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:33,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:33,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:33,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:33,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:33,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:33,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:33,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:33,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,336 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:33,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:33,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,336 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:33,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:33,337 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:33,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:33,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:33,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:33,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:33,339 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:33,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:33,339 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:33,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:33,339 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:33,343 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:33,343 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,343 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:33,343 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:33,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:33,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:33,343 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:33,343 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:33,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:33,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:33,344 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:12:33,343 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:33,343 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:33,344 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,344 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,346 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:33,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:33,344 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:33,344 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:33,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:33,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:33,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:33,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:33,346 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,346 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:33,346 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 19:12:33,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:33,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:33,346 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,346 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:33,346 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:33,347 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,347 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,347 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-19 19:12:33,381 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,382 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,426 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:12:33,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 19:12:33,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:12:33,428 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 19:12:33,457 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,535 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-19 19:12:33,535 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,536 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,536 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689793953121Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689793953381 (+260 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689793953381Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689793953381Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689793953387 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689793953416 (+29 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689793953535 (+119 ms) 2023-07-19 19:12:33,539 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 19:12:33,540 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 417 msec 2023-07-19 19:12:33,728 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:12:33,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 19:12:33,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 19:12:33,731 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46111] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689793952457.d58887d6a09503adc64d91b264e86133. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 19:12:33,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40791] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689793952457.05862531789adc5dc35e07b0f578ba9b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 19:12:33,735 DEBUG [Listener at jenkins-hbase4.apache.org/42871] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,736 DEBUG [Listener at jenkins-hbase4.apache.org/42871] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689793952457.d58887d6a09503adc64d91b264e86133. 2023-07-19 19:12:33,736 INFO [Listener at jenkins-hbase4.apache.org/42871] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 19:12:33,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 19:12:33,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689793953748 (current time:1689793953748). 2023-07-19 19:12:33,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 19:12:33,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(139): Connect 0x0c33160a to 127.0.0.1:58293 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:12:33,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4408c520, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:12:33,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:12:33,772 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47962, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:12:33,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0c33160a to 127.0.0.1:58293 2023-07-19 19:12:33,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:12:33,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(139): Connect 0x7fa35848 to 127.0.0.1:58293 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 19:12:33,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6bb492f0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 19:12:33,787 DEBUG [hconnection-0x69976b63-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 19:12:33,791 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47974, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 19:12:33,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7fa35848 to 127.0.0.1:58293 2023-07-19 19:12:33,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:12:33,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-19 19:12:33,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 19:12:33,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 19:12:33,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 19:12:33,807 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 19:12:33,808 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689794553808 2023-07-19 19:12:33,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 19:12:33,809 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,811 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 19:12:33,812 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 19:12:33,812 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 19:12:33,813 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 19:12:33,814 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-07-19 19:12:33,815 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 19:12:33,817 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689794553817 2023-07-19 19:12:33,834 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,834 INFO [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-19 19:12:33,834 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:12:33,835 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-19 19:12:33,836 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-19 19:12:33,836 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,836 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,838 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:33,838 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:33,838 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:33,838 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:33,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:33,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:33,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:33,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:33,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:33,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:33,838 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:33,838 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:33,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,839 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:33,839 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 19:12:33,839 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,839 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,839 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-19 19:12:33,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-19 19:12:33,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,840 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 19:12:33,840 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 19:12:33,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-19 19:12:33,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,840 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,841 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 19:12:33,841 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:12:33,840 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 19:12:33,856 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 19:12:33,856 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 19:12:33,856 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45693,1689793835672' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 19:12:33,859 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,859 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,859 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,859 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 19:12:33,859 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 19:12:33,859 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:12:33,859 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,859 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 19:12:33,859 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:12:33,861 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 19:12:33,861 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 19:12:33,861 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40791,1689793835731' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 19:12:33,862 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 19:12:33,862 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 19:12:33,863 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46111,1689793835594' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 19:12:33,864 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:33,864 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:33,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:33,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:33,866 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:33,866 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,866 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:12:33,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:33,866 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:33,867 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,867 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 19:12:33,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:33,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:33,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:33,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:33,873 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40791,1689793835731' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 19:12:33,873 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d738367[Count = 1] remaining members to acquire global barrier 2023-07-19 19:12:33,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:33,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:33,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:33,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:33,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:33,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:33,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:33,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:33,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:33,878 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46111,1689793835594' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 19:12:33,878 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d738367[Count = 0] remaining members to acquire global barrier 2023-07-19 19:12:33,878 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-19 19:12:33,878 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,883 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,883 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,883 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,883 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 19:12:33,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,883 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 19:12:33,884 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 19:12:33,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,884 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45693,1689793835672' in zk 2023-07-19 19:12:33,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,884 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:12:33,884 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:12:33,884 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 19:12:33,884 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689793952457.05862531789adc5dc35e07b0f578ba9b. 2023-07-19 19:12:33,884 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689793952457.05862531789adc5dc35e07b0f578ba9b. started... 2023-07-19 19:12:33,884 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:33,884 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 19:12:33,884 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 19:12:33,884 INFO [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 05862531789adc5dc35e07b0f578ba9b 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-19 19:12:33,885 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689793952457.d58887d6a09503adc64d91b264e86133. 2023-07-19 19:12:33,886 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 19:12:33,885 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:33,886 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689793952457.d58887d6a09503adc64d91b264e86133. started... 2023-07-19 19:12:33,886 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 19:12:33,886 INFO [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d58887d6a09503adc64d91b264e86133 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-19 19:12:33,886 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:12:33,891 DEBUG [member: 'jenkins-hbase4.apache.org,45693,1689793835672' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 19:12:33,913 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:12:33,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 19:12:33,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:12:33,914 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 19:12:33,920 INFO [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230719ad68a15c3b704d6485a0d606707c31ef to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230719ad68a15c3b704d6485a0d606707c31ef 2023-07-19 19:12:33,923 INFO [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307199f4ec37888c74a4682d471428932e2c1 to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307199f4ec37888c74a4682d471428932e2c1 2023-07-19 19:12:33,930 INFO [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithSkipTmp/05862531789adc5dc35e07b0f578ba9b/.tmp/cf/3bb39469821448ea9cd826b3de8d71ed 2023-07-19 19:12:33,948 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithSkipTmp/05862531789adc5dc35e07b0f578ba9b/.tmp/cf/3bb39469821448ea9cd826b3de8d71ed as hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithSkipTmp/05862531789adc5dc35e07b0f578ba9b/cf/3bb39469821448ea9cd826b3de8d71ed 2023-07-19 19:12:33,955 INFO [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithSkipTmp/05862531789adc5dc35e07b0f578ba9b/cf/3bb39469821448ea9cd826b3de8d71ed, entries=45, sequenceid=6, filesize=13.0 K 2023-07-19 19:12:33,956 INFO [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 05862531789adc5dc35e07b0f578ba9b in 72ms, sequenceid=6, compaction requested=false 2023-07-19 19:12:33,956 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-19 19:12:33,957 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 05862531789adc5dc35e07b0f578ba9b: 2023-07-19 19:12:33,957 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689793952457.05862531789adc5dc35e07b0f578ba9b.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,957 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:12:33,957 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithSkipTmp/05862531789adc5dc35e07b0f578ba9b/cf/3bb39469821448ea9cd826b3de8d71ed] hfiles 2023-07-19 19:12:33,957 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithSkipTmp/05862531789adc5dc35e07b0f578ba9b/cf/3bb39469821448ea9cd826b3de8d71ed for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,970 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689793952457.05862531789adc5dc35e07b0f578ba9b. completed. 2023-07-19 19:12:33,970 DEBUG [rs(jenkins-hbase4.apache.org,40791,1689793835731)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689793952457.05862531789adc5dc35e07b0f578ba9b. 2023-07-19 19:12:33,970 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:12:33,970 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:12:33,970 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:33,970 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 19:12:33,970 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40791,1689793835731' in zk 2023-07-19 19:12:33,973 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:33,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:33,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:33,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:33,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:33,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:33,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,974 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 19:12:33,975 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:12:33,975 DEBUG [member: 'jenkins-hbase4.apache.org,40791,1689793835731' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 19:12:33,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:33,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:33,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:33,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:33,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:33,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:33,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:33,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40791,1689793835731': 2023-07-19 19:12:33,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40791,1689793835731' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-19 19:12:34,114 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:12:34,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 19:12:34,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:12:34,116 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 19:12:34,333 INFO [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithSkipTmp/d58887d6a09503adc64d91b264e86133/.tmp/cf/8697b1462e704d0baf30b8a1bb4e848e 2023-07-19 19:12:34,339 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithSkipTmp/d58887d6a09503adc64d91b264e86133/.tmp/cf/8697b1462e704d0baf30b8a1bb4e848e as hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithSkipTmp/d58887d6a09503adc64d91b264e86133/cf/8697b1462e704d0baf30b8a1bb4e848e 2023-07-19 19:12:34,344 INFO [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithSkipTmp/d58887d6a09503adc64d91b264e86133/cf/8697b1462e704d0baf30b8a1bb4e848e, entries=5, sequenceid=6, filesize=5.8 K 2023-07-19 19:12:34,345 INFO [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for d58887d6a09503adc64d91b264e86133 in 459ms, sequenceid=6, compaction requested=false 2023-07-19 19:12:34,347 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d58887d6a09503adc64d91b264e86133: 2023-07-19 19:12:34,347 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689793952457.d58887d6a09503adc64d91b264e86133.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:34,347 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 19:12:34,347 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithSkipTmp/d58887d6a09503adc64d91b264e86133/cf/8697b1462e704d0baf30b8a1bb4e848e] hfiles 2023-07-19 19:12:34,347 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithSkipTmp/d58887d6a09503adc64d91b264e86133/cf/8697b1462e704d0baf30b8a1bb4e848e for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:34,357 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689793952457.d58887d6a09503adc64d91b264e86133. completed. 2023-07-19 19:12:34,357 DEBUG [rs(jenkins-hbase4.apache.org,46111,1689793835594)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689793952457.d58887d6a09503adc64d91b264e86133. 2023-07-19 19:12:34,357 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 19:12:34,357 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 19:12:34,357 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:34,357 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 19:12:34,358 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46111,1689793835594' in zk 2023-07-19 19:12:34,359 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:34,359 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 19:12:34,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:34,359 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:12:34,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:34,359 DEBUG [member: 'jenkins-hbase4.apache.org,46111,1689793835594' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 19:12:34,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:34,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:34,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:34,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:34,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:34,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:34,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:34,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:34,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:34,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:34,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:34,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:34,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,46111,1689793835594': 2023-07-19 19:12:34,365 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46111,1689793835594' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-19 19:12:34,365 INFO [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-19 19:12:34,365 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 19:12:34,365 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 19:12:34,365 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:34,365 INFO [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 19:12:34,367 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:34,367 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:34,367 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:34,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:34,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:34,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 19:12:34,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 19:12:34,367 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:34,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:34,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:34,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:34,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:34,367 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:34,367 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:34,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:34,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 19:12:34,367 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:34,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:34,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:34,368 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:34,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:34,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:34,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:34,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:34,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:34,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:34,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:34,369 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:34,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:34,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 19:12:34,369 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:34,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:34,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:34,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:34,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:34,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 19:12:34,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:34,373 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:34,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:34,374 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:34,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:34,374 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:34,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:34,377 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:34,377 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:34,377 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 19:12:34,377 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:34,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:34,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:34,378 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:34,378 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:34,378 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 19:12:34,378 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:34,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:34,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:34,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 19:12:34,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 19:12:34,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:34,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:34,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:34,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:34,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 19:12:34,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 19:12:34,379 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:34,379 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:34,379 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:34,379 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:34,379 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:34,379 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:12:34,379 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:34,379 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:34,379 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:34,379 DEBUG [(jenkins-hbase4.apache.org,37769,1689793834010)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 19:12:34,379 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:34,381 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:34,381 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:34,381 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-19 19:12:34,382 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230719ad68a15c3b704d6485a0d606707c31ef, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307199f4ec37888c74a4682d471428932e2c1] mob files 2023-07-19 19:12:34,382 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230719ad68a15c3b704d6485a0d606707c31ef 2023-07-19 19:12:34,382 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307199f4ec37888c74a4682d471428932e2c1 2023-07-19 19:12:34,395 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:34,396 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:34,416 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:12:34,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 19:12:34,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 19:12:34,417 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-19 19:12:34,437 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:34,485 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-19 19:12:34,485 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:34,485 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:34,485 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689793953809Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689793954395 (+586 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689793954395Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689793954395Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689793954405 (+10 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689793954425 (+20 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689793954485 (+60 ms) 2023-07-19 19:12:34,489 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 19:12:34,492 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 678 msec 2023-07-19 19:12:34,918 DEBUG [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 19:12:34,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 19:12:34,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 19:12:34,919 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793954919 2023-07-19 19:12:34,919 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43367, tgtDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793954919, rawTgtDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793954919, srcFsUri=hdfs://localhost:43367, srcDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978 2023-07-19 19:12:34,951 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43367, inputRoot=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978 2023-07-19 19:12:34,951 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1263973641_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793954919, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793954919/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:34,951 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43367, inputRoot=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978, snapshotDir=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-19 19:12:34,963 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793954919/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:34,996 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:34,996 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:34,997 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:34,997 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:34,997 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:34,998 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:34,998 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:35,097 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/hadoop-4468626436954370665.jar 2023-07-19 19:12:35,097 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:35,098 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:35,098 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:35,099 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:35,099 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:35,100 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 19:12:35,100 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 19:12:35,101 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 19:12:35,102 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 19:12:35,102 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 19:12:35,103 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 19:12:35,103 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 19:12:35,104 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 19:12:35,105 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 19:12:35,105 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 19:12:35,106 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 19:12:35,107 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:12:35,107 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:12:35,108 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 19:12:35,108 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:12:35,108 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 19:12:35,109 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 19:12:35,111 DEBUG [Listener at jenkins-hbase4.apache.org/42871] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 19:12:36,305 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843898_0006_000001 (auth:SIMPLE) 2023-07-19 19:12:36,322 WARN [Listener at jenkins-hbase4.apache.org/42871] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 19:12:36,324 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-19 19:12:36,326 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-19 19:12:36,443 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 19:12:36,443 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 19:12:37,318 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843898_0007_000001 (auth:SIMPLE) 2023-07-19 19:12:37,837 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 19:12:42,993 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843898_0007_000001 (auth:SIMPLE) 2023-07-19 19:12:45,334 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843898_0007_000001 (auth:SIMPLE) 2023-07-19 19:12:49,297 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843898_0007_000001 (auth:SIMPLE) 2023-07-19 19:12:50,610 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 19:12:50,610 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 19:12:50,625 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:50,625 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 19:12:50,626 INFO [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 19:12:50,626 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1054544951_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:50,626 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(367): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-19 19:12:50,626 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(367): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-19 19:12:50,627 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1054544951_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793954919/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793954919/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:50,627 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(367): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793954919/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-19 19:12:50,627 DEBUG [Listener at jenkins-hbase4.apache.org/42871] snapshot.TestExportSnapshot(367): hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/export-test/export-1689793954919/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-19 19:12:50,635 INFO [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:50,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:50,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:50,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-19 19:12:50,643 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793970643"}]},"ts":"1689793970643"} 2023-07-19 19:12:50,645 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-19 19:12:50,646 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-19 19:12:50,647 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d58887d6a09503adc64d91b264e86133, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=05862531789adc5dc35e07b0f578ba9b, UNASSIGN}] 2023-07-19 19:12:50,649 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d58887d6a09503adc64d91b264e86133, UNASSIGN 2023-07-19 19:12:50,649 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=05862531789adc5dc35e07b0f578ba9b, UNASSIGN 2023-07-19 19:12:50,650 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=d58887d6a09503adc64d91b264e86133, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:12:50,650 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=05862531789adc5dc35e07b0f578ba9b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:12:50,650 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689793952457.d58887d6a09503adc64d91b264e86133.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689793970650"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793970650"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793970650"}]},"ts":"1689793970650"} 2023-07-19 19:12:50,650 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689793952457.05862531789adc5dc35e07b0f578ba9b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689793970650"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689793970650"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689793970650"}]},"ts":"1689793970650"} 2023-07-19 19:12:50,652 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure d58887d6a09503adc64d91b264e86133, server=jenkins-hbase4.apache.org,46111,1689793835594}] 2023-07-19 19:12:50,653 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 05862531789adc5dc35e07b0f578ba9b, server=jenkins-hbase4.apache.org,40791,1689793835731}] 2023-07-19 19:12:50,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-19 19:12:50,804 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d58887d6a09503adc64d91b264e86133 2023-07-19 19:12:50,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d58887d6a09503adc64d91b264e86133, disabling compactions & flushes 2023-07-19 19:12:50,804 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689793952457.d58887d6a09503adc64d91b264e86133. 2023-07-19 19:12:50,805 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689793952457.d58887d6a09503adc64d91b264e86133. 2023-07-19 19:12:50,805 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689793952457.d58887d6a09503adc64d91b264e86133. after waiting 0 ms 2023-07-19 19:12:50,805 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689793952457.d58887d6a09503adc64d91b264e86133. 2023-07-19 19:12:50,805 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 05862531789adc5dc35e07b0f578ba9b 2023-07-19 19:12:50,805 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 05862531789adc5dc35e07b0f578ba9b, disabling compactions & flushes 2023-07-19 19:12:50,806 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689793952457.05862531789adc5dc35e07b0f578ba9b. 2023-07-19 19:12:50,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689793952457.05862531789adc5dc35e07b0f578ba9b. 2023-07-19 19:12:50,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689793952457.05862531789adc5dc35e07b0f578ba9b. after waiting 0 ms 2023-07-19 19:12:50,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689793952457.05862531789adc5dc35e07b0f578ba9b. 2023-07-19 19:12:50,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithSkipTmp/05862531789adc5dc35e07b0f578ba9b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 19:12:50,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:12:50,856 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689793952457.05862531789adc5dc35e07b0f578ba9b. 2023-07-19 19:12:50,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 05862531789adc5dc35e07b0f578ba9b: 2023-07-19 19:12:50,861 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 05862531789adc5dc35e07b0f578ba9b 2023-07-19 19:12:50,862 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=05862531789adc5dc35e07b0f578ba9b, regionState=CLOSED 2023-07-19 19:12:50,862 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689793952457.05862531789adc5dc35e07b0f578ba9b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689793970862"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793970862"}]},"ts":"1689793970862"} 2023-07-19 19:12:50,865 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-19 19:12:50,865 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 05862531789adc5dc35e07b0f578ba9b, server=jenkins-hbase4.apache.org,40791,1689793835731 in 210 msec 2023-07-19 19:12:50,867 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=05862531789adc5dc35e07b0f578ba9b, UNASSIGN in 218 msec 2023-07-19 19:12:50,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/default/testtb-testExportFileSystemStateWithSkipTmp/d58887d6a09503adc64d91b264e86133/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 19:12:50,877 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:12:50,879 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689793952457.d58887d6a09503adc64d91b264e86133. 2023-07-19 19:12:50,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d58887d6a09503adc64d91b264e86133: 2023-07-19 19:12:50,885 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d58887d6a09503adc64d91b264e86133 2023-07-19 19:12:50,886 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=d58887d6a09503adc64d91b264e86133, regionState=CLOSED 2023-07-19 19:12:50,886 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689793952457.d58887d6a09503adc64d91b264e86133.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689793970886"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689793970886"}]},"ts":"1689793970886"} 2023-07-19 19:12:50,889 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-19 19:12:50,890 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure d58887d6a09503adc64d91b264e86133, server=jenkins-hbase4.apache.org,46111,1689793835594 in 236 msec 2023-07-19 19:12:50,892 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-19 19:12:50,892 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d58887d6a09503adc64d91b264e86133, UNASSIGN in 243 msec 2023-07-19 19:12:50,899 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689793970899"}]},"ts":"1689793970899"} 2023-07-19 19:12:50,901 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-19 19:12:50,903 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-19 19:12:50,906 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 270 msec 2023-07-19 19:12:50,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-19 19:12:50,942 INFO [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-19 19:12:50,943 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:50,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:50,947 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:50,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:50,948 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:50,950 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40791] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:50,953 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:50,953 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:50,953 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:50,953 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:50,954 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-19 19:12:50,954 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-19 19:12:50,954 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-19 19:12:50,954 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-19 19:12:50,956 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d58887d6a09503adc64d91b264e86133 2023-07-19 19:12:50,957 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:50,957 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:50,957 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:50,957 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:50,957 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:50,957 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:50,957 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:50,957 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 19:12:50,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-19 19:12:50,959 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/05862531789adc5dc35e07b0f578ba9b 2023-07-19 19:12:50,959 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d58887d6a09503adc64d91b264e86133/cf, FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d58887d6a09503adc64d91b264e86133/recovered.edits] 2023-07-19 19:12:50,962 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/05862531789adc5dc35e07b0f578ba9b/cf, FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/05862531789adc5dc35e07b0f578ba9b/recovered.edits] 2023-07-19 19:12:50,974 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/05862531789adc5dc35e07b0f578ba9b/cf/3bb39469821448ea9cd826b3de8d71ed to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/05862531789adc5dc35e07b0f578ba9b/cf/3bb39469821448ea9cd826b3de8d71ed 2023-07-19 19:12:50,975 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d58887d6a09503adc64d91b264e86133/cf/8697b1462e704d0baf30b8a1bb4e848e to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/d58887d6a09503adc64d91b264e86133/cf/8697b1462e704d0baf30b8a1bb4e848e 2023-07-19 19:12:50,978 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/05862531789adc5dc35e07b0f578ba9b/recovered.edits/9.seqid to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/05862531789adc5dc35e07b0f578ba9b/recovered.edits/9.seqid 2023-07-19 19:12:50,979 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d58887d6a09503adc64d91b264e86133/recovered.edits/9.seqid to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/d58887d6a09503adc64d91b264e86133/recovered.edits/9.seqid 2023-07-19 19:12:50,979 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/05862531789adc5dc35e07b0f578ba9b 2023-07-19 19:12:50,979 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d58887d6a09503adc64d91b264e86133 2023-07-19 19:12:50,979 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-19 19:12:50,980 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-19 19:12:50,981 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-19 19:12:50,987 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230719ad68a15c3b704d6485a0d606707c31ef to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230719ad68a15c3b704d6485a0d606707c31ef 2023-07-19 19:12:50,989 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307199f4ec37888c74a4682d471428932e2c1 to hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307199f4ec37888c74a4682d471428932e2c1 2023-07-19 19:12:50,989 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-19 19:12:50,992 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:50,994 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-19 19:12:50,997 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-19 19:12:50,998 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:50,998 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-19 19:12:50,999 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689793952457.d58887d6a09503adc64d91b264e86133.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689793970998"}]},"ts":"9223372036854775807"} 2023-07-19 19:12:50,999 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689793952457.05862531789adc5dc35e07b0f578ba9b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689793970998"}]},"ts":"9223372036854775807"} 2023-07-19 19:12:51,012 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 19:12:51,012 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d58887d6a09503adc64d91b264e86133, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689793952457.d58887d6a09503adc64d91b264e86133.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 05862531789adc5dc35e07b0f578ba9b, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689793952457.05862531789adc5dc35e07b0f578ba9b.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 19:12:51,012 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-19 19:12:51,012 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689793971012"}]},"ts":"9223372036854775807"} 2023-07-19 19:12:51,014 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-19 19:12:51,017 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:51,020 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 74 msec 2023-07-19 19:12:51,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-19 19:12:51,060 INFO [Listener at jenkins-hbase4.apache.org/42871] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-19 19:12:51,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-19 19:12:51,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:51,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-19 19:12:51,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37769] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 19:12:51,107 INFO [Listener at jenkins-hbase4.apache.org/42871] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765 (was 762) Potentially hanging thread: hconnection-0x1164f60d-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2019023498_1 at /127.0.0.1:47748 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5549 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x1164f60d-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2019023498_1 at /127.0.0.1:36760 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1164f60d-shared-pool-46 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1054544951_17 at /127.0.0.1:56436 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1054544951_17 at /127.0.0.1:42014 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1054544951_17 at /127.0.0.1:34964 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1164f60d-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (274932937) connection to jenkins-hbase4.apache.org/172.31.14.131:39103 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=916 (was 904) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=680 (was 601) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 181), AvailableMemoryMB=1718 (was 1971) 2023-07-19 19:12:51,108 WARN [Listener at jenkins-hbase4.apache.org/42871] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-19 19:12:51,108 INFO [Listener at jenkins-hbase4.apache.org/42871] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-19 19:12:51,128 INFO [Listener at jenkins-hbase4.apache.org/42871] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 19:12:55,481 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689793843898_0007_000001 (auth:SIMPLE) 2023-07-19 19:12:56,443 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 19:13:05,156 INFO [Listener at jenkins-hbase4.apache.org/42871] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 19:13:19,276 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-19 19:13:19,276 INFO [Listener at jenkins-hbase4.apache.org/42871] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 19:13:19,397 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-19 19:13:19,413 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-19 19:13:19,414 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-19 19:13:19,455 INFO [Listener at jenkins-hbase4.apache.org/42871] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 19:13:19,568 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-19 19:13:19,568 INFO [Listener at jenkins-hbase4.apache.org/42871] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-19 19:13:19,569 INFO [Listener at jenkins-hbase4.apache.org/42871] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-19 19:13:19,569 INFO [Listener at jenkins-hbase4.apache.org/42871] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-19 19:13:19,569 DEBUG [Listener at jenkins-hbase4.apache.org/42871] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x416d673c to 127.0.0.1:58293 2023-07-19 19:13:19,569 DEBUG [Listener at jenkins-hbase4.apache.org/42871] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:13:19,569 DEBUG [Listener at jenkins-hbase4.apache.org/42871] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-19 19:13:19,569 DEBUG [Listener at jenkins-hbase4.apache.org/42871] util.JVMClusterUtil(257): Found active master hash=2095043435, stopped=false 2023-07-19 19:13:19,569 DEBUG [Listener at jenkins-hbase4.apache.org/42871] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:13:19,569 DEBUG [Listener at jenkins-hbase4.apache.org/42871] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-19 19:13:19,569 INFO [Listener at jenkins-hbase4.apache.org/42871] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,37769,1689793834010 2023-07-19 19:13:19,573 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 19:13:19,573 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 19:13:19,573 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 19:13:19,573 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 19:13:19,573 INFO [Listener at jenkins-hbase4.apache.org/42871] procedure2.ProcedureExecutor(629): Stopping 2023-07-19 19:13:19,573 DEBUG [Listener at jenkins-hbase4.apache.org/42871] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1b71b91e to 127.0.0.1:58293 2023-07-19 19:13:19,573 DEBUG [Listener at jenkins-hbase4.apache.org/42871] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:13:19,573 INFO [Listener at jenkins-hbase4.apache.org/42871] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46111,1689793835594' ***** 2023-07-19 19:13:19,574 DEBUG [Listener at jenkins-hbase4.apache.org/42871] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:13:19,574 INFO [Listener at jenkins-hbase4.apache.org/42871] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-19 19:13:19,574 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 19:13:19,574 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 19:13:19,575 INFO [RS:0;jenkins-hbase4:46111] regionserver.HeapMemoryManager(220): Stopping 2023-07-19 19:13:19,575 INFO [RS:0;jenkins-hbase4:46111] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-19 19:13:19,575 INFO [RS:0;jenkins-hbase4:46111] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-19 19:13:19,575 INFO [RS:0;jenkins-hbase4:46111] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:13:19,576 DEBUG [RS:0;jenkins-hbase4:46111] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a2eeaea to 127.0.0.1:58293 2023-07-19 19:13:19,576 DEBUG [RS:0;jenkins-hbase4:46111] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:13:19,574 INFO [Listener at jenkins-hbase4.apache.org/42871] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45693,1689793835672' ***** 2023-07-19 19:13:19,581 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-19 19:13:19,579 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 19:13:19,579 INFO [RS:0;jenkins-hbase4:46111] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46111,1689793835594; all regions closed. 2023-07-19 19:13:19,574 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 19:13:19,574 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 19:13:19,585 DEBUG [Listener at jenkins-hbase4.apache.org/42871] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:13:19,585 INFO [Listener at jenkins-hbase4.apache.org/42871] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-19 19:13:19,585 INFO [Listener at jenkins-hbase4.apache.org/42871] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40791,1689793835731' ***** 2023-07-19 19:13:19,586 DEBUG [Listener at jenkins-hbase4.apache.org/42871] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:13:19,586 INFO [RS:1;jenkins-hbase4:45693] regionserver.HeapMemoryManager(220): Stopping 2023-07-19 19:13:19,586 INFO [RS:1;jenkins-hbase4:45693] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-19 19:13:19,586 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-19 19:13:19,586 INFO [Listener at jenkins-hbase4.apache.org/42871] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-19 19:13:19,586 INFO [RS:1;jenkins-hbase4:45693] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-19 19:13:19,588 INFO [RS:1;jenkins-hbase4:45693] regionserver.HRegionServer(3305): Received CLOSE for 8249fd75ae928a70fcb60e633db01d47 2023-07-19 19:13:19,589 INFO [RS:1;jenkins-hbase4:45693] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:13:19,589 DEBUG [RS:1;jenkins-hbase4:45693] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1be1f3c3 to 127.0.0.1:58293 2023-07-19 19:13:19,589 DEBUG [RS:1;jenkins-hbase4:45693] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:13:19,590 INFO [RS:2;jenkins-hbase4:40791] regionserver.HeapMemoryManager(220): Stopping 2023-07-19 19:13:19,598 INFO [RS:2;jenkins-hbase4:40791] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-19 19:13:19,598 INFO [RS:2;jenkins-hbase4:40791] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-19 19:13:19,598 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-19 19:13:19,590 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8249fd75ae928a70fcb60e633db01d47, disabling compactions & flushes 2023-07-19 19:13:19,598 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689793838738.8249fd75ae928a70fcb60e633db01d47. 2023-07-19 19:13:19,598 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689793838738.8249fd75ae928a70fcb60e633db01d47. 2023-07-19 19:13:19,598 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689793838738.8249fd75ae928a70fcb60e633db01d47. after waiting 0 ms 2023-07-19 19:13:19,598 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689793838738.8249fd75ae928a70fcb60e633db01d47. 2023-07-19 19:13:19,598 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 8249fd75ae928a70fcb60e633db01d47 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-19 19:13:19,599 INFO [RS:2;jenkins-hbase4:40791] regionserver.HRegionServer(3305): Received CLOSE for d9649b1716be71c1e4890f6a127b36b2 2023-07-19 19:13:19,599 INFO [RS:2;jenkins-hbase4:40791] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:13:19,599 DEBUG [RS:2;jenkins-hbase4:40791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x006fef8e to 127.0.0.1:58293 2023-07-19 19:13:19,599 DEBUG [RS:2;jenkins-hbase4:40791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:13:19,616 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d9649b1716be71c1e4890f6a127b36b2, disabling compactions & flushes 2023-07-19 19:13:19,616 INFO [RS:2;jenkins-hbase4:40791] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-19 19:13:19,616 INFO [RS:1;jenkins-hbase4:45693] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-19 19:13:19,616 DEBUG [RS:1;jenkins-hbase4:45693] regionserver.HRegionServer(1478): Online Regions={8249fd75ae928a70fcb60e633db01d47=hbase:namespace,,1689793838738.8249fd75ae928a70fcb60e633db01d47.} 2023-07-19 19:13:19,616 INFO [RS:2;jenkins-hbase4:40791] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-19 19:13:19,617 INFO [RS:2;jenkins-hbase4:40791] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-19 19:13:19,616 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689793839616.d9649b1716be71c1e4890f6a127b36b2. 2023-07-19 19:13:19,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689793839616.d9649b1716be71c1e4890f6a127b36b2. 2023-07-19 19:13:19,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689793839616.d9649b1716be71c1e4890f6a127b36b2. after waiting 0 ms 2023-07-19 19:13:19,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689793839616.d9649b1716be71c1e4890f6a127b36b2. 2023-07-19 19:13:19,617 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing d9649b1716be71c1e4890f6a127b36b2 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-19 19:13:19,617 INFO [RS:2;jenkins-hbase4:40791] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-19 19:13:19,617 DEBUG [RS:1;jenkins-hbase4:45693] regionserver.HRegionServer(1504): Waiting on 8249fd75ae928a70fcb60e633db01d47 2023-07-19 19:13:19,619 INFO [RS:2;jenkins-hbase4:40791] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-19 19:13:19,619 DEBUG [RS:2;jenkins-hbase4:40791] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, d9649b1716be71c1e4890f6a127b36b2=hbase:acl,,1689793839616.d9649b1716be71c1e4890f6a127b36b2.} 2023-07-19 19:13:19,619 DEBUG [RS:2;jenkins-hbase4:40791] regionserver.HRegionServer(1504): Waiting on 1588230740, d9649b1716be71c1e4890f6a127b36b2 2023-07-19 19:13:19,629 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-19 19:13:19,629 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-19 19:13:19,629 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-19 19:13:19,629 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-19 19:13:19,629 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-19 19:13:19,629 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-19 19:13:19,676 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-19 19:13:19,676 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-19 19:13:19,676 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-19 19:13:19,688 DEBUG [RS:0;jenkins-hbase4:46111] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/oldWALs 2023-07-19 19:13:19,688 INFO [RS:0;jenkins-hbase4:46111] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46111%2C1689793835594:(num 1689793838021) 2023-07-19 19:13:19,688 DEBUG [RS:0;jenkins-hbase4:46111] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:13:19,688 INFO [RS:0;jenkins-hbase4:46111] regionserver.LeaseManager(133): Closed leases 2023-07-19 19:13:19,707 INFO [RS:0;jenkins-hbase4:46111] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-19 19:13:19,711 INFO [RS:0;jenkins-hbase4:46111] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-19 19:13:19,711 INFO [RS:0;jenkins-hbase4:46111] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-19 19:13:19,711 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 19:13:19,712 INFO [RS:0;jenkins-hbase4:46111] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-19 19:13:19,713 INFO [RS:0;jenkins-hbase4:46111] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46111 2023-07-19 19:13:19,724 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 19:13:19,724 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:13:19,725 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 19:13:19,725 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:13:19,725 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 19:13:19,725 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/acl/d9649b1716be71c1e4890f6a127b36b2/.tmp/l/c4587682a9be4ace95266f24ecbd8341 2023-07-19 19:13:19,725 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46111,1689793835594 2023-07-19 19:13:19,725 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 19:13:19,725 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46111,1689793835594] 2023-07-19 19:13:19,726 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46111,1689793835594; numProcessing=1 2023-07-19 19:13:19,729 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46111,1689793835594 already deleted, retry=false 2023-07-19 19:13:19,729 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46111,1689793835594 expired; onlineServers=2 2023-07-19 19:13:19,733 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/namespace/8249fd75ae928a70fcb60e633db01d47/.tmp/info/2ae615aeefa24dc7b727aaaa33e0adba 2023-07-19 19:13:19,739 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/meta/1588230740/.tmp/info/749a9f36805b4d2f9290ba55df45d6b4 2023-07-19 19:13:19,742 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4587682a9be4ace95266f24ecbd8341 2023-07-19 19:13:19,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/acl/d9649b1716be71c1e4890f6a127b36b2/.tmp/l/c4587682a9be4ace95266f24ecbd8341 as hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/acl/d9649b1716be71c1e4890f6a127b36b2/l/c4587682a9be4ace95266f24ecbd8341 2023-07-19 19:13:19,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/namespace/8249fd75ae928a70fcb60e633db01d47/.tmp/info/2ae615aeefa24dc7b727aaaa33e0adba as hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/namespace/8249fd75ae928a70fcb60e633db01d47/info/2ae615aeefa24dc7b727aaaa33e0adba 2023-07-19 19:13:19,745 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 749a9f36805b4d2f9290ba55df45d6b4 2023-07-19 19:13:19,753 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4587682a9be4ace95266f24ecbd8341 2023-07-19 19:13:19,753 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/acl/d9649b1716be71c1e4890f6a127b36b2/l/c4587682a9be4ace95266f24ecbd8341, entries=7, sequenceid=18, filesize=5.2 K 2023-07-19 19:13:19,755 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for d9649b1716be71c1e4890f6a127b36b2 in 138ms, sequenceid=18, compaction requested=false 2023-07-19 19:13:19,763 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/namespace/8249fd75ae928a70fcb60e633db01d47/info/2ae615aeefa24dc7b727aaaa33e0adba, entries=2, sequenceid=6, filesize=4.8 K 2023-07-19 19:13:19,764 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 8249fd75ae928a70fcb60e633db01d47 in 166ms, sequenceid=6, compaction requested=false 2023-07-19 19:13:19,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/acl/d9649b1716be71c1e4890f6a127b36b2/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-19 19:13:19,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/namespace/8249fd75ae928a70fcb60e633db01d47/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 19:13:19,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:13:19,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:13:19,776 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689793839616.d9649b1716be71c1e4890f6a127b36b2. 2023-07-19 19:13:19,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d9649b1716be71c1e4890f6a127b36b2: 2023-07-19 19:13:19,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689793839616.d9649b1716be71c1e4890f6a127b36b2. 2023-07-19 19:13:19,777 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689793838738.8249fd75ae928a70fcb60e633db01d47. 2023-07-19 19:13:19,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8249fd75ae928a70fcb60e633db01d47: 2023-07-19 19:13:19,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689793838738.8249fd75ae928a70fcb60e633db01d47. 2023-07-19 19:13:19,779 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/meta/1588230740/.tmp/rep_barrier/0a90d227a5f944e092250ef9a77a800c 2023-07-19 19:13:19,784 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0a90d227a5f944e092250ef9a77a800c 2023-07-19 19:13:19,797 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/meta/1588230740/.tmp/table/21566dd3059149dc8619da87be767c47 2023-07-19 19:13:19,801 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 21566dd3059149dc8619da87be767c47 2023-07-19 19:13:19,802 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/meta/1588230740/.tmp/info/749a9f36805b4d2f9290ba55df45d6b4 as hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/meta/1588230740/info/749a9f36805b4d2f9290ba55df45d6b4 2023-07-19 19:13:19,807 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 749a9f36805b4d2f9290ba55df45d6b4 2023-07-19 19:13:19,807 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/meta/1588230740/info/749a9f36805b4d2f9290ba55df45d6b4, entries=48, sequenceid=131, filesize=10.3 K 2023-07-19 19:13:19,808 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/meta/1588230740/.tmp/rep_barrier/0a90d227a5f944e092250ef9a77a800c as hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/meta/1588230740/rep_barrier/0a90d227a5f944e092250ef9a77a800c 2023-07-19 19:13:19,812 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0a90d227a5f944e092250ef9a77a800c 2023-07-19 19:13:19,812 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/meta/1588230740/rep_barrier/0a90d227a5f944e092250ef9a77a800c, entries=13, sequenceid=131, filesize=6.4 K 2023-07-19 19:13:19,813 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/meta/1588230740/.tmp/table/21566dd3059149dc8619da87be767c47 as hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/meta/1588230740/table/21566dd3059149dc8619da87be767c47 2023-07-19 19:13:19,818 INFO [RS:1;jenkins-hbase4:45693] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45693,1689793835672; all regions closed. 2023-07-19 19:13:19,819 DEBUG [RS:2;jenkins-hbase4:40791] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-19 19:13:19,820 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 21566dd3059149dc8619da87be767c47 2023-07-19 19:13:19,820 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/meta/1588230740/table/21566dd3059149dc8619da87be767c47, entries=24, sequenceid=131, filesize=6.9 K 2023-07-19 19:13:19,821 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 192ms, sequenceid=131, compaction requested=false 2023-07-19 19:13:19,825 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-19 19:13:19,825 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-19 19:13:19,828 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 19:13:19,828 INFO [RS:0;jenkins-hbase4:46111] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46111,1689793835594; zookeeper connection closed. 2023-07-19 19:13:19,828 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:46111-0x1017efe2b740001, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 19:13:19,829 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2e50b26f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2e50b26f 2023-07-19 19:13:19,838 DEBUG [RS:1;jenkins-hbase4:45693] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/oldWALs 2023-07-19 19:13:19,838 INFO [RS:1;jenkins-hbase4:45693] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45693%2C1689793835672:(num 1689793838012) 2023-07-19 19:13:19,839 DEBUG [RS:1;jenkins-hbase4:45693] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:13:19,839 INFO [RS:1;jenkins-hbase4:45693] regionserver.LeaseManager(133): Closed leases 2023-07-19 19:13:19,839 INFO [RS:1;jenkins-hbase4:45693] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-19 19:13:19,840 INFO [RS:1;jenkins-hbase4:45693] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-19 19:13:19,840 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 19:13:19,840 INFO [RS:1;jenkins-hbase4:45693] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-19 19:13:19,840 INFO [RS:1;jenkins-hbase4:45693] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-19 19:13:19,840 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-19 19:13:19,841 INFO [RS:1;jenkins-hbase4:45693] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45693 2023-07-19 19:13:19,842 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 19:13:19,842 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-19 19:13:19,842 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-19 19:13:19,842 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-19 19:13:19,842 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-19 19:13:19,843 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:13:19,843 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 19:13:19,843 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45693,1689793835672 2023-07-19 19:13:19,844 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45693,1689793835672] 2023-07-19 19:13:19,844 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45693,1689793835672; numProcessing=2 2023-07-19 19:13:19,845 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45693,1689793835672 already deleted, retry=false 2023-07-19 19:13:19,845 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45693,1689793835672 expired; onlineServers=1 2023-07-19 19:13:19,858 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-19 19:13:19,859 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-19 19:13:19,944 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 19:13:19,944 INFO [RS:1;jenkins-hbase4:45693] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45693,1689793835672; zookeeper connection closed. 2023-07-19 19:13:19,944 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:45693-0x1017efe2b740002, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 19:13:19,945 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@60a35516] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@60a35516 2023-07-19 19:13:20,019 INFO [RS:2;jenkins-hbase4:40791] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40791,1689793835731; all regions closed. 2023-07-19 19:13:20,027 DEBUG [RS:2;jenkins-hbase4:40791] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/oldWALs 2023-07-19 19:13:20,027 INFO [RS:2;jenkins-hbase4:40791] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40791%2C1689793835731.meta:.meta(num 1689793838353) 2023-07-19 19:13:20,037 DEBUG [RS:2;jenkins-hbase4:40791] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/oldWALs 2023-07-19 19:13:20,037 INFO [RS:2;jenkins-hbase4:40791] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40791%2C1689793835731:(num 1689793838024) 2023-07-19 19:13:20,037 DEBUG [RS:2;jenkins-hbase4:40791] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:13:20,037 INFO [RS:2;jenkins-hbase4:40791] regionserver.LeaseManager(133): Closed leases 2023-07-19 19:13:20,037 INFO [RS:2;jenkins-hbase4:40791] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-19 19:13:20,038 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 19:13:20,039 INFO [RS:2;jenkins-hbase4:40791] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40791 2023-07-19 19:13:20,041 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40791,1689793835731 2023-07-19 19:13:20,041 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 19:13:20,041 ERROR [Listener at localhost/44441-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3cf3e5e8 rejected from java.util.concurrent.ThreadPoolExecutor@38cc76ae[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 109] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1374) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:603) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-07-19 19:13:20,041 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40791,1689793835731] 2023-07-19 19:13:20,041 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40791,1689793835731; numProcessing=3 2023-07-19 19:13:20,043 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40791,1689793835731 already deleted, retry=false 2023-07-19 19:13:20,044 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40791,1689793835731 expired; onlineServers=0 2023-07-19 19:13:20,044 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37769,1689793834010' ***** 2023-07-19 19:13:20,044 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-19 19:13:20,044 DEBUG [M:0;jenkins-hbase4:37769] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3de2d950, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 19:13:20,044 INFO [M:0;jenkins-hbase4:37769] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37769,1689793834010 2023-07-19 19:13:20,044 INFO [M:0;jenkins-hbase4:37769] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37769,1689793834010; all regions closed. 2023-07-19 19:13:20,044 DEBUG [M:0;jenkins-hbase4:37769] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 19:13:20,044 DEBUG [M:0;jenkins-hbase4:37769] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-19 19:13:20,044 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-19 19:13:20,044 DEBUG [M:0;jenkins-hbase4:37769] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-19 19:13:20,044 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689793837423] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689793837423,5,FailOnTimeoutGroup] 2023-07-19 19:13:20,045 INFO [M:0;jenkins-hbase4:37769] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-19 19:13:20,045 INFO [M:0;jenkins-hbase4:37769] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-19 19:13:20,045 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689793837421] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689793837421,5,FailOnTimeoutGroup] 2023-07-19 19:13:20,045 INFO [M:0;jenkins-hbase4:37769] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-19 19:13:20,045 DEBUG [M:0;jenkins-hbase4:37769] master.HMaster(1512): Stopping service threads 2023-07-19 19:13:20,045 INFO [M:0;jenkins-hbase4:37769] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-19 19:13:20,045 ERROR [M:0;jenkins-hbase4:37769] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-19 19:13:20,046 INFO [M:0;jenkins-hbase4:37769] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-19 19:13:20,046 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-19 19:13:20,047 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-19 19:13:20,047 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 19:13:20,047 DEBUG [M:0;jenkins-hbase4:37769] zookeeper.ZKUtil(398): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-19 19:13:20,047 WARN [M:0;jenkins-hbase4:37769] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-19 19:13:20,047 INFO [M:0;jenkins-hbase4:37769] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-19 19:13:20,048 INFO [M:0;jenkins-hbase4:37769] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-19 19:13:20,048 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 19:13:20,048 DEBUG [M:0;jenkins-hbase4:37769] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-19 19:13:20,049 INFO [M:0;jenkins-hbase4:37769] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 19:13:20,049 DEBUG [M:0;jenkins-hbase4:37769] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 19:13:20,049 DEBUG [M:0;jenkins-hbase4:37769] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-19 19:13:20,049 DEBUG [M:0;jenkins-hbase4:37769] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 19:13:20,049 INFO [M:0;jenkins-hbase4:37769] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.95 KB heapSize=452.18 KB 2023-07-19 19:13:20,079 INFO [M:0;jenkins-hbase4:37769] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.95 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ede3f7daaae34c65b3aed3a4a9bc55a4 2023-07-19 19:13:20,083 INFO [M:0;jenkins-hbase4:37769] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ede3f7daaae34c65b3aed3a4a9bc55a4 2023-07-19 19:13:20,084 DEBUG [M:0;jenkins-hbase4:37769] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ede3f7daaae34c65b3aed3a4a9bc55a4 as hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ede3f7daaae34c65b3aed3a4a9bc55a4 2023-07-19 19:13:20,089 INFO [M:0;jenkins-hbase4:37769] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ede3f7daaae34c65b3aed3a4a9bc55a4 2023-07-19 19:13:20,089 INFO [M:0;jenkins-hbase4:37769] regionserver.HStore(1080): Added hdfs://localhost:43367/user/jenkins/test-data/dc85c6f3-10b6-0530-8d10-aafd15786978/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ede3f7daaae34c65b3aed3a4a9bc55a4, entries=119, sequenceid=899, filesize=28.7 K 2023-07-19 19:13:20,090 INFO [M:0;jenkins-hbase4:37769] regionserver.HRegion(2948): Finished flush of dataSize ~375.95 KB/384969, heapSize ~452.16 KB/463016, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 41ms, sequenceid=899, compaction requested=false 2023-07-19 19:13:20,092 INFO [M:0;jenkins-hbase4:37769] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 19:13:20,092 DEBUG [M:0;jenkins-hbase4:37769] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-19 19:13:20,097 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 19:13:20,097 INFO [M:0;jenkins-hbase4:37769] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-19 19:13:20,098 INFO [M:0;jenkins-hbase4:37769] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37769 2023-07-19 19:13:20,099 DEBUG [M:0;jenkins-hbase4:37769] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,37769,1689793834010 already deleted, retry=false 2023-07-19 19:13:20,143 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 19:13:20,143 INFO [RS:2;jenkins-hbase4:40791] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40791,1689793835731; zookeeper connection closed. 2023-07-19 19:13:20,143 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): regionserver:40791-0x1017efe2b740003, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 19:13:20,147 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@36d6be70] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@36d6be70 2023-07-19 19:13:20,148 INFO [Listener at jenkins-hbase4.apache.org/42871] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-19 19:13:20,201 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 19:13:20,201 DEBUG [Listener at localhost/44441-EventThread] zookeeper.ZKWatcher(600): master:37769-0x1017efe2b740000, quorum=127.0.0.1:58293, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 19:13:20,201 INFO [M:0;jenkins-hbase4:37769] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37769,1689793834010; zookeeper connection closed. 2023-07-19 19:13:20,203 WARN [Listener at jenkins-hbase4.apache.org/42871] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-19 19:13:20,210 INFO [Listener at jenkins-hbase4.apache.org/42871] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 19:13:20,314 WARN [BP-183832824-172.31.14.131-1689793829911 heartbeating to localhost/127.0.0.1:43367] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-19 19:13:20,314 WARN [BP-183832824-172.31.14.131-1689793829911 heartbeating to localhost/127.0.0.1:43367] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-183832824-172.31.14.131-1689793829911 (Datanode Uuid d5f7c849-9e9c-4d44-b929-f627d4d1fc35) service to localhost/127.0.0.1:43367 2023-07-19 19:13:20,316 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/cluster_2c362217-96ff-d8ab-49ae-f9e6c2163f5d/dfs/data/data5/current/BP-183832824-172.31.14.131-1689793829911] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 19:13:20,316 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/cluster_2c362217-96ff-d8ab-49ae-f9e6c2163f5d/dfs/data/data6/current/BP-183832824-172.31.14.131-1689793829911] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 19:13:20,317 WARN [Listener at jenkins-hbase4.apache.org/42871] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-19 19:13:20,325 INFO [Listener at jenkins-hbase4.apache.org/42871] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 19:13:20,428 WARN [BP-183832824-172.31.14.131-1689793829911 heartbeating to localhost/127.0.0.1:43367] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-19 19:13:20,428 WARN [BP-183832824-172.31.14.131-1689793829911 heartbeating to localhost/127.0.0.1:43367] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-183832824-172.31.14.131-1689793829911 (Datanode Uuid 0661f3f7-036d-4d35-897b-d1f78df5bfb0) service to localhost/127.0.0.1:43367 2023-07-19 19:13:20,429 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/cluster_2c362217-96ff-d8ab-49ae-f9e6c2163f5d/dfs/data/data3/current/BP-183832824-172.31.14.131-1689793829911] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 19:13:20,430 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/cluster_2c362217-96ff-d8ab-49ae-f9e6c2163f5d/dfs/data/data4/current/BP-183832824-172.31.14.131-1689793829911] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 19:13:20,436 WARN [Listener at jenkins-hbase4.apache.org/42871] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-19 19:13:20,438 INFO [Listener at jenkins-hbase4.apache.org/42871] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 19:13:20,542 WARN [BP-183832824-172.31.14.131-1689793829911 heartbeating to localhost/127.0.0.1:43367] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-19 19:13:20,542 WARN [BP-183832824-172.31.14.131-1689793829911 heartbeating to localhost/127.0.0.1:43367] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-183832824-172.31.14.131-1689793829911 (Datanode Uuid 5456848f-aac7-4428-8ab3-8bf0c283644f) service to localhost/127.0.0.1:43367 2023-07-19 19:13:20,543 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/cluster_2c362217-96ff-d8ab-49ae-f9e6c2163f5d/dfs/data/data1/current/BP-183832824-172.31.14.131-1689793829911] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 19:13:20,544 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/39b9608d-d46a-aefe-e946-d5aed3f8ad31/cluster_2c362217-96ff-d8ab-49ae-f9e6c2163f5d/dfs/data/data2/current/BP-183832824-172.31.14.131-1689793829911] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 19:13:20,572 INFO [Listener at jenkins-hbase4.apache.org/42871] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 19:13:20,713 INFO [Listener at jenkins-hbase4.apache.org/42871] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-19 19:13:20,840 INFO [Listener at jenkins-hbase4.apache.org/42871] hbase.HBaseTestingUtility(1293): Minicluster is down