2023-07-16 09:10:31,905 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-16 09:10:32,174 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9 2023-07-16 09:10:32,175 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-16 09:10:32,175 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-16 09:10:32,213 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-16 09:10:32,461 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-16 09:10:32,462 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/cluster_b4b9d27b-ece6-8fd0-070d-ff06f0633057, deleteOnExit=true 2023-07-16 09:10:32,462 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-16 09:10:32,463 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/test.cache.data in system properties and HBase conf 2023-07-16 09:10:32,463 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/hadoop.tmp.dir in system properties and HBase conf 2023-07-16 09:10:32,464 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/hadoop.log.dir in system properties and HBase conf 2023-07-16 09:10:32,464 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-16 09:10:32,465 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-16 09:10:32,465 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-16 09:10:32,851 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-16 09:10:32,858 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-16 09:10:32,859 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-16 09:10:32,859 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-16 09:10:32,860 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-16 09:10:32,860 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-16 09:10:32,861 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-16 09:10:32,864 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-16 09:10:32,865 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-16 09:10:32,866 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-16 09:10:32,866 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/nfs.dump.dir in system properties and HBase conf 2023-07-16 09:10:32,867 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/java.io.tmpdir in system properties and HBase conf 2023-07-16 09:10:32,867 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-16 09:10:32,868 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-16 09:10:32,868 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-16 09:10:33,498 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-16 09:10:33,502 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-16 09:10:33,787 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-16 09:10:33,968 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-16 09:10:33,988 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 09:10:34,025 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 09:10:34,057 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/java.io.tmpdir/Jetty_localhost_45197_hdfs____3xaxk/webapp 2023-07-16 09:10:34,224 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45197 2023-07-16 09:10:34,268 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-16 09:10:34,268 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-16 09:10:34,805 WARN [Listener at localhost/43477] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-16 09:10:34,910 WARN [Listener at localhost/43477] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-16 09:10:34,937 WARN [Listener at localhost/43477] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 09:10:34,948 INFO [Listener at localhost/43477] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 09:10:34,959 INFO [Listener at localhost/43477] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/java.io.tmpdir/Jetty_localhost_38241_datanode____5t6pw1/webapp 2023-07-16 09:10:35,104 INFO [Listener at localhost/43477] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38241 2023-07-16 09:10:35,568 WARN [Listener at localhost/35785] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-16 09:10:35,613 WARN [Listener at localhost/35785] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-16 09:10:35,619 WARN [Listener at localhost/35785] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 09:10:35,622 INFO [Listener at localhost/35785] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 09:10:35,631 INFO [Listener at localhost/35785] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/java.io.tmpdir/Jetty_localhost_38539_datanode____.kvqeyr/webapp 2023-07-16 09:10:35,752 INFO [Listener at localhost/35785] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38539 2023-07-16 09:10:35,765 WARN [Listener at localhost/33623] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-16 09:10:35,803 WARN [Listener at localhost/33623] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-16 09:10:35,807 WARN [Listener at localhost/33623] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 09:10:35,808 INFO [Listener at localhost/33623] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 09:10:35,823 INFO [Listener at localhost/33623] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/java.io.tmpdir/Jetty_localhost_41093_datanode____.e2ubqk/webapp 2023-07-16 09:10:35,989 INFO [Listener at localhost/33623] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41093 2023-07-16 09:10:36,032 WARN [Listener at localhost/39411] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-16 09:10:36,328 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfd3dc62dff1a770e: Processing first storage report for DS-d944664b-66c4-4325-aa9f-16b17d934d2c from datanode 97143709-4ac0-42dc-8bf4-4db3a889ac23 2023-07-16 09:10:36,329 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfd3dc62dff1a770e: from storage DS-d944664b-66c4-4325-aa9f-16b17d934d2c node DatanodeRegistration(127.0.0.1:45095, datanodeUuid=97143709-4ac0-42dc-8bf4-4db3a889ac23, infoPort=37849, infoSecurePort=0, ipcPort=35785, storageInfo=lv=-57;cid=testClusterID;nsid=1838970190;c=1689498633573), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-16 09:10:36,330 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8d01fc2602f7b765: Processing first storage report for DS-cd66a558-133e-41f9-ba9e-49328fdbe4cf from datanode 87ddf0fe-2473-42e8-aa36-00fc502b4dbf 2023-07-16 09:10:36,330 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8d01fc2602f7b765: from storage DS-cd66a558-133e-41f9-ba9e-49328fdbe4cf node DatanodeRegistration(127.0.0.1:36029, datanodeUuid=87ddf0fe-2473-42e8-aa36-00fc502b4dbf, infoPort=42707, infoSecurePort=0, ipcPort=33623, storageInfo=lv=-57;cid=testClusterID;nsid=1838970190;c=1689498633573), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-16 09:10:36,330 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xaa540f7431d17b59: Processing first storage report for DS-ddcd0d8d-8f22-4327-a28c-990bd23ded76 from datanode c908d5ed-fa9f-4707-98c1-faa58dbd9580 2023-07-16 09:10:36,330 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xaa540f7431d17b59: from storage DS-ddcd0d8d-8f22-4327-a28c-990bd23ded76 node DatanodeRegistration(127.0.0.1:34409, datanodeUuid=c908d5ed-fa9f-4707-98c1-faa58dbd9580, infoPort=46823, infoSecurePort=0, ipcPort=39411, storageInfo=lv=-57;cid=testClusterID;nsid=1838970190;c=1689498633573), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-16 09:10:36,331 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfd3dc62dff1a770e: Processing first storage report for DS-a5dd1bfc-8587-4f03-99d7-7c7f386e2fb4 from datanode 97143709-4ac0-42dc-8bf4-4db3a889ac23 2023-07-16 09:10:36,331 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfd3dc62dff1a770e: from storage DS-a5dd1bfc-8587-4f03-99d7-7c7f386e2fb4 node DatanodeRegistration(127.0.0.1:45095, datanodeUuid=97143709-4ac0-42dc-8bf4-4db3a889ac23, infoPort=37849, infoSecurePort=0, ipcPort=35785, storageInfo=lv=-57;cid=testClusterID;nsid=1838970190;c=1689498633573), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-16 09:10:36,331 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8d01fc2602f7b765: Processing first storage report for DS-0124cf2f-7979-4205-97d1-80d5806424b3 from datanode 87ddf0fe-2473-42e8-aa36-00fc502b4dbf 2023-07-16 09:10:36,332 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8d01fc2602f7b765: from storage DS-0124cf2f-7979-4205-97d1-80d5806424b3 node DatanodeRegistration(127.0.0.1:36029, datanodeUuid=87ddf0fe-2473-42e8-aa36-00fc502b4dbf, infoPort=42707, infoSecurePort=0, ipcPort=33623, storageInfo=lv=-57;cid=testClusterID;nsid=1838970190;c=1689498633573), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-16 09:10:36,332 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xaa540f7431d17b59: Processing first storage report for DS-1862369f-2f1d-4ea1-ae53-fdbbd15894a2 from datanode c908d5ed-fa9f-4707-98c1-faa58dbd9580 2023-07-16 09:10:36,332 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xaa540f7431d17b59: from storage DS-1862369f-2f1d-4ea1-ae53-fdbbd15894a2 node DatanodeRegistration(127.0.0.1:34409, datanodeUuid=c908d5ed-fa9f-4707-98c1-faa58dbd9580, infoPort=46823, infoSecurePort=0, ipcPort=39411, storageInfo=lv=-57;cid=testClusterID;nsid=1838970190;c=1689498633573), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-16 09:10:36,588 DEBUG [Listener at localhost/39411] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9 2023-07-16 09:10:36,697 INFO [Listener at localhost/39411] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/cluster_b4b9d27b-ece6-8fd0-070d-ff06f0633057/zookeeper_0, clientPort=64380, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/cluster_b4b9d27b-ece6-8fd0-070d-ff06f0633057/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/cluster_b4b9d27b-ece6-8fd0-070d-ff06f0633057/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-16 09:10:36,723 INFO [Listener at localhost/39411] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64380 2023-07-16 09:10:36,735 INFO [Listener at localhost/39411] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 09:10:36,738 INFO [Listener at localhost/39411] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 09:10:37,405 INFO [Listener at localhost/39411] util.FSUtils(471): Created version file at hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae with version=8 2023-07-16 09:10:37,405 INFO [Listener at localhost/39411] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/hbase-staging 2023-07-16 09:10:37,790 INFO [Listener at localhost/39411] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-16 09:10:38,467 INFO [Listener at localhost/39411] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-16 09:10:38,509 INFO [Listener at localhost/39411] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 09:10:38,509 INFO [Listener at localhost/39411] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-16 09:10:38,510 INFO [Listener at localhost/39411] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-16 09:10:38,510 INFO [Listener at localhost/39411] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 09:10:38,510 INFO [Listener at localhost/39411] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-16 09:10:38,691 INFO [Listener at localhost/39411] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-16 09:10:38,774 DEBUG [Listener at localhost/39411] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-16 09:10:38,877 INFO [Listener at localhost/39411] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46005 2023-07-16 09:10:38,893 INFO [Listener at localhost/39411] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 09:10:38,895 INFO [Listener at localhost/39411] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 09:10:38,920 INFO [Listener at localhost/39411] zookeeper.RecoverableZooKeeper(93): Process identifier=master:46005 connecting to ZooKeeper ensemble=127.0.0.1:64380 2023-07-16 09:10:38,975 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:460050x0, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-16 09:10:38,979 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:46005-0x1016d65d4800000 connected 2023-07-16 09:10:39,016 DEBUG [Listener at localhost/39411] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-16 09:10:39,018 DEBUG [Listener at localhost/39411] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 09:10:39,033 DEBUG [Listener at localhost/39411] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-16 09:10:39,042 DEBUG [Listener at localhost/39411] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46005 2023-07-16 09:10:39,043 DEBUG [Listener at localhost/39411] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46005 2023-07-16 09:10:39,043 DEBUG [Listener at localhost/39411] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46005 2023-07-16 09:10:39,046 DEBUG [Listener at localhost/39411] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46005 2023-07-16 09:10:39,046 DEBUG [Listener at localhost/39411] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46005 2023-07-16 09:10:39,054 INFO [Listener at localhost/39411] master.HMaster(444): hbase.rootdir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae, hbase.cluster.distributed=false 2023-07-16 09:10:39,118 INFO [Listener at localhost/39411] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-16 09:10:39,119 INFO [Listener at localhost/39411] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 09:10:39,119 INFO [Listener at localhost/39411] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-16 09:10:39,119 INFO [Listener at localhost/39411] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-16 09:10:39,119 INFO [Listener at localhost/39411] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 09:10:39,119 INFO [Listener at localhost/39411] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-16 09:10:39,125 INFO [Listener at localhost/39411] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-16 09:10:39,128 INFO [Listener at localhost/39411] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45805 2023-07-16 09:10:39,132 INFO [Listener at localhost/39411] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-16 09:10:39,141 INFO [Listener at localhost/39411] mob.MobFileCache(124): MobFileCache disabled 2023-07-16 09:10:39,143 INFO [Listener at localhost/39411] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 09:10:39,146 INFO [Listener at localhost/39411] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 09:10:39,148 INFO [Listener at localhost/39411] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45805 connecting to ZooKeeper ensemble=127.0.0.1:64380 2023-07-16 09:10:39,153 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:458050x0, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-16 09:10:39,155 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45805-0x1016d65d4800001 connected 2023-07-16 09:10:39,155 DEBUG [Listener at localhost/39411] zookeeper.ZKUtil(164): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-16 09:10:39,156 DEBUG [Listener at localhost/39411] zookeeper.ZKUtil(164): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 09:10:39,157 DEBUG [Listener at localhost/39411] zookeeper.ZKUtil(164): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-16 09:10:39,158 DEBUG [Listener at localhost/39411] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45805 2023-07-16 09:10:39,162 DEBUG [Listener at localhost/39411] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45805 2023-07-16 09:10:39,162 DEBUG [Listener at localhost/39411] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45805 2023-07-16 09:10:39,165 DEBUG [Listener at localhost/39411] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45805 2023-07-16 09:10:39,166 DEBUG [Listener at localhost/39411] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45805 2023-07-16 09:10:39,179 INFO [Listener at localhost/39411] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-16 09:10:39,180 INFO [Listener at localhost/39411] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 09:10:39,180 INFO [Listener at localhost/39411] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-16 09:10:39,180 INFO [Listener at localhost/39411] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-16 09:10:39,181 INFO [Listener at localhost/39411] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 09:10:39,181 INFO [Listener at localhost/39411] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-16 09:10:39,181 INFO [Listener at localhost/39411] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-16 09:10:39,183 INFO [Listener at localhost/39411] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37709 2023-07-16 09:10:39,183 INFO [Listener at localhost/39411] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-16 09:10:39,186 INFO [Listener at localhost/39411] mob.MobFileCache(124): MobFileCache disabled 2023-07-16 09:10:39,187 INFO [Listener at localhost/39411] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 09:10:39,189 INFO [Listener at localhost/39411] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 09:10:39,192 INFO [Listener at localhost/39411] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37709 connecting to ZooKeeper ensemble=127.0.0.1:64380 2023-07-16 09:10:39,201 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:377090x0, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-16 09:10:39,203 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37709-0x1016d65d4800002 connected 2023-07-16 09:10:39,203 DEBUG [Listener at localhost/39411] zookeeper.ZKUtil(164): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-16 09:10:39,204 DEBUG [Listener at localhost/39411] zookeeper.ZKUtil(164): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 09:10:39,205 DEBUG [Listener at localhost/39411] zookeeper.ZKUtil(164): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-16 09:10:39,206 DEBUG [Listener at localhost/39411] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37709 2023-07-16 09:10:39,207 DEBUG [Listener at localhost/39411] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37709 2023-07-16 09:10:39,210 DEBUG [Listener at localhost/39411] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37709 2023-07-16 09:10:39,211 DEBUG [Listener at localhost/39411] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37709 2023-07-16 09:10:39,218 DEBUG [Listener at localhost/39411] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37709 2023-07-16 09:10:39,235 INFO [Listener at localhost/39411] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-16 09:10:39,235 INFO [Listener at localhost/39411] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 09:10:39,235 INFO [Listener at localhost/39411] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-16 09:10:39,236 INFO [Listener at localhost/39411] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-16 09:10:39,236 INFO [Listener at localhost/39411] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-16 09:10:39,236 INFO [Listener at localhost/39411] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-16 09:10:39,236 INFO [Listener at localhost/39411] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-16 09:10:39,247 INFO [Listener at localhost/39411] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45437 2023-07-16 09:10:39,250 INFO [Listener at localhost/39411] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-16 09:10:39,253 INFO [Listener at localhost/39411] mob.MobFileCache(124): MobFileCache disabled 2023-07-16 09:10:39,254 INFO [Listener at localhost/39411] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 09:10:39,255 INFO [Listener at localhost/39411] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 09:10:39,257 INFO [Listener at localhost/39411] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45437 connecting to ZooKeeper ensemble=127.0.0.1:64380 2023-07-16 09:10:39,268 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:454370x0, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-16 09:10:39,269 DEBUG [Listener at localhost/39411] zookeeper.ZKUtil(164): regionserver:454370x0, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-16 09:10:39,269 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45437-0x1016d65d4800003 connected 2023-07-16 09:10:39,270 DEBUG [Listener at localhost/39411] zookeeper.ZKUtil(164): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 09:10:39,271 DEBUG [Listener at localhost/39411] zookeeper.ZKUtil(164): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-16 09:10:39,274 DEBUG [Listener at localhost/39411] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45437 2023-07-16 09:10:39,274 DEBUG [Listener at localhost/39411] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45437 2023-07-16 09:10:39,274 DEBUG [Listener at localhost/39411] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45437 2023-07-16 09:10:39,280 DEBUG [Listener at localhost/39411] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45437 2023-07-16 09:10:39,282 DEBUG [Listener at localhost/39411] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45437 2023-07-16 09:10:39,285 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,46005,1689498637607 2023-07-16 09:10:39,297 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-16 09:10:39,300 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,46005,1689498637607 2023-07-16 09:10:39,329 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-16 09:10:39,329 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 09:10:39,330 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-16 09:10:39,331 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-16 09:10:39,330 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-16 09:10:39,338 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-16 09:10:39,343 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-16 09:10:39,355 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,46005,1689498637607 from backup master directory 2023-07-16 09:10:39,359 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,46005,1689498637607 2023-07-16 09:10:39,360 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-16 09:10:39,361 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-16 09:10:39,361 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,46005,1689498637607 2023-07-16 09:10:39,366 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-16 09:10:39,371 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-16 09:10:39,501 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/hbase.id with ID: cdfef65b-cced-481e-bf1e-f7e653f69f46 2023-07-16 09:10:39,548 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-16 09:10:39,566 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 09:10:39,649 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x519832e7 to 127.0.0.1:64380 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:10:39,696 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2122cf8c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:10:39,726 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-16 09:10:39,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-16 09:10:39,749 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-16 09:10:39,750 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-16 09:10:39,752 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-16 09:10:39,758 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-16 09:10:39,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-16 09:10:39,809 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/MasterData/data/master/store-tmp 2023-07-16 09:10:39,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:10:39,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-16 09:10:39,883 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 09:10:39,883 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 09:10:39,883 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-16 09:10:39,883 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 09:10:39,883 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 09:10:39,883 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-16 09:10:39,885 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/MasterData/WALs/jenkins-hbase4.apache.org,46005,1689498637607 2023-07-16 09:10:39,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46005%2C1689498637607, suffix=, logDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/MasterData/WALs/jenkins-hbase4.apache.org,46005,1689498637607, archiveDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/MasterData/oldWALs, maxLogs=10 2023-07-16 09:10:39,989 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34409,DS-ddcd0d8d-8f22-4327-a28c-990bd23ded76,DISK] 2023-07-16 09:10:39,989 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36029,DS-cd66a558-133e-41f9-ba9e-49328fdbe4cf,DISK] 2023-07-16 09:10:39,989 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45095,DS-d944664b-66c4-4325-aa9f-16b17d934d2c,DISK] 2023-07-16 09:10:40,000 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-16 09:10:40,087 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/MasterData/WALs/jenkins-hbase4.apache.org,46005,1689498637607/jenkins-hbase4.apache.org%2C46005%2C1689498637607.1689498639922 2023-07-16 09:10:40,088 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34409,DS-ddcd0d8d-8f22-4327-a28c-990bd23ded76,DISK], DatanodeInfoWithStorage[127.0.0.1:36029,DS-cd66a558-133e-41f9-ba9e-49328fdbe4cf,DISK], DatanodeInfoWithStorage[127.0.0.1:45095,DS-d944664b-66c4-4325-aa9f-16b17d934d2c,DISK]] 2023-07-16 09:10:40,088 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-16 09:10:40,089 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:10:40,093 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-16 09:10:40,095 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-16 09:10:40,203 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-16 09:10:40,213 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-16 09:10:40,255 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-16 09:10:40,269 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:10:40,275 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-16 09:10:40,277 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-16 09:10:40,294 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-16 09:10:40,299 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 09:10:40,300 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70415152, jitterRate=0.04926753044128418}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 09:10:40,300 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-16 09:10:40,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-16 09:10:40,325 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-16 09:10:40,325 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-16 09:10:40,328 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-16 09:10:40,330 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-16 09:10:40,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 52 msec 2023-07-16 09:10:40,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-16 09:10:40,417 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-16 09:10:40,423 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-16 09:10:40,450 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-16 09:10:40,456 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-16 09:10:40,457 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-16 09:10:40,466 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-16 09:10:40,472 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-16 09:10:40,479 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 09:10:40,483 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-16 09:10:40,487 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-16 09:10:40,507 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-16 09:10:40,517 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-16 09:10:40,517 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-16 09:10:40,517 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-16 09:10:40,517 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-16 09:10:40,518 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 09:10:40,521 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,46005,1689498637607, sessionid=0x1016d65d4800000, setting cluster-up flag (Was=false) 2023-07-16 09:10:40,562 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 09:10:40,576 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-16 09:10:40,578 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46005,1689498637607 2023-07-16 09:10:40,588 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 09:10:40,598 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-16 09:10:40,600 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46005,1689498637607 2023-07-16 09:10:40,602 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp 2023-07-16 09:10:40,700 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-16 09:10:40,701 INFO [RS:0;jenkins-hbase4:45805] regionserver.HRegionServer(951): ClusterId : cdfef65b-cced-481e-bf1e-f7e653f69f46 2023-07-16 09:10:40,701 INFO [RS:1;jenkins-hbase4:37709] regionserver.HRegionServer(951): ClusterId : cdfef65b-cced-481e-bf1e-f7e653f69f46 2023-07-16 09:10:40,718 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:10:40,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-16 09:10:40,721 INFO [RS:2;jenkins-hbase4:45437] regionserver.HRegionServer(951): ClusterId : cdfef65b-cced-481e-bf1e-f7e653f69f46 2023-07-16 09:10:40,722 DEBUG [RS:1;jenkins-hbase4:37709] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-16 09:10:40,725 DEBUG [RS:0;jenkins-hbase4:45805] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-16 09:10:40,725 DEBUG [RS:2;jenkins-hbase4:45437] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-16 09:10:40,732 DEBUG [RS:1;jenkins-hbase4:37709] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-16 09:10:40,732 DEBUG [RS:0;jenkins-hbase4:45805] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-16 09:10:40,733 DEBUG [RS:0;jenkins-hbase4:45805] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-16 09:10:40,732 DEBUG [RS:1;jenkins-hbase4:37709] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-16 09:10:40,733 DEBUG [RS:2;jenkins-hbase4:45437] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-16 09:10:40,733 DEBUG [RS:2;jenkins-hbase4:45437] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-16 09:10:40,739 DEBUG [RS:1;jenkins-hbase4:37709] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-16 09:10:40,739 DEBUG [RS:0;jenkins-hbase4:45805] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-16 09:10:40,740 DEBUG [RS:2;jenkins-hbase4:45437] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-16 09:10:40,745 DEBUG [RS:0;jenkins-hbase4:45805] zookeeper.ReadOnlyZKClient(139): Connect 0x674848ed to 127.0.0.1:64380 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:10:40,757 DEBUG [RS:1;jenkins-hbase4:37709] zookeeper.ReadOnlyZKClient(139): Connect 0x6992be8e to 127.0.0.1:64380 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:10:40,764 DEBUG [RS:2;jenkins-hbase4:45437] zookeeper.ReadOnlyZKClient(139): Connect 0x450bb0f6 to 127.0.0.1:64380 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:10:40,788 DEBUG [RS:2;jenkins-hbase4:45437] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4bcc4627, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:10:40,788 DEBUG [RS:1;jenkins-hbase4:37709] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4dfa2010, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:10:40,789 DEBUG [RS:2;jenkins-hbase4:45437] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ff3db86, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-16 09:10:40,789 DEBUG [RS:1;jenkins-hbase4:37709] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67c63fd8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-16 09:10:40,790 DEBUG [RS:0;jenkins-hbase4:45805] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c984af4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:10:40,790 DEBUG [RS:0;jenkins-hbase4:45805] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d200851, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-16 09:10:40,829 DEBUG [RS:1;jenkins-hbase4:37709] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:37709 2023-07-16 09:10:40,839 INFO [RS:1;jenkins-hbase4:37709] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-16 09:10:40,839 INFO [RS:1;jenkins-hbase4:37709] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-16 09:10:40,840 DEBUG [RS:1;jenkins-hbase4:37709] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-16 09:10:40,841 DEBUG [RS:0;jenkins-hbase4:45805] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:45805 2023-07-16 09:10:40,844 INFO [RS:1;jenkins-hbase4:37709] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:10:40,851 DEBUG [RS:1;jenkins-hbase4:37709] regionserver.HRegionServer(1022): About to register with Master. 2023-07-16 09:10:40,851 INFO [RS:0;jenkins-hbase4:45805] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-16 09:10:40,852 INFO [RS:0;jenkins-hbase4:45805] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-16 09:10:40,852 DEBUG [RS:0;jenkins-hbase4:45805] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-16 09:10:40,852 INFO [RS:0;jenkins-hbase4:45805] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:10:40,852 DEBUG [RS:0;jenkins-hbase4:45805] regionserver.HRegionServer(1022): About to register with Master. 2023-07-16 09:10:40,855 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-16 09:10:40,863 DEBUG [RS:2;jenkins-hbase4:45437] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:45437 2023-07-16 09:10:40,863 INFO [RS:2;jenkins-hbase4:45437] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-16 09:10:40,863 INFO [RS:2;jenkins-hbase4:45437] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-16 09:10:40,863 DEBUG [RS:2;jenkins-hbase4:45437] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-16 09:10:40,863 INFO [RS:2;jenkins-hbase4:45437] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:10:40,863 DEBUG [RS:2;jenkins-hbase4:45437] regionserver.HRegionServer(1022): About to register with Master. 2023-07-16 09:10:40,865 INFO [RS:1;jenkins-hbase4:37709] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46005,1689498637607 with isa=jenkins-hbase4.apache.org/172.31.14.131:37709, startcode=1689498639179 2023-07-16 09:10:40,866 INFO [RS:2;jenkins-hbase4:45437] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46005,1689498637607 with isa=jenkins-hbase4.apache.org/172.31.14.131:45437, startcode=1689498639234 2023-07-16 09:10:40,868 INFO [RS:0;jenkins-hbase4:45805] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46005,1689498637607 with isa=jenkins-hbase4.apache.org/172.31.14.131:45805, startcode=1689498639118 2023-07-16 09:10:40,871 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-16 09:10:40,871 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-16 09:10:40,871 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-16 09:10:40,872 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-16 09:10:40,872 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-16 09:10:40,872 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:40,873 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-16 09:10:40,873 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:40,875 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689498670875 2023-07-16 09:10:40,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-16 09:10:40,887 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-16 09:10:40,888 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-16 09:10:40,895 DEBUG [RS:1;jenkins-hbase4:37709] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-16 09:10:40,895 DEBUG [RS:0;jenkins-hbase4:45805] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-16 09:10:40,895 DEBUG [RS:2;jenkins-hbase4:45437] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-16 09:10:40,899 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-16 09:10:40,900 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-16 09:10:40,907 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-16 09:10:40,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-16 09:10:40,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-16 09:10:40,909 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-16 09:10:40,923 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:40,924 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-16 09:10:40,926 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-16 09:10:40,926 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-16 09:10:40,930 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-16 09:10:40,931 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-16 09:10:40,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689498640932,5,FailOnTimeoutGroup] 2023-07-16 09:10:40,940 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689498640940,5,FailOnTimeoutGroup] 2023-07-16 09:10:40,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:40,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-16 09:10:40,942 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:40,942 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:41,013 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-16 09:10:41,015 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-16 09:10:41,015 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae 2023-07-16 09:10:41,017 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37385, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-16 09:10:41,017 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46865, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-16 09:10:41,017 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56779, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-16 09:10:41,043 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46005] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:41,084 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:10:41,088 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46005] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:10:41,089 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-16 09:10:41,092 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46005] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:41,099 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/meta/1588230740/info 2023-07-16 09:10:41,101 DEBUG [RS:1;jenkins-hbase4:37709] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae 2023-07-16 09:10:41,101 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-16 09:10:41,101 DEBUG [RS:2;jenkins-hbase4:45437] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae 2023-07-16 09:10:41,101 DEBUG [RS:1;jenkins-hbase4:37709] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:43477 2023-07-16 09:10:41,102 DEBUG [RS:2;jenkins-hbase4:45437] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:43477 2023-07-16 09:10:41,103 DEBUG [RS:1;jenkins-hbase4:37709] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-16 09:10:41,103 DEBUG [RS:0;jenkins-hbase4:45805] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae 2023-07-16 09:10:41,103 DEBUG [RS:2;jenkins-hbase4:45437] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-16 09:10:41,103 DEBUG [RS:0;jenkins-hbase4:45805] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:43477 2023-07-16 09:10:41,103 DEBUG [RS:0;jenkins-hbase4:45805] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-16 09:10:41,103 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:10:41,103 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-16 09:10:41,111 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 09:10:41,111 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/meta/1588230740/rep_barrier 2023-07-16 09:10:41,113 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-16 09:10:41,114 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:10:41,114 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-16 09:10:41,115 DEBUG [RS:2;jenkins-hbase4:45437] zookeeper.ZKUtil(162): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:41,116 WARN [RS:2;jenkins-hbase4:45437] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-16 09:10:41,116 INFO [RS:2;jenkins-hbase4:45437] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-16 09:10:41,116 DEBUG [RS:2;jenkins-hbase4:45437] regionserver.HRegionServer(1948): logDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/WALs/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:41,117 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/meta/1588230740/table 2023-07-16 09:10:41,117 DEBUG [RS:0;jenkins-hbase4:45805] zookeeper.ZKUtil(162): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:41,118 DEBUG [RS:1;jenkins-hbase4:37709] zookeeper.ZKUtil(162): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:10:41,118 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-16 09:10:41,118 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37709,1689498639179] 2023-07-16 09:10:41,119 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45437,1689498639234] 2023-07-16 09:10:41,119 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45805,1689498639118] 2023-07-16 09:10:41,119 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:10:41,118 WARN [RS:1;jenkins-hbase4:37709] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-16 09:10:41,118 WARN [RS:0;jenkins-hbase4:45805] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-16 09:10:41,124 INFO [RS:1;jenkins-hbase4:37709] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-16 09:10:41,124 INFO [RS:0;jenkins-hbase4:45805] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-16 09:10:41,125 DEBUG [RS:1;jenkins-hbase4:37709] regionserver.HRegionServer(1948): logDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/WALs/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:10:41,125 DEBUG [RS:0;jenkins-hbase4:45805] regionserver.HRegionServer(1948): logDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/WALs/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:41,126 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/meta/1588230740 2023-07-16 09:10:41,128 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/meta/1588230740 2023-07-16 09:10:41,140 DEBUG [RS:1;jenkins-hbase4:37709] zookeeper.ZKUtil(162): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:10:41,141 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-16 09:10:41,141 DEBUG [RS:0;jenkins-hbase4:45805] zookeeper.ZKUtil(162): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:10:41,142 DEBUG [RS:2;jenkins-hbase4:45437] zookeeper.ZKUtil(162): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:10:41,144 DEBUG [RS:1;jenkins-hbase4:37709] zookeeper.ZKUtil(162): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:41,144 DEBUG [RS:2;jenkins-hbase4:45437] zookeeper.ZKUtil(162): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:41,144 DEBUG [RS:0;jenkins-hbase4:45805] zookeeper.ZKUtil(162): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:41,145 DEBUG [RS:2;jenkins-hbase4:45437] zookeeper.ZKUtil(162): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:41,145 DEBUG [RS:1;jenkins-hbase4:37709] zookeeper.ZKUtil(162): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:41,145 DEBUG [RS:0;jenkins-hbase4:45805] zookeeper.ZKUtil(162): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:41,146 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-16 09:10:41,165 DEBUG [RS:0;jenkins-hbase4:45805] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-16 09:10:41,165 DEBUG [RS:2;jenkins-hbase4:45437] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-16 09:10:41,166 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 09:10:41,166 DEBUG [RS:1;jenkins-hbase4:37709] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-16 09:10:41,168 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62802220, jitterRate=-0.06417399644851685}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-16 09:10:41,168 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-16 09:10:41,168 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-16 09:10:41,168 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-16 09:10:41,168 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-16 09:10:41,168 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-16 09:10:41,168 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-16 09:10:41,169 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-16 09:10:41,170 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-16 09:10:41,178 INFO [RS:2;jenkins-hbase4:45437] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-16 09:10:41,178 INFO [RS:1;jenkins-hbase4:37709] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-16 09:10:41,179 INFO [RS:0;jenkins-hbase4:45805] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-16 09:10:41,181 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-16 09:10:41,181 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-16 09:10:41,197 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-16 09:10:41,208 INFO [RS:1;jenkins-hbase4:37709] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-16 09:10:41,209 INFO [RS:2;jenkins-hbase4:45437] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-16 09:10:41,210 INFO [RS:0;jenkins-hbase4:45805] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-16 09:10:41,213 INFO [RS:2;jenkins-hbase4:45437] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-16 09:10:41,213 INFO [RS:2;jenkins-hbase4:45437] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:41,215 INFO [RS:0;jenkins-hbase4:45805] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-16 09:10:41,215 INFO [RS:0;jenkins-hbase4:45805] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:41,219 INFO [RS:1;jenkins-hbase4:37709] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-16 09:10:41,219 INFO [RS:1;jenkins-hbase4:37709] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:41,224 INFO [RS:2;jenkins-hbase4:45437] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-16 09:10:41,224 INFO [RS:1;jenkins-hbase4:37709] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-16 09:10:41,224 INFO [RS:0;jenkins-hbase4:45805] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-16 09:10:41,225 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-16 09:10:41,234 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-16 09:10:41,240 INFO [RS:2;jenkins-hbase4:45437] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:41,240 INFO [RS:1;jenkins-hbase4:37709] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:41,240 DEBUG [RS:2;jenkins-hbase4:45437] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,240 INFO [RS:0;jenkins-hbase4:45805] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:41,240 DEBUG [RS:2;jenkins-hbase4:45437] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,240 DEBUG [RS:2;jenkins-hbase4:45437] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,241 DEBUG [RS:2;jenkins-hbase4:45437] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,241 DEBUG [RS:2;jenkins-hbase4:45437] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,241 DEBUG [RS:2;jenkins-hbase4:45437] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-16 09:10:41,241 DEBUG [RS:2;jenkins-hbase4:45437] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,241 DEBUG [RS:2;jenkins-hbase4:45437] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,241 DEBUG [RS:2;jenkins-hbase4:45437] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,241 DEBUG [RS:2;jenkins-hbase4:45437] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,240 DEBUG [RS:1;jenkins-hbase4:37709] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,247 DEBUG [RS:1;jenkins-hbase4:37709] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,247 DEBUG [RS:1;jenkins-hbase4:37709] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,247 DEBUG [RS:1;jenkins-hbase4:37709] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,247 DEBUG [RS:1;jenkins-hbase4:37709] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,247 DEBUG [RS:1;jenkins-hbase4:37709] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-16 09:10:41,247 DEBUG [RS:1;jenkins-hbase4:37709] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,247 DEBUG [RS:1;jenkins-hbase4:37709] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,248 DEBUG [RS:1;jenkins-hbase4:37709] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,248 DEBUG [RS:1;jenkins-hbase4:37709] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,240 DEBUG [RS:0;jenkins-hbase4:45805] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,271 INFO [RS:2;jenkins-hbase4:45437] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:41,271 DEBUG [RS:0;jenkins-hbase4:45805] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,271 INFO [RS:2;jenkins-hbase4:45437] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:41,271 DEBUG [RS:0;jenkins-hbase4:45805] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,271 INFO [RS:2;jenkins-hbase4:45437] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:41,271 DEBUG [RS:0;jenkins-hbase4:45805] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,271 DEBUG [RS:0;jenkins-hbase4:45805] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,272 DEBUG [RS:0;jenkins-hbase4:45805] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-16 09:10:41,272 DEBUG [RS:0;jenkins-hbase4:45805] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,272 DEBUG [RS:0;jenkins-hbase4:45805] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,272 DEBUG [RS:0;jenkins-hbase4:45805] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,272 DEBUG [RS:0;jenkins-hbase4:45805] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-16 09:10:41,280 INFO [RS:1;jenkins-hbase4:37709] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:41,280 INFO [RS:1;jenkins-hbase4:37709] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:41,280 INFO [RS:1;jenkins-hbase4:37709] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:41,305 INFO [RS:0;jenkins-hbase4:45805] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:41,307 INFO [RS:0;jenkins-hbase4:45805] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:41,308 INFO [RS:0;jenkins-hbase4:45805] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:41,319 INFO [RS:1;jenkins-hbase4:37709] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-16 09:10:41,323 INFO [RS:1;jenkins-hbase4:37709] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37709,1689498639179-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:41,328 INFO [RS:0;jenkins-hbase4:45805] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-16 09:10:41,339 INFO [RS:0;jenkins-hbase4:45805] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45805,1689498639118-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:41,341 INFO [RS:2;jenkins-hbase4:45437] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-16 09:10:41,341 INFO [RS:2;jenkins-hbase4:45437] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45437,1689498639234-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:41,368 INFO [RS:1;jenkins-hbase4:37709] regionserver.Replication(203): jenkins-hbase4.apache.org,37709,1689498639179 started 2023-07-16 09:10:41,368 INFO [RS:1;jenkins-hbase4:37709] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,37709,1689498639179, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37709, sessionid=0x1016d65d4800002 2023-07-16 09:10:41,371 DEBUG [RS:1;jenkins-hbase4:37709] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-16 09:10:41,371 DEBUG [RS:1;jenkins-hbase4:37709] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:10:41,371 DEBUG [RS:1;jenkins-hbase4:37709] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37709,1689498639179' 2023-07-16 09:10:41,371 DEBUG [RS:1;jenkins-hbase4:37709] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-16 09:10:41,373 DEBUG [RS:1;jenkins-hbase4:37709] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-16 09:10:41,374 DEBUG [RS:1;jenkins-hbase4:37709] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-16 09:10:41,374 DEBUG [RS:1;jenkins-hbase4:37709] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-16 09:10:41,374 DEBUG [RS:1;jenkins-hbase4:37709] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:10:41,374 DEBUG [RS:1;jenkins-hbase4:37709] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37709,1689498639179' 2023-07-16 09:10:41,374 DEBUG [RS:1;jenkins-hbase4:37709] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:10:41,375 DEBUG [RS:1;jenkins-hbase4:37709] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:10:41,375 DEBUG [RS:1;jenkins-hbase4:37709] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-16 09:10:41,376 INFO [RS:1;jenkins-hbase4:37709] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-16 09:10:41,376 INFO [RS:1;jenkins-hbase4:37709] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-16 09:10:41,380 INFO [RS:2;jenkins-hbase4:45437] regionserver.Replication(203): jenkins-hbase4.apache.org,45437,1689498639234 started 2023-07-16 09:10:41,380 INFO [RS:2;jenkins-hbase4:45437] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,45437,1689498639234, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45437, sessionid=0x1016d65d4800003 2023-07-16 09:10:41,381 DEBUG [RS:2;jenkins-hbase4:45437] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-16 09:10:41,381 DEBUG [RS:2;jenkins-hbase4:45437] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:41,388 DEBUG [jenkins-hbase4:46005] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-16 09:10:41,384 DEBUG [RS:2;jenkins-hbase4:45437] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45437,1689498639234' 2023-07-16 09:10:41,393 DEBUG [RS:2;jenkins-hbase4:45437] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-16 09:10:41,393 DEBUG [RS:2;jenkins-hbase4:45437] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-16 09:10:41,394 DEBUG [RS:2;jenkins-hbase4:45437] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-16 09:10:41,394 DEBUG [jenkins-hbase4:46005] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 09:10:41,394 DEBUG [RS:2;jenkins-hbase4:45437] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-16 09:10:41,400 DEBUG [RS:2;jenkins-hbase4:45437] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:41,401 DEBUG [RS:2;jenkins-hbase4:45437] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45437,1689498639234' 2023-07-16 09:10:41,401 DEBUG [RS:2;jenkins-hbase4:45437] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:10:41,402 DEBUG [RS:2;jenkins-hbase4:45437] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:10:41,403 DEBUG [RS:2;jenkins-hbase4:45437] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-16 09:10:41,403 INFO [RS:2;jenkins-hbase4:45437] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-16 09:10:41,404 INFO [RS:2;jenkins-hbase4:45437] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-16 09:10:41,406 DEBUG [jenkins-hbase4:46005] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 09:10:41,406 DEBUG [jenkins-hbase4:46005] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 09:10:41,407 DEBUG [jenkins-hbase4:46005] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 09:10:41,407 DEBUG [jenkins-hbase4:46005] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 09:10:41,410 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45805,1689498639118, state=OPENING 2023-07-16 09:10:41,410 INFO [RS:0;jenkins-hbase4:45805] regionserver.Replication(203): jenkins-hbase4.apache.org,45805,1689498639118 started 2023-07-16 09:10:41,410 INFO [RS:0;jenkins-hbase4:45805] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,45805,1689498639118, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45805, sessionid=0x1016d65d4800001 2023-07-16 09:10:41,410 DEBUG [RS:0;jenkins-hbase4:45805] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-16 09:10:41,411 DEBUG [RS:0;jenkins-hbase4:45805] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:41,411 DEBUG [RS:0;jenkins-hbase4:45805] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45805,1689498639118' 2023-07-16 09:10:41,411 DEBUG [RS:0;jenkins-hbase4:45805] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-16 09:10:41,411 DEBUG [RS:0;jenkins-hbase4:45805] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-16 09:10:41,412 DEBUG [RS:0;jenkins-hbase4:45805] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-16 09:10:41,412 DEBUG [RS:0;jenkins-hbase4:45805] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-16 09:10:41,412 DEBUG [RS:0;jenkins-hbase4:45805] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:41,412 DEBUG [RS:0;jenkins-hbase4:45805] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45805,1689498639118' 2023-07-16 09:10:41,412 DEBUG [RS:0;jenkins-hbase4:45805] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:10:41,413 DEBUG [RS:0;jenkins-hbase4:45805] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:10:41,413 DEBUG [RS:0;jenkins-hbase4:45805] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-16 09:10:41,413 INFO [RS:0;jenkins-hbase4:45805] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-16 09:10:41,413 INFO [RS:0;jenkins-hbase4:45805] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-16 09:10:41,419 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-16 09:10:41,422 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 09:10:41,424 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-16 09:10:41,429 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45805,1689498639118}] 2023-07-16 09:10:41,489 INFO [RS:1;jenkins-hbase4:37709] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37709%2C1689498639179, suffix=, logDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/WALs/jenkins-hbase4.apache.org,37709,1689498639179, archiveDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/oldWALs, maxLogs=32 2023-07-16 09:10:41,508 INFO [RS:2;jenkins-hbase4:45437] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45437%2C1689498639234, suffix=, logDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/WALs/jenkins-hbase4.apache.org,45437,1689498639234, archiveDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/oldWALs, maxLogs=32 2023-07-16 09:10:41,520 INFO [RS:0;jenkins-hbase4:45805] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45805%2C1689498639118, suffix=, logDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/WALs/jenkins-hbase4.apache.org,45805,1689498639118, archiveDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/oldWALs, maxLogs=32 2023-07-16 09:10:41,539 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36029,DS-cd66a558-133e-41f9-ba9e-49328fdbe4cf,DISK] 2023-07-16 09:10:41,543 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34409,DS-ddcd0d8d-8f22-4327-a28c-990bd23ded76,DISK] 2023-07-16 09:10:41,555 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45095,DS-d944664b-66c4-4325-aa9f-16b17d934d2c,DISK] 2023-07-16 09:10:41,585 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36029,DS-cd66a558-133e-41f9-ba9e-49328fdbe4cf,DISK] 2023-07-16 09:10:41,585 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45095,DS-d944664b-66c4-4325-aa9f-16b17d934d2c,DISK] 2023-07-16 09:10:41,586 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34409,DS-ddcd0d8d-8f22-4327-a28c-990bd23ded76,DISK] 2023-07-16 09:10:41,586 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36029,DS-cd66a558-133e-41f9-ba9e-49328fdbe4cf,DISK] 2023-07-16 09:10:41,586 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45095,DS-d944664b-66c4-4325-aa9f-16b17d934d2c,DISK] 2023-07-16 09:10:41,587 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34409,DS-ddcd0d8d-8f22-4327-a28c-990bd23ded76,DISK] 2023-07-16 09:10:41,588 INFO [RS:1;jenkins-hbase4:37709] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/WALs/jenkins-hbase4.apache.org,37709,1689498639179/jenkins-hbase4.apache.org%2C37709%2C1689498639179.1689498641492 2023-07-16 09:10:41,604 DEBUG [RS:1;jenkins-hbase4:37709] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36029,DS-cd66a558-133e-41f9-ba9e-49328fdbe4cf,DISK], DatanodeInfoWithStorage[127.0.0.1:45095,DS-d944664b-66c4-4325-aa9f-16b17d934d2c,DISK], DatanodeInfoWithStorage[127.0.0.1:34409,DS-ddcd0d8d-8f22-4327-a28c-990bd23ded76,DISK]] 2023-07-16 09:10:41,623 INFO [RS:2;jenkins-hbase4:45437] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/WALs/jenkins-hbase4.apache.org,45437,1689498639234/jenkins-hbase4.apache.org%2C45437%2C1689498639234.1689498641513 2023-07-16 09:10:41,627 DEBUG [RS:2;jenkins-hbase4:45437] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45095,DS-d944664b-66c4-4325-aa9f-16b17d934d2c,DISK], DatanodeInfoWithStorage[127.0.0.1:36029,DS-cd66a558-133e-41f9-ba9e-49328fdbe4cf,DISK], DatanodeInfoWithStorage[127.0.0.1:34409,DS-ddcd0d8d-8f22-4327-a28c-990bd23ded76,DISK]] 2023-07-16 09:10:41,628 INFO [RS:0;jenkins-hbase4:45805] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/WALs/jenkins-hbase4.apache.org,45805,1689498639118/jenkins-hbase4.apache.org%2C45805%2C1689498639118.1689498641521 2023-07-16 09:10:41,628 DEBUG [RS:0;jenkins-hbase4:45805] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34409,DS-ddcd0d8d-8f22-4327-a28c-990bd23ded76,DISK], DatanodeInfoWithStorage[127.0.0.1:36029,DS-cd66a558-133e-41f9-ba9e-49328fdbe4cf,DISK], DatanodeInfoWithStorage[127.0.0.1:45095,DS-d944664b-66c4-4325-aa9f-16b17d934d2c,DISK]] 2023-07-16 09:10:41,649 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:41,653 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 09:10:41,656 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44800, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 09:10:41,675 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-16 09:10:41,676 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-16 09:10:41,680 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45805%2C1689498639118.meta, suffix=.meta, logDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/WALs/jenkins-hbase4.apache.org,45805,1689498639118, archiveDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/oldWALs, maxLogs=32 2023-07-16 09:10:41,717 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34409,DS-ddcd0d8d-8f22-4327-a28c-990bd23ded76,DISK] 2023-07-16 09:10:41,717 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36029,DS-cd66a558-133e-41f9-ba9e-49328fdbe4cf,DISK] 2023-07-16 09:10:41,720 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45095,DS-d944664b-66c4-4325-aa9f-16b17d934d2c,DISK] 2023-07-16 09:10:41,735 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/WALs/jenkins-hbase4.apache.org,45805,1689498639118/jenkins-hbase4.apache.org%2C45805%2C1689498639118.meta.1689498641682.meta 2023-07-16 09:10:41,736 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36029,DS-cd66a558-133e-41f9-ba9e-49328fdbe4cf,DISK], DatanodeInfoWithStorage[127.0.0.1:34409,DS-ddcd0d8d-8f22-4327-a28c-990bd23ded76,DISK], DatanodeInfoWithStorage[127.0.0.1:45095,DS-d944664b-66c4-4325-aa9f-16b17d934d2c,DISK]] 2023-07-16 09:10:41,736 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-16 09:10:41,738 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-16 09:10:41,740 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:10:41,741 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-16 09:10:41,744 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-16 09:10:41,747 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-16 09:10:41,767 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-16 09:10:41,767 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:10:41,767 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-16 09:10:41,767 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-16 09:10:41,784 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-16 09:10:41,787 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/meta/1588230740/info 2023-07-16 09:10:41,787 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/meta/1588230740/info 2023-07-16 09:10:41,787 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-16 09:10:41,788 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:10:41,788 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-16 09:10:41,790 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/meta/1588230740/rep_barrier 2023-07-16 09:10:41,790 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/meta/1588230740/rep_barrier 2023-07-16 09:10:41,791 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-16 09:10:41,792 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:10:41,792 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-16 09:10:41,794 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/meta/1588230740/table 2023-07-16 09:10:41,794 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/meta/1588230740/table 2023-07-16 09:10:41,794 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-16 09:10:41,795 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:10:41,804 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/meta/1588230740 2023-07-16 09:10:41,808 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/meta/1588230740 2023-07-16 09:10:41,813 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-16 09:10:41,817 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-16 09:10:41,820 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62419861, jitterRate=-0.06987158954143524}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-16 09:10:41,824 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-16 09:10:41,838 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689498641639 2023-07-16 09:10:41,863 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-16 09:10:41,864 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-16 09:10:41,865 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45805,1689498639118, state=OPEN 2023-07-16 09:10:41,868 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-16 09:10:41,868 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-16 09:10:41,872 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-16 09:10:41,872 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45805,1689498639118 in 439 msec 2023-07-16 09:10:41,881 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-16 09:10:41,881 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 677 msec 2023-07-16 09:10:41,893 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1570 sec 2023-07-16 09:10:41,893 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689498641893, completionTime=-1 2023-07-16 09:10:41,893 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-16 09:10:41,893 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-16 09:10:41,966 DEBUG [hconnection-0x404319e1-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:10:41,969 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44812, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:10:41,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-16 09:10:41,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689498701993 2023-07-16 09:10:41,994 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689498761994 2023-07-16 09:10:41,994 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 100 msec 2023-07-16 09:10:42,043 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46005,1689498637607-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:42,043 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46005,1689498637607-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:42,043 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46005,1689498637607-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:42,046 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:46005, period=300000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:42,047 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-16 09:10:42,082 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-16 09:10:42,083 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-16 09:10:42,084 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-16 09:10:42,100 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-16 09:10:42,104 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 09:10:42,109 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 09:10:42,156 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/hbase/namespace/f7ad2e339a72ba504e143898f86e18f5 2023-07-16 09:10:42,159 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/hbase/namespace/f7ad2e339a72ba504e143898f86e18f5 empty. 2023-07-16 09:10:42,160 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/hbase/namespace/f7ad2e339a72ba504e143898f86e18f5 2023-07-16 09:10:42,160 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-16 09:10:42,214 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-16 09:10:42,217 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => f7ad2e339a72ba504e143898f86e18f5, NAME => 'hbase:namespace,,1689498642083.f7ad2e339a72ba504e143898f86e18f5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp 2023-07-16 09:10:42,244 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689498642083.f7ad2e339a72ba504e143898f86e18f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:10:42,244 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing f7ad2e339a72ba504e143898f86e18f5, disabling compactions & flushes 2023-07-16 09:10:42,244 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689498642083.f7ad2e339a72ba504e143898f86e18f5. 2023-07-16 09:10:42,245 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689498642083.f7ad2e339a72ba504e143898f86e18f5. 2023-07-16 09:10:42,245 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689498642083.f7ad2e339a72ba504e143898f86e18f5. after waiting 0 ms 2023-07-16 09:10:42,245 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689498642083.f7ad2e339a72ba504e143898f86e18f5. 2023-07-16 09:10:42,245 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689498642083.f7ad2e339a72ba504e143898f86e18f5. 2023-07-16 09:10:42,245 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for f7ad2e339a72ba504e143898f86e18f5: 2023-07-16 09:10:42,250 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 09:10:42,270 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689498642083.f7ad2e339a72ba504e143898f86e18f5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689498642254"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498642254"}]},"ts":"1689498642254"} 2023-07-16 09:10:42,307 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-16 09:10:42,309 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 09:10:42,313 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498642309"}]},"ts":"1689498642309"} 2023-07-16 09:10:42,318 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-16 09:10:42,322 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 09:10:42,324 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 09:10:42,324 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 09:10:42,324 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 09:10:42,324 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 09:10:42,327 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=f7ad2e339a72ba504e143898f86e18f5, ASSIGN}] 2023-07-16 09:10:42,330 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=f7ad2e339a72ba504e143898f86e18f5, ASSIGN 2023-07-16 09:10:42,332 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=f7ad2e339a72ba504e143898f86e18f5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45437,1689498639234; forceNewPlan=false, retain=false 2023-07-16 09:10:42,485 INFO [jenkins-hbase4:46005] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-16 09:10:42,486 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=f7ad2e339a72ba504e143898f86e18f5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:42,486 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689498642083.f7ad2e339a72ba504e143898f86e18f5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689498642486"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498642486"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498642486"}]},"ts":"1689498642486"} 2023-07-16 09:10:42,491 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure f7ad2e339a72ba504e143898f86e18f5, server=jenkins-hbase4.apache.org,45437,1689498639234}] 2023-07-16 09:10:42,647 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:42,648 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 09:10:42,652 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33390, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 09:10:42,662 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689498642083.f7ad2e339a72ba504e143898f86e18f5. 2023-07-16 09:10:42,662 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f7ad2e339a72ba504e143898f86e18f5, NAME => 'hbase:namespace,,1689498642083.f7ad2e339a72ba504e143898f86e18f5.', STARTKEY => '', ENDKEY => ''} 2023-07-16 09:10:42,663 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689498642083.f7ad2e339a72ba504e143898f86e18f5. service=AccessControlService 2023-07-16 09:10:42,664 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:10:42,664 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace f7ad2e339a72ba504e143898f86e18f5 2023-07-16 09:10:42,664 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689498642083.f7ad2e339a72ba504e143898f86e18f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:10:42,665 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f7ad2e339a72ba504e143898f86e18f5 2023-07-16 09:10:42,665 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f7ad2e339a72ba504e143898f86e18f5 2023-07-16 09:10:42,670 INFO [StoreOpener-f7ad2e339a72ba504e143898f86e18f5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region f7ad2e339a72ba504e143898f86e18f5 2023-07-16 09:10:42,673 DEBUG [StoreOpener-f7ad2e339a72ba504e143898f86e18f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/namespace/f7ad2e339a72ba504e143898f86e18f5/info 2023-07-16 09:10:42,673 DEBUG [StoreOpener-f7ad2e339a72ba504e143898f86e18f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/namespace/f7ad2e339a72ba504e143898f86e18f5/info 2023-07-16 09:10:42,675 INFO [StoreOpener-f7ad2e339a72ba504e143898f86e18f5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f7ad2e339a72ba504e143898f86e18f5 columnFamilyName info 2023-07-16 09:10:42,676 INFO [StoreOpener-f7ad2e339a72ba504e143898f86e18f5-1] regionserver.HStore(310): Store=f7ad2e339a72ba504e143898f86e18f5/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:10:42,679 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/namespace/f7ad2e339a72ba504e143898f86e18f5 2023-07-16 09:10:42,681 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/namespace/f7ad2e339a72ba504e143898f86e18f5 2023-07-16 09:10:42,686 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f7ad2e339a72ba504e143898f86e18f5 2023-07-16 09:10:42,698 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/namespace/f7ad2e339a72ba504e143898f86e18f5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 09:10:42,699 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f7ad2e339a72ba504e143898f86e18f5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66053019, jitterRate=-0.01573331654071808}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 09:10:42,699 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f7ad2e339a72ba504e143898f86e18f5: 2023-07-16 09:10:42,701 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689498642083.f7ad2e339a72ba504e143898f86e18f5., pid=6, masterSystemTime=1689498642647 2023-07-16 09:10:42,706 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689498642083.f7ad2e339a72ba504e143898f86e18f5. 2023-07-16 09:10:42,706 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689498642083.f7ad2e339a72ba504e143898f86e18f5. 2023-07-16 09:10:42,708 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=f7ad2e339a72ba504e143898f86e18f5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:42,708 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689498642083.f7ad2e339a72ba504e143898f86e18f5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689498642707"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689498642707"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689498642707"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689498642707"}]},"ts":"1689498642707"} 2023-07-16 09:10:42,719 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-16 09:10:42,719 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure f7ad2e339a72ba504e143898f86e18f5, server=jenkins-hbase4.apache.org,45437,1689498639234 in 222 msec 2023-07-16 09:10:42,723 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-16 09:10:42,724 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=f7ad2e339a72ba504e143898f86e18f5, ASSIGN in 393 msec 2023-07-16 09:10:42,726 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 09:10:42,726 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498642726"}]},"ts":"1689498642726"} 2023-07-16 09:10:42,728 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-16 09:10:42,732 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 09:10:42,737 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 647 msec 2023-07-16 09:10:42,806 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-16 09:10:42,807 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-16 09:10:42,808 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 09:10:42,833 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:10:42,835 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33400, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:10:42,855 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-16 09:10:42,876 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-16 09:10:42,885 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 42 msec 2023-07-16 09:10:42,900 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-16 09:10:42,915 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-16 09:10:42,921 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 22 msec 2023-07-16 09:10:42,938 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-16 09:10:42,941 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-16 09:10:42,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.580sec 2023-07-16 09:10:42,947 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-16 09:10:42,949 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-16 09:10:42,949 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-16 09:10:42,951 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46005,1689498637607-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-16 09:10:42,951 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46005,1689498637607-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-16 09:10:42,978 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-16 09:10:42,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-16 09:10:42,982 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 09:10:42,984 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 09:10:42,989 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-16 09:10:42,990 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/hbase/acl/dc50139a54969c5b0d84afa719bd5e04 2023-07-16 09:10:42,991 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/hbase/acl/dc50139a54969c5b0d84afa719bd5e04 empty. 2023-07-16 09:10:42,995 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/hbase/acl/dc50139a54969c5b0d84afa719bd5e04 2023-07-16 09:10:42,995 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-16 09:10:43,000 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-16 09:10:43,028 DEBUG [Listener at localhost/39411] zookeeper.ReadOnlyZKClient(139): Connect 0x0e1990f9 to 127.0.0.1:64380 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:10:43,046 DEBUG [Listener at localhost/39411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@207f6c1a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:10:43,061 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-16 09:10:43,065 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => dc50139a54969c5b0d84afa719bd5e04, NAME => 'hbase:acl,,1689498642973.dc50139a54969c5b0d84afa719bd5e04.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp 2023-07-16 09:10:43,071 DEBUG [hconnection-0x4968aca5-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:10:43,102 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689498642973.dc50139a54969c5b0d84afa719bd5e04.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:10:43,103 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing dc50139a54969c5b0d84afa719bd5e04, disabling compactions & flushes 2023-07-16 09:10:43,103 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689498642973.dc50139a54969c5b0d84afa719bd5e04. 2023-07-16 09:10:43,103 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689498642973.dc50139a54969c5b0d84afa719bd5e04. 2023-07-16 09:10:43,103 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689498642973.dc50139a54969c5b0d84afa719bd5e04. after waiting 0 ms 2023-07-16 09:10:43,103 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689498642973.dc50139a54969c5b0d84afa719bd5e04. 2023-07-16 09:10:43,103 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689498642973.dc50139a54969c5b0d84afa719bd5e04. 2023-07-16 09:10:43,103 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for dc50139a54969c5b0d84afa719bd5e04: 2023-07-16 09:10:43,106 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-16 09:10:43,106 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44824, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:10:43,109 INFO [Listener at localhost/39411] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,46005,1689498637607 2023-07-16 09:10:43,110 INFO [Listener at localhost/39411] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-16 09:10:43,110 INFO [Listener at localhost/39411] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/test.cache.data in system properties and HBase conf 2023-07-16 09:10:43,110 INFO [Listener at localhost/39411] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/hadoop.tmp.dir in system properties and HBase conf 2023-07-16 09:10:43,110 INFO [Listener at localhost/39411] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/hadoop.log.dir in system properties and HBase conf 2023-07-16 09:10:43,110 INFO [Listener at localhost/39411] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-16 09:10:43,110 INFO [Listener at localhost/39411] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-16 09:10:43,110 INFO [Listener at localhost/39411] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-16 09:10:43,110 INFO [Listener at localhost/39411] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-16 09:10:43,110 INFO [Listener at localhost/39411] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-16 09:10:43,111 INFO [Listener at localhost/39411] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-16 09:10:43,111 INFO [Listener at localhost/39411] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-16 09:10:43,111 INFO [Listener at localhost/39411] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-16 09:10:43,112 INFO [Listener at localhost/39411] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-16 09:10:43,112 INFO [Listener at localhost/39411] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-16 09:10:43,112 INFO [Listener at localhost/39411] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-16 09:10:43,112 INFO [Listener at localhost/39411] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-16 09:10:43,112 INFO [Listener at localhost/39411] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/nfs.dump.dir in system properties and HBase conf 2023-07-16 09:10:43,112 INFO [Listener at localhost/39411] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/java.io.tmpdir in system properties and HBase conf 2023-07-16 09:10:43,112 INFO [Listener at localhost/39411] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-16 09:10:43,113 INFO [Listener at localhost/39411] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-16 09:10:43,113 INFO [Listener at localhost/39411] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-16 09:10:43,117 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 09:10:43,119 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689498642973.dc50139a54969c5b0d84afa719bd5e04.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689498643119"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498643119"}]},"ts":"1689498643119"} 2023-07-16 09:10:43,122 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-16 09:10:43,124 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 09:10:43,124 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498643124"}]},"ts":"1689498643124"} 2023-07-16 09:10:43,132 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-16 09:10:43,143 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 09:10:43,144 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 09:10:43,144 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 09:10:43,144 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 09:10:43,144 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 09:10:43,145 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=dc50139a54969c5b0d84afa719bd5e04, ASSIGN}] 2023-07-16 09:10:43,160 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=dc50139a54969c5b0d84afa719bd5e04, ASSIGN 2023-07-16 09:10:43,167 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=dc50139a54969c5b0d84afa719bd5e04, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37709,1689498639179; forceNewPlan=false, retain=false 2023-07-16 09:10:43,306 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-16 09:10:43,318 INFO [jenkins-hbase4:46005] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-16 09:10:43,319 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=dc50139a54969c5b0d84afa719bd5e04, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:10:43,319 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689498642973.dc50139a54969c5b0d84afa719bd5e04.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689498643319"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498643319"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498643319"}]},"ts":"1689498643319"} 2023-07-16 09:10:43,323 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure dc50139a54969c5b0d84afa719bd5e04, server=jenkins-hbase4.apache.org,37709,1689498639179}] 2023-07-16 09:10:43,479 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:10:43,479 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 09:10:43,483 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42160, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 09:10:43,489 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689498642973.dc50139a54969c5b0d84afa719bd5e04. 2023-07-16 09:10:43,489 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dc50139a54969c5b0d84afa719bd5e04, NAME => 'hbase:acl,,1689498642973.dc50139a54969c5b0d84afa719bd5e04.', STARTKEY => '', ENDKEY => ''} 2023-07-16 09:10:43,490 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689498642973.dc50139a54969c5b0d84afa719bd5e04. service=AccessControlService 2023-07-16 09:10:43,490 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:10:43,490 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl dc50139a54969c5b0d84afa719bd5e04 2023-07-16 09:10:43,490 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689498642973.dc50139a54969c5b0d84afa719bd5e04.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:10:43,490 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dc50139a54969c5b0d84afa719bd5e04 2023-07-16 09:10:43,490 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dc50139a54969c5b0d84afa719bd5e04 2023-07-16 09:10:43,495 INFO [StoreOpener-dc50139a54969c5b0d84afa719bd5e04-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region dc50139a54969c5b0d84afa719bd5e04 2023-07-16 09:10:43,497 DEBUG [StoreOpener-dc50139a54969c5b0d84afa719bd5e04-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/acl/dc50139a54969c5b0d84afa719bd5e04/l 2023-07-16 09:10:43,497 DEBUG [StoreOpener-dc50139a54969c5b0d84afa719bd5e04-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/acl/dc50139a54969c5b0d84afa719bd5e04/l 2023-07-16 09:10:43,498 INFO [StoreOpener-dc50139a54969c5b0d84afa719bd5e04-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dc50139a54969c5b0d84afa719bd5e04 columnFamilyName l 2023-07-16 09:10:43,499 INFO [StoreOpener-dc50139a54969c5b0d84afa719bd5e04-1] regionserver.HStore(310): Store=dc50139a54969c5b0d84afa719bd5e04/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:10:43,501 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/acl/dc50139a54969c5b0d84afa719bd5e04 2023-07-16 09:10:43,502 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/acl/dc50139a54969c5b0d84afa719bd5e04 2023-07-16 09:10:43,507 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dc50139a54969c5b0d84afa719bd5e04 2023-07-16 09:10:43,512 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/acl/dc50139a54969c5b0d84afa719bd5e04/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 09:10:43,513 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dc50139a54969c5b0d84afa719bd5e04; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61932689, jitterRate=-0.07713101804256439}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 09:10:43,514 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dc50139a54969c5b0d84afa719bd5e04: 2023-07-16 09:10:43,516 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689498642973.dc50139a54969c5b0d84afa719bd5e04., pid=11, masterSystemTime=1689498643479 2023-07-16 09:10:43,524 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=dc50139a54969c5b0d84afa719bd5e04, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:10:43,525 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689498642973.dc50139a54969c5b0d84afa719bd5e04.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689498643524"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689498643524"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689498643524"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689498643524"}]},"ts":"1689498643524"} 2023-07-16 09:10:43,530 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689498642973.dc50139a54969c5b0d84afa719bd5e04. 2023-07-16 09:10:43,531 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689498642973.dc50139a54969c5b0d84afa719bd5e04. 2023-07-16 09:10:43,536 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-16 09:10:43,536 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure dc50139a54969c5b0d84afa719bd5e04, server=jenkins-hbase4.apache.org,37709,1689498639179 in 206 msec 2023-07-16 09:10:43,541 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-16 09:10:43,541 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=dc50139a54969c5b0d84afa719bd5e04, ASSIGN in 391 msec 2023-07-16 09:10:43,543 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 09:10:43,543 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498643543"}]},"ts":"1689498643543"} 2023-07-16 09:10:43,546 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-16 09:10:43,550 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 09:10:43,557 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 572 msec 2023-07-16 09:10:43,607 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-16 09:10:43,607 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-16 09:10:43,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-16 09:10:44,425 WARN [Thread-382] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 09:10:44,715 INFO [Thread-382] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 09:10:44,720 INFO [Thread-382] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_43561_jobhistory____j36bzu/webapp 2023-07-16 09:10:44,894 INFO [Thread-382] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-16 09:10:44,895 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-16 09:10:44,895 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-16 09:10:44,897 INFO [Thread-382] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-16 09:10:44,961 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 09:10:45,260 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 09:10:45,638 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-16 09:10:45,675 INFO [Thread-382] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:43561 2023-07-16 09:10:45,902 WARN [Listener at jenkins-hbase4.apache.org/46775] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 09:10:46,262 WARN [Listener at jenkins-hbase4.apache.org/46775] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-16 09:10:46,263 INFO [Listener at jenkins-hbase4.apache.org/46775] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 09:10:46,271 INFO [Listener at jenkins-hbase4.apache.org/46775] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_45701_cluster____z4114d/webapp 2023-07-16 09:10:46,346 INFO [Listener at jenkins-hbase4.apache.org/46775] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-16 09:10:46,346 INFO [Listener at jenkins-hbase4.apache.org/46775] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-16 09:10:46,347 INFO [Listener at jenkins-hbase4.apache.org/46775] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-16 09:10:46,347 INFO [Listener at jenkins-hbase4.apache.org/46775] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-16 09:10:46,359 INFO [Listener at jenkins-hbase4.apache.org/46775] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 09:10:46,619 INFO [Listener at jenkins-hbase4.apache.org/46775] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 09:10:46,944 INFO [Listener at jenkins-hbase4.apache.org/46775] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 09:10:46,992 INFO [Listener at jenkins-hbase4.apache.org/46775] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:45701 2023-07-16 09:10:47,448 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 09:10:47,620 WARN [Listener at jenkins-hbase4.apache.org/37615] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 09:10:47,661 WARN [Listener at jenkins-hbase4.apache.org/37615] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-16 09:10:47,661 INFO [Listener at jenkins-hbase4.apache.org/37615] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 09:10:47,688 INFO [Listener at jenkins-hbase4.apache.org/37615] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46175_node____.7lhh1/webapp 2023-07-16 09:10:47,711 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-16 09:10:47,713 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-16 09:10:47,714 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-16 09:10:47,764 INFO [Listener at jenkins-hbase4.apache.org/37615] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-16 09:10:47,764 INFO [Listener at jenkins-hbase4.apache.org/37615] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-16 09:10:47,764 INFO [Listener at jenkins-hbase4.apache.org/37615] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-16 09:10:47,765 INFO [Listener at jenkins-hbase4.apache.org/37615] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-16 09:10:47,777 INFO [Listener at jenkins-hbase4.apache.org/37615] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 09:10:47,784 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:10:47,785 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-16 09:10:47,785 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:10:47,785 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-16 09:10:47,786 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-16 09:10:47,786 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-16 09:10:47,786 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:10:47,786 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-16 09:10:47,786 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-16 09:10:47,786 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-16 09:10:47,804 INFO [Listener at jenkins-hbase4.apache.org/37615] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 09:10:47,938 INFO [Listener at jenkins-hbase4.apache.org/37615] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 09:10:47,953 INFO [Listener at jenkins-hbase4.apache.org/37615] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46175 2023-07-16 09:10:48,217 WARN [Listener at jenkins-hbase4.apache.org/33381] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-16 09:10:48,226 WARN [Listener at jenkins-hbase4.apache.org/33381] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-16 09:10:48,227 INFO [Listener at jenkins-hbase4.apache.org/33381] log.Slf4jLog(67): jetty-6.1.26 2023-07-16 09:10:48,238 INFO [Listener at jenkins-hbase4.apache.org/33381] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_40209_node____2i794t/webapp 2023-07-16 09:10:48,299 INFO [Listener at jenkins-hbase4.apache.org/33381] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-16 09:10:48,300 INFO [Listener at jenkins-hbase4.apache.org/33381] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-16 09:10:48,300 INFO [Listener at jenkins-hbase4.apache.org/33381] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-16 09:10:48,300 INFO [Listener at jenkins-hbase4.apache.org/33381] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-16 09:10:48,309 INFO [Listener at jenkins-hbase4.apache.org/33381] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 09:10:48,326 INFO [Listener at jenkins-hbase4.apache.org/33381] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 09:10:48,425 INFO [Listener at jenkins-hbase4.apache.org/33381] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-16 09:10:48,444 INFO [Listener at jenkins-hbase4.apache.org/33381] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:40209 2023-07-16 09:10:48,488 INFO [Listener at jenkins-hbase4.apache.org/33381] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-16 09:10:48,490 INFO [Listener at jenkins-hbase4.apache.org/33381] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 09:10:48,562 INFO [Listener at jenkins-hbase4.apache.org/33381] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=705, OpenFileDescriptor=900, MaxFileDescriptor=60000, SystemLoadAverage=369, ProcessCount=175, AvailableMemoryMB=4606 2023-07-16 09:10:48,563 WARN [Listener at jenkins-hbase4.apache.org/33381] hbase.ResourceChecker(130): Thread=705 is superior to 500 2023-07-16 09:10:48,578 DEBUG [Listener at jenkins-hbase4.apache.org/33381] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-16 09:10:48,584 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36816, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-16 09:10:48,592 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-16 09:10:48,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-16 09:10:48,597 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 09:10:48,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-16 09:10:48,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-16 09:10:48,607 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 09:10:48,612 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportWithTargetName/177f67f96d70b3ca6b10a802ab415096 2023-07-16 09:10:48,615 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportWithTargetName/177f67f96d70b3ca6b10a802ab415096 empty. 2023-07-16 09:10:48,616 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportWithTargetName/651c63b2f645b64d6ce1b688a2e7959f 2023-07-16 09:10:48,616 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportWithTargetName/177f67f96d70b3ca6b10a802ab415096 2023-07-16 09:10:48,618 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportWithTargetName/651c63b2f645b64d6ce1b688a2e7959f empty. 2023-07-16 09:10:48,618 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportWithTargetName/651c63b2f645b64d6ce1b688a2e7959f 2023-07-16 09:10:48,619 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-16 09:10:48,653 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-16 09:10:48,655 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 177f67f96d70b3ca6b10a802ab415096, NAME => 'testtb-testExportWithTargetName,,1689498648591.177f67f96d70b3ca6b10a802ab415096.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp 2023-07-16 09:10:48,655 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 651c63b2f645b64d6ce1b688a2e7959f, NAME => 'testtb-testExportWithTargetName,1,1689498648591.651c63b2f645b64d6ce1b688a2e7959f.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp 2023-07-16 09:10:48,705 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689498648591.177f67f96d70b3ca6b10a802ab415096.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:10:48,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-16 09:10:48,707 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 177f67f96d70b3ca6b10a802ab415096, disabling compactions & flushes 2023-07-16 09:10:48,707 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689498648591.177f67f96d70b3ca6b10a802ab415096. 2023-07-16 09:10:48,707 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689498648591.177f67f96d70b3ca6b10a802ab415096. 2023-07-16 09:10:48,707 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689498648591.177f67f96d70b3ca6b10a802ab415096. after waiting 0 ms 2023-07-16 09:10:48,708 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689498648591.177f67f96d70b3ca6b10a802ab415096. 2023-07-16 09:10:48,708 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689498648591.177f67f96d70b3ca6b10a802ab415096. 2023-07-16 09:10:48,708 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 177f67f96d70b3ca6b10a802ab415096: 2023-07-16 09:10:48,710 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689498648591.651c63b2f645b64d6ce1b688a2e7959f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:10:48,710 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 651c63b2f645b64d6ce1b688a2e7959f, disabling compactions & flushes 2023-07-16 09:10:48,710 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689498648591.651c63b2f645b64d6ce1b688a2e7959f. 2023-07-16 09:10:48,710 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689498648591.651c63b2f645b64d6ce1b688a2e7959f. 2023-07-16 09:10:48,710 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689498648591.651c63b2f645b64d6ce1b688a2e7959f. after waiting 0 ms 2023-07-16 09:10:48,710 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689498648591.651c63b2f645b64d6ce1b688a2e7959f. 2023-07-16 09:10:48,710 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689498648591.651c63b2f645b64d6ce1b688a2e7959f. 2023-07-16 09:10:48,710 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 651c63b2f645b64d6ce1b688a2e7959f: 2023-07-16 09:10:48,715 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 09:10:48,717 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689498648591.177f67f96d70b3ca6b10a802ab415096.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689498648717"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498648717"}]},"ts":"1689498648717"} 2023-07-16 09:10:48,717 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689498648591.651c63b2f645b64d6ce1b688a2e7959f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689498648717"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498648717"}]},"ts":"1689498648717"} 2023-07-16 09:10:48,780 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 09:10:48,782 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 09:10:48,782 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498648782"}]},"ts":"1689498648782"} 2023-07-16 09:10:48,784 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-16 09:10:48,789 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 09:10:48,791 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 09:10:48,791 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 09:10:48,791 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 09:10:48,791 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 09:10:48,792 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=177f67f96d70b3ca6b10a802ab415096, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=651c63b2f645b64d6ce1b688a2e7959f, ASSIGN}] 2023-07-16 09:10:48,794 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=177f67f96d70b3ca6b10a802ab415096, ASSIGN 2023-07-16 09:10:48,795 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=651c63b2f645b64d6ce1b688a2e7959f, ASSIGN 2023-07-16 09:10:48,796 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=651c63b2f645b64d6ce1b688a2e7959f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45805,1689498639118; forceNewPlan=false, retain=false 2023-07-16 09:10:48,796 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=177f67f96d70b3ca6b10a802ab415096, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45437,1689498639234; forceNewPlan=false, retain=false 2023-07-16 09:10:48,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-16 09:10:48,946 INFO [jenkins-hbase4:46005] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 09:10:48,948 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=651c63b2f645b64d6ce1b688a2e7959f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:48,948 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=177f67f96d70b3ca6b10a802ab415096, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:48,949 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689498648591.651c63b2f645b64d6ce1b688a2e7959f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689498648948"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498648948"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498648948"}]},"ts":"1689498648948"} 2023-07-16 09:10:48,949 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689498648591.177f67f96d70b3ca6b10a802ab415096.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689498648948"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498648948"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498648948"}]},"ts":"1689498648948"} 2023-07-16 09:10:48,952 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 651c63b2f645b64d6ce1b688a2e7959f, server=jenkins-hbase4.apache.org,45805,1689498639118}] 2023-07-16 09:10:48,954 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 177f67f96d70b3ca6b10a802ab415096, server=jenkins-hbase4.apache.org,45437,1689498639234}] 2023-07-16 09:10:49,115 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689498648591.651c63b2f645b64d6ce1b688a2e7959f. 2023-07-16 09:10:49,115 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689498648591.177f67f96d70b3ca6b10a802ab415096. 2023-07-16 09:10:49,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 651c63b2f645b64d6ce1b688a2e7959f, NAME => 'testtb-testExportWithTargetName,1,1689498648591.651c63b2f645b64d6ce1b688a2e7959f.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 09:10:49,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 177f67f96d70b3ca6b10a802ab415096, NAME => 'testtb-testExportWithTargetName,,1689498648591.177f67f96d70b3ca6b10a802ab415096.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 09:10:49,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689498648591.177f67f96d70b3ca6b10a802ab415096. service=AccessControlService 2023-07-16 09:10:49,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689498648591.651c63b2f645b64d6ce1b688a2e7959f. service=AccessControlService 2023-07-16 09:10:49,117 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:10:49,117 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:10:49,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 177f67f96d70b3ca6b10a802ab415096 2023-07-16 09:10:49,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 651c63b2f645b64d6ce1b688a2e7959f 2023-07-16 09:10:49,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689498648591.177f67f96d70b3ca6b10a802ab415096.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:10:49,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689498648591.651c63b2f645b64d6ce1b688a2e7959f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:10:49,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 177f67f96d70b3ca6b10a802ab415096 2023-07-16 09:10:49,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 651c63b2f645b64d6ce1b688a2e7959f 2023-07-16 09:10:49,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 177f67f96d70b3ca6b10a802ab415096 2023-07-16 09:10:49,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 651c63b2f645b64d6ce1b688a2e7959f 2023-07-16 09:10:49,124 INFO [StoreOpener-177f67f96d70b3ca6b10a802ab415096-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 177f67f96d70b3ca6b10a802ab415096 2023-07-16 09:10:49,124 INFO [StoreOpener-651c63b2f645b64d6ce1b688a2e7959f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 651c63b2f645b64d6ce1b688a2e7959f 2023-07-16 09:10:49,127 DEBUG [StoreOpener-651c63b2f645b64d6ce1b688a2e7959f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportWithTargetName/651c63b2f645b64d6ce1b688a2e7959f/cf 2023-07-16 09:10:49,127 DEBUG [StoreOpener-651c63b2f645b64d6ce1b688a2e7959f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportWithTargetName/651c63b2f645b64d6ce1b688a2e7959f/cf 2023-07-16 09:10:49,127 DEBUG [StoreOpener-177f67f96d70b3ca6b10a802ab415096-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportWithTargetName/177f67f96d70b3ca6b10a802ab415096/cf 2023-07-16 09:10:49,127 DEBUG [StoreOpener-177f67f96d70b3ca6b10a802ab415096-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportWithTargetName/177f67f96d70b3ca6b10a802ab415096/cf 2023-07-16 09:10:49,131 INFO [StoreOpener-177f67f96d70b3ca6b10a802ab415096-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 177f67f96d70b3ca6b10a802ab415096 columnFamilyName cf 2023-07-16 09:10:49,131 INFO [StoreOpener-651c63b2f645b64d6ce1b688a2e7959f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 651c63b2f645b64d6ce1b688a2e7959f columnFamilyName cf 2023-07-16 09:10:49,136 INFO [StoreOpener-651c63b2f645b64d6ce1b688a2e7959f-1] regionserver.HStore(310): Store=651c63b2f645b64d6ce1b688a2e7959f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:10:49,136 INFO [StoreOpener-177f67f96d70b3ca6b10a802ab415096-1] regionserver.HStore(310): Store=177f67f96d70b3ca6b10a802ab415096/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:10:49,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportWithTargetName/177f67f96d70b3ca6b10a802ab415096 2023-07-16 09:10:49,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportWithTargetName/177f67f96d70b3ca6b10a802ab415096 2023-07-16 09:10:49,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportWithTargetName/651c63b2f645b64d6ce1b688a2e7959f 2023-07-16 09:10:49,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportWithTargetName/651c63b2f645b64d6ce1b688a2e7959f 2023-07-16 09:10:49,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 651c63b2f645b64d6ce1b688a2e7959f 2023-07-16 09:10:49,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 177f67f96d70b3ca6b10a802ab415096 2023-07-16 09:10:49,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportWithTargetName/651c63b2f645b64d6ce1b688a2e7959f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 09:10:49,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportWithTargetName/177f67f96d70b3ca6b10a802ab415096/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 09:10:49,166 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 177f67f96d70b3ca6b10a802ab415096; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73239112, jitterRate=0.09134781360626221}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 09:10:49,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 177f67f96d70b3ca6b10a802ab415096: 2023-07-16 09:10:49,168 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689498648591.177f67f96d70b3ca6b10a802ab415096., pid=16, masterSystemTime=1689498649106 2023-07-16 09:10:49,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689498648591.177f67f96d70b3ca6b10a802ab415096. 2023-07-16 09:10:49,172 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689498648591.177f67f96d70b3ca6b10a802ab415096. 2023-07-16 09:10:49,174 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=177f67f96d70b3ca6b10a802ab415096, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:49,175 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 651c63b2f645b64d6ce1b688a2e7959f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71031678, jitterRate=0.0584544837474823}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 09:10:49,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 651c63b2f645b64d6ce1b688a2e7959f: 2023-07-16 09:10:49,175 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689498648591.177f67f96d70b3ca6b10a802ab415096.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689498649174"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689498649174"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689498649174"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689498649174"}]},"ts":"1689498649174"} 2023-07-16 09:10:49,180 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689498648591.651c63b2f645b64d6ce1b688a2e7959f., pid=15, masterSystemTime=1689498649105 2023-07-16 09:10:49,184 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=651c63b2f645b64d6ce1b688a2e7959f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:49,187 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689498648591.651c63b2f645b64d6ce1b688a2e7959f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689498649183"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689498649183"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689498649183"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689498649183"}]},"ts":"1689498649183"} 2023-07-16 09:10:49,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689498648591.651c63b2f645b64d6ce1b688a2e7959f. 2023-07-16 09:10:49,188 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689498648591.651c63b2f645b64d6ce1b688a2e7959f. 2023-07-16 09:10:49,203 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-16 09:10:49,205 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 177f67f96d70b3ca6b10a802ab415096, server=jenkins-hbase4.apache.org,45437,1689498639234 in 228 msec 2023-07-16 09:10:49,208 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=177f67f96d70b3ca6b10a802ab415096, ASSIGN in 412 msec 2023-07-16 09:10:49,209 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-16 09:10:49,209 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 651c63b2f645b64d6ce1b688a2e7959f, server=jenkins-hbase4.apache.org,45805,1689498639118 in 253 msec 2023-07-16 09:10:49,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-16 09:10:49,215 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-16 09:10:49,215 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=651c63b2f645b64d6ce1b688a2e7959f, ASSIGN in 417 msec 2023-07-16 09:10:49,216 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 09:10:49,216 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498649216"}]},"ts":"1689498649216"} 2023-07-16 09:10:49,219 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-16 09:10:49,223 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 09:10:49,229 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-16 09:10:49,243 DEBUG [PEWorker-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:10:49,252 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42166, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:10:49,257 DEBUG [hconnection-0x473faf76-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:10:49,260 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44830, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-07-16 09:10:49,271 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37709] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-16 09:10:49,306 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-16 09:10:49,306 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-16 09:10:49,306 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-16 09:10:49,306 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-16 09:10:49,306 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 09:10:49,315 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 09:10:49,315 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 09:10:49,315 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-16 09:10:49,316 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-16 09:10:49,318 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-16 09:10:49,318 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-16 09:10:49,321 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 724 msec 2023-07-16 09:10:49,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-16 09:10:49,714 INFO [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-16 09:10:49,718 DEBUG [Listener at jenkins-hbase4.apache.org/33381] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-16 09:10:49,719 DEBUG [Listener at jenkins-hbase4.apache.org/33381] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689498648591.177f67f96d70b3ca6b10a802ab415096. 2023-07-16 09:10:49,722 INFO [Listener at jenkins-hbase4.apache.org/33381] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 09:10:49,747 DEBUG [hconnection-0x4968aca5-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:10:49,752 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33404, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:10:49,769 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 09:10:49,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689498649769 (current time:1689498649769). 2023-07-16 09:10:49,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 09:10:49,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(139): Connect 0x34465087 to 127.0.0.1:64380 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:10:49,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24eff71c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:10:49,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:10:49,781 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44838, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:10:49,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34465087 to 127.0.0.1:64380 2023-07-16 09:10:49,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:10:49,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(139): Connect 0x107cd55b to 127.0.0.1:64380 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:10:49,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f10700c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:10:49,794 DEBUG [hconnection-0x297b343b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:10:49,795 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44842, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:10:49,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:10:49,801 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42168, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:10:49,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x107cd55b to 127.0.0.1:64380 2023-07-16 09:10:49,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:10:49,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-16 09:10:49,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 09:10:49,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 09:10:49,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 09:10:49,852 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 09:10:49,854 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689499249854 2023-07-16 09:10:49,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 09:10:49,854 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-16 09:10:49,857 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 09:10:49,859 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 09:10:49,860 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 14 msec 2023-07-16 09:10:49,861 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 09:10:49,861 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 09:10:49,862 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 09:10:49,862 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689499249862 2023-07-16 09:10:49,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:49,885 INFO [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-16 09:10:49,885 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:10:49,887 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-16 09:10:49,887 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-16 09:10:49,908 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:49,908 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:49,917 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:10:49,917 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:10:49,917 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:49,917 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:10:49,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:10:49,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:10:49,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:10:49,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:10:49,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:10:49,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:10:49,918 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:49,918 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:49,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:49,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:49,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:49,919 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:49,919 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 09:10:49,919 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:49,919 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:49,919 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:49,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-16 09:10:49,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-16 09:10:49,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-16 09:10:49,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:49,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:49,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:49,921 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 09:10:49,921 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 09:10:49,922 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 09:10:49,924 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:49,924 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:49,924 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:49,924 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 09:10:49,924 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 09:10:49,924 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 09:10:49,924 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:10:49,924 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:10:49,925 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 09:10:49,926 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 09:10:49,926 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-16 09:10:49,924 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:10:49,926 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45805,1689498639118' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-16 09:10:49,927 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 09:10:49,927 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-16 09:10:49,926 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-16 09:10:49,927 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37709,1689498639179' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-16 09:10:49,927 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45437,1689498639234' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-16 09:10:49,929 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:49,929 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:49,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:49,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:10:49,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:10:49,930 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:49,930 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:49,930 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:49,930 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:49,931 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:10:49,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:10:49,931 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:49,931 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:10:49,931 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:49,932 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:10:49,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:10:49,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:49,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:10:49,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:49,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:49,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:10:49,934 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45805,1689498639118' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-16 09:10:49,935 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54a5e671[Count = 1] remaining members to acquire global barrier 2023-07-16 09:10:49,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:49,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:10:49,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:10:49,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:10:49,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:10:49,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:49,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:10:49,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:49,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:49,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:10:49,938 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45437,1689498639234' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-16 09:10:49,938 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54a5e671[Count = 0] remaining members to acquire global barrier 2023-07-16 09:10:49,938 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-16 09:10:49,938 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:49,941 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:49,941 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:49,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:49,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:49,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:49,941 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:49,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:49,941 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 09:10:49,941 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-16 09:10:49,941 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 09:10:49,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:49,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:49,941 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37709,1689498639179' in zk 2023-07-16 09:10:49,942 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:49,944 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:49,944 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 09:10:49,946 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 09:10:49,952 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:10:49,952 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:10:49,952 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689498648591.177f67f96d70b3ca6b10a802ab415096. 2023-07-16 09:10:49,952 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 09:10:49,952 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:10:49,952 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-16 09:10:49,952 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689498648591.177f67f96d70b3ca6b10a802ab415096. started... 2023-07-16 09:10:49,952 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:10:49,953 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:10:49,953 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689498648591.651c63b2f645b64d6ce1b688a2e7959f. 2023-07-16 09:10:49,953 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689498648591.651c63b2f645b64d6ce1b688a2e7959f. started... 2023-07-16 09:10:49,956 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 651c63b2f645b64d6ce1b688a2e7959f: 2023-07-16 09:10:49,956 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 177f67f96d70b3ca6b10a802ab415096: 2023-07-16 09:10:49,957 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689498648591.651c63b2f645b64d6ce1b688a2e7959f.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:49,957 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689498648591.177f67f96d70b3ca6b10a802ab415096.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:49,962 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:10:49,963 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:10:49,963 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:10:49,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 09:10:49,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:10:49,967 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 09:10:49,967 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 09:10:49,967 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 09:10:50,002 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689498648591.177f67f96d70b3ca6b10a802ab415096. completed. 2023-07-16 09:10:50,002 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689498648591.177f67f96d70b3ca6b10a802ab415096. 2023-07-16 09:10:50,003 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:10:50,003 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:10:50,003 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:50,003 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-16 09:10:50,003 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45437,1689498639234' in zk 2023-07-16 09:10:50,005 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689498648591.651c63b2f645b64d6ce1b688a2e7959f. completed. 2023-07-16 09:10:50,005 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689498648591.651c63b2f645b64d6ce1b688a2e7959f. 2023-07-16 09:10:50,005 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:10:50,005 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:10:50,005 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:50,005 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-16 09:10:50,005 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45805,1689498639118' in zk 2023-07-16 09:10:50,006 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:50,006 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 09:10:50,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:50,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:10:50,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:10:50,006 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:10:50,006 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-16 09:10:50,008 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 09:10:50,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:10:50,008 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:50,008 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:10:50,008 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-16 09:10:50,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:10:50,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:10:50,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:50,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:50,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:10:50,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:10:50,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:50,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:50,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45437,1689498639234': 2023-07-16 09:10:50,014 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45437,1689498639234' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-16 09:10:50,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:50,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:10:50,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:10:50,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:10:50,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:10:50,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:10:50,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:50,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:50,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:10:50,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:10:50,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:50,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:50,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45805,1689498639118': 2023-07-16 09:10:50,020 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45805,1689498639118' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-16 09:10:50,020 INFO [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-16 09:10:50,021 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 09:10:50,021 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 09:10:50,021 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,021 INFO [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 09:10:50,024 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,024 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,024 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,024 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:10:50,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,024 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:10:50,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:10:50,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:10:50,024 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,025 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:10:50,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:10:50,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:10:50,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:10:50,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:10:50,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:10:50,025 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:10:50,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:10:50,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:10:50,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,026 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:50,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:10:50,027 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:50,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:10:50,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:50,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:50,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:10:50,029 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:10:50,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,029 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:50,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:10:50,030 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:50,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:50,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:50,043 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:50,043 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,043 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:50,043 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:10:50,043 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,043 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:10:50,043 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:10:50,043 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:50,043 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,043 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:50,043 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:10:50,043 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:10:50,043 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,044 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:10:50,044 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-16 09:10:50,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:10:50,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:10:50,044 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,045 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 09:10:50,043 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:10:50,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:10:50,044 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:10:50,044 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:10:50,045 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,045 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:10:50,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:10:50,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:10:50,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:10:50,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:10:50,046 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-16 09:10:50,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:10:50,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:10:50,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:10:50,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:10:50,062 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,065 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,110 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,144 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-16 09:10:50,144 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,144 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-16 09:10:50,145 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689498649854Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689498650062 (+208 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689498650062Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689498650062Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689498650074 (+12 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689498650098 (+24 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689498650144 (+46 ms) 2023-07-16 09:10:50,146 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 09:10:50,149 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 290 msec 2023-07-16 09:10:50,167 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:10:50,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 09:10:50,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 09:10:50,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45437] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689498648591.177f67f96d70b3ca6b10a802ab415096. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 09:10:50,186 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45805] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689498648591.651c63b2f645b64d6ce1b688a2e7959f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 09:10:50,192 DEBUG [Listener at jenkins-hbase4.apache.org/33381] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-16 09:10:50,193 DEBUG [Listener at jenkins-hbase4.apache.org/33381] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689498648591.177f67f96d70b3ca6b10a802ab415096. 2023-07-16 09:10:50,193 INFO [Listener at jenkins-hbase4.apache.org/33381] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 09:10:50,210 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 09:10:50,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689498650210 (current time:1689498650210). 2023-07-16 09:10:50,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 09:10:50,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(139): Connect 0x0a43dad9 to 127.0.0.1:64380 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:10:50,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70844402, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:10:50,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:10:50,227 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44852, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:10:50,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a43dad9 to 127.0.0.1:64380 2023-07-16 09:10:50,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:10:50,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(139): Connect 0x59201b62 to 127.0.0.1:64380 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:10:50,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4da1978d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:10:50,237 DEBUG [hconnection-0x1fd76e6f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:10:50,240 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44862, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:10:50,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:10:50,250 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42170, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:10:50,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x59201b62 to 127.0.0.1:64380 2023-07-16 09:10:50,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:10:50,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-16 09:10:50,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 09:10:50,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 09:10:50,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 09:10:50,257 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 09:10:50,259 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689499250259 2023-07-16 09:10:50,259 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-16 09:10:50,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-16 09:10:50,260 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 09:10:50,260 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 09:10:50,261 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 09:10:50,262 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-16 09:10:50,267 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 7 msec 2023-07-16 09:10:50,268 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 09:10:50,269 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689499250269 2023-07-16 09:10:50,297 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-16 09:10:50,297 INFO [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-16 09:10:50,297 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:10:50,298 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-16 09:10:50,298 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-16 09:10:50,355 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 09:10:50,355 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 09:10:50,357 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:10:50,357 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:10:50,357 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:50,357 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:10:50,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:10:50,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:10:50,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:10:50,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:10:50,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:10:50,358 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:50,358 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:50,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:10:50,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 09:10:50,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 09:10:50,359 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:50,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 09:10:50,359 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 09:10:50,359 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 09:10:50,360 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 09:10:50,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-16 09:10:50,360 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 09:10:50,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 09:10:50,360 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 09:10:50,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-16 09:10:50,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 09:10:50,361 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 09:10:50,361 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-16 09:10:50,361 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 09:10:50,361 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-16 09:10:50,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-16 09:10:50,361 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 09:10:50,361 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:10:50,361 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:10:50,363 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 09:10:50,364 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-16 09:10:50,364 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45805,1689498639118' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-16 09:10:50,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 09:10:50,363 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:10:50,364 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-16 09:10:50,364 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 09:10:50,364 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-16 09:10:50,364 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37709,1689498639179' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-16 09:10:50,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 09:10:50,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:10:50,367 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 09:10:50,368 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-16 09:10:50,369 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-16 09:10:50,369 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:10:50,370 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-16 09:10:50,370 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-16 09:10:50,370 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45437,1689498639234' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-16 09:10:50,370 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:50,370 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 09:10:50,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:50,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:10:50,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:10:50,372 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 09:10:50,372 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 09:10:50,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:10:50,372 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:10:50,373 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:50,373 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 09:10:50,373 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 09:10:50,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:10:50,373 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:10:50,373 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 09:10:50,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 09:10:50,373 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:10:50,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:10:50,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:50,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:50,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:10:50,375 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45805,1689498639118' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-16 09:10:50,376 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c3c846a[Count = 1] remaining members to acquire global barrier 2023-07-16 09:10:50,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:50,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:10:50,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:10:50,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:10:50,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:10:50,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 09:10:50,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:10:50,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:50,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:50,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:10:50,379 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45437,1689498639234' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-16 09:10:50,379 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c3c846a[Count = 0] remaining members to acquire global barrier 2023-07-16 09:10:50,379 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-16 09:10:50,379 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 09:10:50,385 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 09:10:50,385 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 09:10:50,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 09:10:50,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 09:10:50,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 09:10:50,385 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 09:10:50,385 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 09:10:50,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 09:10:50,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 09:10:50,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 09:10:50,385 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 09:10:50,385 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:10:50,385 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:50,385 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-16 09:10:50,385 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:10:50,386 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-16 09:10:50,386 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37709,1689498639179' in zk 2023-07-16 09:10:50,386 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689498648591.651c63b2f645b64d6ce1b688a2e7959f. 2023-07-16 09:10:50,386 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689498648591.651c63b2f645b64d6ce1b688a2e7959f. started... 2023-07-16 09:10:50,386 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:10:50,386 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:10:50,386 INFO [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 651c63b2f645b64d6ce1b688a2e7959f 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-16 09:10:50,386 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689498648591.177f67f96d70b3ca6b10a802ab415096. 2023-07-16 09:10:50,387 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689498648591.177f67f96d70b3ca6b10a802ab415096. started... 2023-07-16 09:10:50,386 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:50,387 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 09:10:50,387 INFO [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 177f67f96d70b3ca6b10a802ab415096 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-16 09:10:50,389 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 09:10:50,389 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:10:50,389 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-16 09:10:50,567 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:10:50,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 09:10:50,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:10:50,569 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 09:10:50,572 INFO [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230716be97e75c0b004ba0bb0dd6b6f058a7e5 to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230716be97e75c0b004ba0bb0dd6b6f058a7e5 2023-07-16 09:10:50,595 INFO [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportWithTargetName/651c63b2f645b64d6ce1b688a2e7959f/.tmp/cf/a6d9dc40236945429a24145bb60bcb4c 2023-07-16 09:10:50,606 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportWithTargetName/651c63b2f645b64d6ce1b688a2e7959f/.tmp/cf/a6d9dc40236945429a24145bb60bcb4c as hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportWithTargetName/651c63b2f645b64d6ce1b688a2e7959f/cf/a6d9dc40236945429a24145bb60bcb4c 2023-07-16 09:10:50,616 INFO [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportWithTargetName/651c63b2f645b64d6ce1b688a2e7959f/cf/a6d9dc40236945429a24145bb60bcb4c, entries=48, sequenceid=6, filesize=13.0 K 2023-07-16 09:10:50,618 INFO [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 651c63b2f645b64d6ce1b688a2e7959f in 232ms, sequenceid=6, compaction requested=false 2023-07-16 09:10:50,618 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-16 09:10:50,619 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 651c63b2f645b64d6ce1b688a2e7959f: 2023-07-16 09:10:50,619 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689498648591.651c63b2f645b64d6ce1b688a2e7959f.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-16 09:10:50,620 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:10:50,620 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportWithTargetName/651c63b2f645b64d6ce1b688a2e7959f/cf/a6d9dc40236945429a24145bb60bcb4c] hfiles 2023-07-16 09:10:50,620 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportWithTargetName/651c63b2f645b64d6ce1b688a2e7959f/cf/a6d9dc40236945429a24145bb60bcb4c for snapshot=snaptb0-testExportWithTargetName 2023-07-16 09:10:50,639 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689498648591.651c63b2f645b64d6ce1b688a2e7959f. completed. 2023-07-16 09:10:50,639 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689498648591.651c63b2f645b64d6ce1b688a2e7959f. 2023-07-16 09:10:50,639 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:10:50,640 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:10:50,640 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:50,640 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-16 09:10:50,640 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45805,1689498639118' in zk 2023-07-16 09:10:50,642 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 09:10:50,642 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:50,642 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:10:50,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:50,642 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-16 09:10:50,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:10:50,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:10:50,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:10:50,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:10:50,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 09:10:50,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:10:50,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:50,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:50,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:10:50,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 09:10:50,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:10:50,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:50,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45805,1689498639118': 2023-07-16 09:10:50,647 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45805,1689498639118' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-16 09:10:50,869 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:10:50,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 09:10:50,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:10:50,871 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-16 09:10:50,929 INFO [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230716599b64dc089840079934888b2b6c8209 to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230716599b64dc089840079934888b2b6c8209 2023-07-16 09:10:50,966 INFO [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportWithTargetName/177f67f96d70b3ca6b10a802ab415096/.tmp/cf/77191b760ca54a7a8eca3953372f2e4a 2023-07-16 09:10:50,979 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportWithTargetName/177f67f96d70b3ca6b10a802ab415096/.tmp/cf/77191b760ca54a7a8eca3953372f2e4a as hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportWithTargetName/177f67f96d70b3ca6b10a802ab415096/cf/77191b760ca54a7a8eca3953372f2e4a 2023-07-16 09:10:50,997 INFO [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportWithTargetName/177f67f96d70b3ca6b10a802ab415096/cf/77191b760ca54a7a8eca3953372f2e4a, entries=2, sequenceid=6, filesize=5.2 K 2023-07-16 09:10:51,000 INFO [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 177f67f96d70b3ca6b10a802ab415096 in 613ms, sequenceid=6, compaction requested=false 2023-07-16 09:10:51,002 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 177f67f96d70b3ca6b10a802ab415096: 2023-07-16 09:10:51,002 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689498648591.177f67f96d70b3ca6b10a802ab415096.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-16 09:10:51,002 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:10:51,002 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportWithTargetName/177f67f96d70b3ca6b10a802ab415096/cf/77191b760ca54a7a8eca3953372f2e4a] hfiles 2023-07-16 09:10:51,002 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportWithTargetName/177f67f96d70b3ca6b10a802ab415096/cf/77191b760ca54a7a8eca3953372f2e4a for snapshot=snaptb0-testExportWithTargetName 2023-07-16 09:10:51,054 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689498648591.177f67f96d70b3ca6b10a802ab415096. completed. 2023-07-16 09:10:51,054 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689498648591.177f67f96d70b3ca6b10a802ab415096. 2023-07-16 09:10:51,054 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:10:51,055 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:10:51,055 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:51,055 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-16 09:10:51,055 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45437,1689498639234' in zk 2023-07-16 09:10:51,057 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:51,058 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-16 09:10:51,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:51,058 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:10:51,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:10:51,058 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-16 09:10:51,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:10:51,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:10:51,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:10:51,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 09:10:51,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:10:51,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:51,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:51,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:10:51,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 09:10:51,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:10:51,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:51,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:51,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45437,1689498639234': 2023-07-16 09:10:51,068 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45437,1689498639234' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-16 09:10:51,068 INFO [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-16 09:10:51,068 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 09:10:51,068 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 09:10:51,068 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-16 09:10:51,068 INFO [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 09:10:51,072 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,072 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,072 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,072 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:10:51,072 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:10:51,072 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:10:51,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,072 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:10:51,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:10:51,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:10:51,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:10:51,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:10:51,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:10:51,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:10:51,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:10:51,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:10:51,075 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:10:51,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 09:10:51,076 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:51,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:10:51,077 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:51,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 09:10:51,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:10:51,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:51,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:51,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:10:51,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-16 09:10:51,080 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:10:51,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:10:51,081 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:51,081 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:51,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:51,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:51,096 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:10:51,096 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:10:51,096 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:10:51,096 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:10:51,096 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:51,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:10:51,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:10:51,096 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,096 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:51,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:10:51,096 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:10:51,096 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:10:51,096 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-16 09:10:51,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:10:51,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:10:51,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:10:51,096 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:10:51,097 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName because node does not exist (not an error) 2023-07-16 09:10:51,097 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-16 09:10:51,096 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:10:51,098 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,098 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-16 09:10:51,098 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:10:51,098 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 09:10:51,099 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:10:51,099 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:10:51,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:10:51,099 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:10:51,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:10:51,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:10:51,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:10:51,099 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:10:51,099 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,100 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230716be97e75c0b004ba0bb0dd6b6f058a7e5, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230716599b64dc089840079934888b2b6c8209] mob files 2023-07-16 09:10:51,100 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230716be97e75c0b004ba0bb0dd6b6f058a7e5 2023-07-16 09:10:51,100 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230716599b64dc089840079934888b2b6c8209 2023-07-16 09:10:51,139 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-16 09:10:51,141 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,276 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,342 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-16 09:10:51,342 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,343 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-16 09:10:51,343 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689498650259Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689498651139 (+880 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689498651139Loading Region manifests for snaptb0-testExportWithTargetName at 1689498651140 (+1 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1689498651180 (+40 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689498651233 (+53 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689498651342 (+109 ms) 2023-07-16 09:10:51,345 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-16 09:10:51,348 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 1.0850 sec 2023-07-16 09:10:51,371 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:10:51,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-16 09:10:51,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 09:10:51,376 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498651376 2023-07-16 09:10:51,377 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43477, tgtDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498651376, rawTgtDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498651376, srcFsUri=hdfs://localhost:43477, srcDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae 2023-07-16 09:10:51,439 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43477, inputRoot=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae 2023-07-16 09:10:51,439 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-881635222_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498651376, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498651376/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-16 09:10:51,439 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43477, inputRoot=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae, snapshotDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-16 09:10:51,474 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498651376/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-16 09:10:51,609 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 09:10:51,610 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 09:10:51,611 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 09:10:51,611 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 09:10:51,612 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-16 09:10:51,612 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 09:10:51,613 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 09:10:51,700 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/hadoop-8594809277045147369.jar 2023-07-16 09:10:51,700 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 09:10:51,701 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 09:10:51,701 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 09:10:51,702 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 09:10:51,702 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 09:10:51,702 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 09:10:51,703 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 09:10:51,703 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 09:10:51,704 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 09:10:51,704 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 09:10:51,705 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 09:10:51,705 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 09:10:51,706 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 09:10:51,706 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 09:10:51,707 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 09:10:51,707 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 09:10:51,711 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:10:51,711 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:10:51,711 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 09:10:51,712 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:10:51,712 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:10:51,713 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 09:10:51,713 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 09:10:53,341 WARN [Listener at jenkins-hbase4.apache.org/33381] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 09:10:53,347 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-16 09:10:53,355 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-16 09:10:53,924 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 09:10:53,925 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 09:10:54,267 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647086_0001_000001 (auth:SIMPLE) 2023-07-16 09:10:54,631 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 09:10:59,951 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647086_0001_000001 (auth:SIMPLE) 2023-07-16 09:11:02,233 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647086_0001_000001 (auth:SIMPLE) 2023-07-16 09:11:05,526 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647086_0001_000001 (auth:SIMPLE) 2023-07-16 09:11:07,313 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 09:11:07,315 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 09:11:07,326 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-16 09:11:07,326 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 09:11:07,327 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 09:11:07,327 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_583604367_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-16 09:11:07,328 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(367): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-16 09:11:07,328 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(367): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-16 09:11:07,328 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_583604367_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498651376/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498651376/.hbase-snapshot/testExportWithTargetName 2023-07-16 09:11:07,328 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(367): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498651376/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-16 09:11:07,328 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(367): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498651376/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-16 09:11:07,340 INFO [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-16 09:11:07,344 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-16 09:11:07,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-16 09:11:07,357 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498667357"}]},"ts":"1689498667357"} 2023-07-16 09:11:07,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-16 09:11:07,359 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-16 09:11:07,361 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-16 09:11:07,363 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=177f67f96d70b3ca6b10a802ab415096, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=651c63b2f645b64d6ce1b688a2e7959f, UNASSIGN}] 2023-07-16 09:11:07,365 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=651c63b2f645b64d6ce1b688a2e7959f, UNASSIGN 2023-07-16 09:11:07,365 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=177f67f96d70b3ca6b10a802ab415096, UNASSIGN 2023-07-16 09:11:07,366 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=651c63b2f645b64d6ce1b688a2e7959f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:07,366 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=177f67f96d70b3ca6b10a802ab415096, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:07,366 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689498648591.651c63b2f645b64d6ce1b688a2e7959f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689498667366"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498667366"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498667366"}]},"ts":"1689498667366"} 2023-07-16 09:11:07,366 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689498648591.177f67f96d70b3ca6b10a802ab415096.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689498667366"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498667366"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498667366"}]},"ts":"1689498667366"} 2023-07-16 09:11:07,368 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 651c63b2f645b64d6ce1b688a2e7959f, server=jenkins-hbase4.apache.org,45805,1689498639118}] 2023-07-16 09:11:07,369 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 177f67f96d70b3ca6b10a802ab415096, server=jenkins-hbase4.apache.org,45437,1689498639234}] 2023-07-16 09:11:07,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-16 09:11:07,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 177f67f96d70b3ca6b10a802ab415096 2023-07-16 09:11:07,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 177f67f96d70b3ca6b10a802ab415096, disabling compactions & flushes 2023-07-16 09:11:07,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689498648591.177f67f96d70b3ca6b10a802ab415096. 2023-07-16 09:11:07,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689498648591.177f67f96d70b3ca6b10a802ab415096. 2023-07-16 09:11:07,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689498648591.177f67f96d70b3ca6b10a802ab415096. after waiting 0 ms 2023-07-16 09:11:07,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689498648591.177f67f96d70b3ca6b10a802ab415096. 2023-07-16 09:11:07,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 651c63b2f645b64d6ce1b688a2e7959f 2023-07-16 09:11:07,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 651c63b2f645b64d6ce1b688a2e7959f, disabling compactions & flushes 2023-07-16 09:11:07,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689498648591.651c63b2f645b64d6ce1b688a2e7959f. 2023-07-16 09:11:07,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689498648591.651c63b2f645b64d6ce1b688a2e7959f. 2023-07-16 09:11:07,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689498648591.651c63b2f645b64d6ce1b688a2e7959f. after waiting 0 ms 2023-07-16 09:11:07,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689498648591.651c63b2f645b64d6ce1b688a2e7959f. 2023-07-16 09:11:07,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportWithTargetName/651c63b2f645b64d6ce1b688a2e7959f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 09:11:07,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:11:07,563 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportWithTargetName/177f67f96d70b3ca6b10a802ab415096/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 09:11:07,563 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689498648591.651c63b2f645b64d6ce1b688a2e7959f. 2023-07-16 09:11:07,563 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 651c63b2f645b64d6ce1b688a2e7959f: 2023-07-16 09:11:07,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:11:07,565 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689498648591.177f67f96d70b3ca6b10a802ab415096. 2023-07-16 09:11:07,565 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 177f67f96d70b3ca6b10a802ab415096: 2023-07-16 09:11:07,567 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 651c63b2f645b64d6ce1b688a2e7959f 2023-07-16 09:11:07,568 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=651c63b2f645b64d6ce1b688a2e7959f, regionState=CLOSED 2023-07-16 09:11:07,569 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689498648591.651c63b2f645b64d6ce1b688a2e7959f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689498667568"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498667568"}]},"ts":"1689498667568"} 2023-07-16 09:11:07,572 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 177f67f96d70b3ca6b10a802ab415096 2023-07-16 09:11:07,572 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=177f67f96d70b3ca6b10a802ab415096, regionState=CLOSED 2023-07-16 09:11:07,572 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689498648591.177f67f96d70b3ca6b10a802ab415096.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689498667572"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498667572"}]},"ts":"1689498667572"} 2023-07-16 09:11:07,576 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-16 09:11:07,576 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 651c63b2f645b64d6ce1b688a2e7959f, server=jenkins-hbase4.apache.org,45805,1689498639118 in 203 msec 2023-07-16 09:11:07,580 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=651c63b2f645b64d6ce1b688a2e7959f, UNASSIGN in 213 msec 2023-07-16 09:11:07,580 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-16 09:11:07,580 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 177f67f96d70b3ca6b10a802ab415096, server=jenkins-hbase4.apache.org,45437,1689498639234 in 206 msec 2023-07-16 09:11:07,583 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-16 09:11:07,583 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=177f67f96d70b3ca6b10a802ab415096, UNASSIGN in 217 msec 2023-07-16 09:11:07,584 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498667584"}]},"ts":"1689498667584"} 2023-07-16 09:11:07,586 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-16 09:11:07,587 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-16 09:11:07,590 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 241 msec 2023-07-16 09:11:07,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-16 09:11:07,660 INFO [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-16 09:11:07,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-16 09:11:07,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 09:11:07,681 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 09:11:07,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-16 09:11:07,684 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 09:11:07,687 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37709] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-16 09:11:07,690 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 09:11:07,690 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 09:11:07,690 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 09:11:07,690 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 09:11:07,691 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-16 09:11:07,691 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-16 09:11:07,691 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-16 09:11:07,691 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-16 09:11:07,692 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportWithTargetName/177f67f96d70b3ca6b10a802ab415096 2023-07-16 09:11:07,692 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportWithTargetName/651c63b2f645b64d6ce1b688a2e7959f 2023-07-16 09:11:07,693 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 09:11:07,693 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:07,693 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 09:11:07,693 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 09:11:07,693 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-16 09:11:07,693 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:07,694 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:07,693 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:07,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-16 09:11:07,698 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportWithTargetName/177f67f96d70b3ca6b10a802ab415096/cf, FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportWithTargetName/177f67f96d70b3ca6b10a802ab415096/recovered.edits] 2023-07-16 09:11:07,698 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportWithTargetName/651c63b2f645b64d6ce1b688a2e7959f/cf, FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportWithTargetName/651c63b2f645b64d6ce1b688a2e7959f/recovered.edits] 2023-07-16 09:11:07,709 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportWithTargetName/177f67f96d70b3ca6b10a802ab415096/cf/77191b760ca54a7a8eca3953372f2e4a to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testExportWithTargetName/177f67f96d70b3ca6b10a802ab415096/cf/77191b760ca54a7a8eca3953372f2e4a 2023-07-16 09:11:07,709 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportWithTargetName/651c63b2f645b64d6ce1b688a2e7959f/cf/a6d9dc40236945429a24145bb60bcb4c to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testExportWithTargetName/651c63b2f645b64d6ce1b688a2e7959f/cf/a6d9dc40236945429a24145bb60bcb4c 2023-07-16 09:11:07,715 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportWithTargetName/177f67f96d70b3ca6b10a802ab415096/recovered.edits/9.seqid to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testExportWithTargetName/177f67f96d70b3ca6b10a802ab415096/recovered.edits/9.seqid 2023-07-16 09:11:07,715 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportWithTargetName/651c63b2f645b64d6ce1b688a2e7959f/recovered.edits/9.seqid to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testExportWithTargetName/651c63b2f645b64d6ce1b688a2e7959f/recovered.edits/9.seqid 2023-07-16 09:11:07,715 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportWithTargetName/177f67f96d70b3ca6b10a802ab415096 2023-07-16 09:11:07,716 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportWithTargetName/651c63b2f645b64d6ce1b688a2e7959f 2023-07-16 09:11:07,716 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-16 09:11:07,716 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-16 09:11:07,717 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-16 09:11:07,722 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230716be97e75c0b004ba0bb0dd6b6f058a7e5 to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230716be97e75c0b004ba0bb0dd6b6f058a7e5 2023-07-16 09:11:07,724 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230716599b64dc089840079934888b2b6c8209 to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230716599b64dc089840079934888b2b6c8209 2023-07-16 09:11:07,724 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-16 09:11:07,728 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 09:11:07,751 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-16 09:11:07,754 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-16 09:11:07,756 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 09:11:07,756 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-16 09:11:07,756 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689498648591.177f67f96d70b3ca6b10a802ab415096.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689498667756"}]},"ts":"9223372036854775807"} 2023-07-16 09:11:07,756 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689498648591.651c63b2f645b64d6ce1b688a2e7959f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689498667756"}]},"ts":"9223372036854775807"} 2023-07-16 09:11:07,759 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 09:11:07,759 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 177f67f96d70b3ca6b10a802ab415096, NAME => 'testtb-testExportWithTargetName,,1689498648591.177f67f96d70b3ca6b10a802ab415096.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 651c63b2f645b64d6ce1b688a2e7959f, NAME => 'testtb-testExportWithTargetName,1,1689498648591.651c63b2f645b64d6ce1b688a2e7959f.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 09:11:07,759 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-16 09:11:07,760 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689498667759"}]},"ts":"9223372036854775807"} 2023-07-16 09:11:07,770 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-16 09:11:07,773 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-16 09:11:07,776 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 105 msec 2023-07-16 09:11:07,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-16 09:11:07,800 INFO [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-16 09:11:07,823 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-16 09:11:07,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-16 09:11:07,830 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-16 09:11:07,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-16 09:11:07,863 INFO [Listener at jenkins-hbase4.apache.org/33381] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=751 (was 705) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/cluster_b4b9d27b-ece6-8fd0-070d-ff06f0633057/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/cluster_b4b9d27b-ece6-8fd0-070d-ff06f0633057/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x404319e1-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1955405206_1 at /127.0.0.1:45118 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1104155582) connection to jenkins-hbase4.apache.org/172.31.14.131:38315 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_583604367_17 at /127.0.0.1:47252 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/cluster_b4b9d27b-ece6-8fd0-070d-ff06f0633057/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/cluster_b4b9d27b-ece6-8fd0-070d-ff06f0633057/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x404319e1-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_583604367_17 at /127.0.0.1:45148 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/cluster_b4b9d27b-ece6-8fd0-070d-ff06f0633057/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x404319e1-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1313 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x404319e1-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_583604367_17 at /127.0.0.1:40046 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1104155582) connection to jenkins-hbase4.apache.org/172.31.14.131:38807 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1955405206_1 at /127.0.0.1:40028 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/cluster_b4b9d27b-ece6-8fd0-070d-ff06f0633057/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=921 (was 900) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=453 (was 369) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 175) - ProcessCount LEAK? -, AvailableMemoryMB=2794 (was 4606) 2023-07-16 09:11:07,864 WARN [Listener at jenkins-hbase4.apache.org/33381] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-16 09:11:07,883 INFO [Listener at jenkins-hbase4.apache.org/33381] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=751, OpenFileDescriptor=921, MaxFileDescriptor=60000, SystemLoadAverage=453, ProcessCount=181, AvailableMemoryMB=2793 2023-07-16 09:11:07,883 WARN [Listener at jenkins-hbase4.apache.org/33381] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-16 09:11:07,885 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-16 09:11:07,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-16 09:11:07,890 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 09:11:07,891 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-16 09:11:07,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-16 09:11:07,892 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 09:11:07,895 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemState/9047b3bc6c024e17f80e88fd11b7ad1c 2023-07-16 09:11:07,895 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemState/76aa85984d09550dc7c0506dc2a95805 2023-07-16 09:11:07,895 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemState/9047b3bc6c024e17f80e88fd11b7ad1c empty. 2023-07-16 09:11:07,895 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemState/76aa85984d09550dc7c0506dc2a95805 empty. 2023-07-16 09:11:07,896 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemState/76aa85984d09550dc7c0506dc2a95805 2023-07-16 09:11:07,896 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemState/9047b3bc6c024e17f80e88fd11b7ad1c 2023-07-16 09:11:07,896 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-16 09:11:07,915 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-16 09:11:07,917 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9047b3bc6c024e17f80e88fd11b7ad1c, NAME => 'testtb-testExportFileSystemState,,1689498667885.9047b3bc6c024e17f80e88fd11b7ad1c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp 2023-07-16 09:11:07,917 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 76aa85984d09550dc7c0506dc2a95805, NAME => 'testtb-testExportFileSystemState,1,1689498667885.76aa85984d09550dc7c0506dc2a95805.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp 2023-07-16 09:11:07,940 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689498667885.76aa85984d09550dc7c0506dc2a95805.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:11:07,940 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 76aa85984d09550dc7c0506dc2a95805, disabling compactions & flushes 2023-07-16 09:11:07,940 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689498667885.9047b3bc6c024e17f80e88fd11b7ad1c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:11:07,940 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689498667885.76aa85984d09550dc7c0506dc2a95805. 2023-07-16 09:11:07,941 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 9047b3bc6c024e17f80e88fd11b7ad1c, disabling compactions & flushes 2023-07-16 09:11:07,941 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689498667885.76aa85984d09550dc7c0506dc2a95805. 2023-07-16 09:11:07,941 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689498667885.9047b3bc6c024e17f80e88fd11b7ad1c. 2023-07-16 09:11:07,941 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689498667885.76aa85984d09550dc7c0506dc2a95805. after waiting 0 ms 2023-07-16 09:11:07,941 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689498667885.9047b3bc6c024e17f80e88fd11b7ad1c. 2023-07-16 09:11:07,941 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689498667885.76aa85984d09550dc7c0506dc2a95805. 2023-07-16 09:11:07,941 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689498667885.9047b3bc6c024e17f80e88fd11b7ad1c. after waiting 0 ms 2023-07-16 09:11:07,941 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689498667885.76aa85984d09550dc7c0506dc2a95805. 2023-07-16 09:11:07,941 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689498667885.9047b3bc6c024e17f80e88fd11b7ad1c. 2023-07-16 09:11:07,941 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 76aa85984d09550dc7c0506dc2a95805: 2023-07-16 09:11:07,941 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689498667885.9047b3bc6c024e17f80e88fd11b7ad1c. 2023-07-16 09:11:07,941 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 9047b3bc6c024e17f80e88fd11b7ad1c: 2023-07-16 09:11:07,944 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 09:11:07,945 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689498667885.76aa85984d09550dc7c0506dc2a95805.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689498667945"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498667945"}]},"ts":"1689498667945"} 2023-07-16 09:11:07,945 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689498667885.9047b3bc6c024e17f80e88fd11b7ad1c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689498667945"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498667945"}]},"ts":"1689498667945"} 2023-07-16 09:11:07,948 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 09:11:07,949 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 09:11:07,949 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498667949"}]},"ts":"1689498667949"} 2023-07-16 09:11:07,951 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-16 09:11:07,953 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 09:11:07,955 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 09:11:07,955 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 09:11:07,955 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 09:11:07,955 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 09:11:07,955 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9047b3bc6c024e17f80e88fd11b7ad1c, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=76aa85984d09550dc7c0506dc2a95805, ASSIGN}] 2023-07-16 09:11:07,957 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9047b3bc6c024e17f80e88fd11b7ad1c, ASSIGN 2023-07-16 09:11:07,957 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=76aa85984d09550dc7c0506dc2a95805, ASSIGN 2023-07-16 09:11:07,958 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9047b3bc6c024e17f80e88fd11b7ad1c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45805,1689498639118; forceNewPlan=false, retain=false 2023-07-16 09:11:07,958 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=76aa85984d09550dc7c0506dc2a95805, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45437,1689498639234; forceNewPlan=false, retain=false 2023-07-16 09:11:07,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-16 09:11:08,108 INFO [jenkins-hbase4:46005] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 09:11:08,111 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=9047b3bc6c024e17f80e88fd11b7ad1c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:08,111 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=76aa85984d09550dc7c0506dc2a95805, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:08,111 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689498667885.9047b3bc6c024e17f80e88fd11b7ad1c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689498668111"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498668111"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498668111"}]},"ts":"1689498668111"} 2023-07-16 09:11:08,111 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689498667885.76aa85984d09550dc7c0506dc2a95805.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689498668111"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498668111"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498668111"}]},"ts":"1689498668111"} 2023-07-16 09:11:08,113 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 9047b3bc6c024e17f80e88fd11b7ad1c, server=jenkins-hbase4.apache.org,45805,1689498639118}] 2023-07-16 09:11:08,115 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 76aa85984d09550dc7c0506dc2a95805, server=jenkins-hbase4.apache.org,45437,1689498639234}] 2023-07-16 09:11:08,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-16 09:11:08,275 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689498667885.9047b3bc6c024e17f80e88fd11b7ad1c. 2023-07-16 09:11:08,275 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689498667885.76aa85984d09550dc7c0506dc2a95805. 2023-07-16 09:11:08,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9047b3bc6c024e17f80e88fd11b7ad1c, NAME => 'testtb-testExportFileSystemState,,1689498667885.9047b3bc6c024e17f80e88fd11b7ad1c.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 09:11:08,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 76aa85984d09550dc7c0506dc2a95805, NAME => 'testtb-testExportFileSystemState,1,1689498667885.76aa85984d09550dc7c0506dc2a95805.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 09:11:08,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689498667885.9047b3bc6c024e17f80e88fd11b7ad1c. service=AccessControlService 2023-07-16 09:11:08,276 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:11:08,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689498667885.76aa85984d09550dc7c0506dc2a95805. service=AccessControlService 2023-07-16 09:11:08,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 9047b3bc6c024e17f80e88fd11b7ad1c 2023-07-16 09:11:08,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689498667885.9047b3bc6c024e17f80e88fd11b7ad1c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:11:08,276 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:11:08,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9047b3bc6c024e17f80e88fd11b7ad1c 2023-07-16 09:11:08,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9047b3bc6c024e17f80e88fd11b7ad1c 2023-07-16 09:11:08,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 76aa85984d09550dc7c0506dc2a95805 2023-07-16 09:11:08,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689498667885.76aa85984d09550dc7c0506dc2a95805.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:11:08,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 76aa85984d09550dc7c0506dc2a95805 2023-07-16 09:11:08,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 76aa85984d09550dc7c0506dc2a95805 2023-07-16 09:11:08,278 INFO [StoreOpener-9047b3bc6c024e17f80e88fd11b7ad1c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9047b3bc6c024e17f80e88fd11b7ad1c 2023-07-16 09:11:08,278 INFO [StoreOpener-76aa85984d09550dc7c0506dc2a95805-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 76aa85984d09550dc7c0506dc2a95805 2023-07-16 09:11:08,279 DEBUG [StoreOpener-9047b3bc6c024e17f80e88fd11b7ad1c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemState/9047b3bc6c024e17f80e88fd11b7ad1c/cf 2023-07-16 09:11:08,279 DEBUG [StoreOpener-76aa85984d09550dc7c0506dc2a95805-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemState/76aa85984d09550dc7c0506dc2a95805/cf 2023-07-16 09:11:08,279 DEBUG [StoreOpener-9047b3bc6c024e17f80e88fd11b7ad1c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemState/9047b3bc6c024e17f80e88fd11b7ad1c/cf 2023-07-16 09:11:08,279 DEBUG [StoreOpener-76aa85984d09550dc7c0506dc2a95805-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemState/76aa85984d09550dc7c0506dc2a95805/cf 2023-07-16 09:11:08,280 INFO [StoreOpener-76aa85984d09550dc7c0506dc2a95805-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 76aa85984d09550dc7c0506dc2a95805 columnFamilyName cf 2023-07-16 09:11:08,280 INFO [StoreOpener-9047b3bc6c024e17f80e88fd11b7ad1c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9047b3bc6c024e17f80e88fd11b7ad1c columnFamilyName cf 2023-07-16 09:11:08,282 INFO [StoreOpener-9047b3bc6c024e17f80e88fd11b7ad1c-1] regionserver.HStore(310): Store=9047b3bc6c024e17f80e88fd11b7ad1c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:11:08,282 INFO [StoreOpener-76aa85984d09550dc7c0506dc2a95805-1] regionserver.HStore(310): Store=76aa85984d09550dc7c0506dc2a95805/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:11:08,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemState/9047b3bc6c024e17f80e88fd11b7ad1c 2023-07-16 09:11:08,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemState/76aa85984d09550dc7c0506dc2a95805 2023-07-16 09:11:08,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemState/9047b3bc6c024e17f80e88fd11b7ad1c 2023-07-16 09:11:08,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemState/76aa85984d09550dc7c0506dc2a95805 2023-07-16 09:11:08,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9047b3bc6c024e17f80e88fd11b7ad1c 2023-07-16 09:11:08,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 76aa85984d09550dc7c0506dc2a95805 2023-07-16 09:11:08,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemState/76aa85984d09550dc7c0506dc2a95805/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 09:11:08,291 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 76aa85984d09550dc7c0506dc2a95805; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59698719, jitterRate=-0.11041976511478424}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 09:11:08,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemState/9047b3bc6c024e17f80e88fd11b7ad1c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 09:11:08,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 76aa85984d09550dc7c0506dc2a95805: 2023-07-16 09:11:08,292 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9047b3bc6c024e17f80e88fd11b7ad1c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62697309, jitterRate=-0.0657372921705246}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 09:11:08,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9047b3bc6c024e17f80e88fd11b7ad1c: 2023-07-16 09:11:08,292 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689498667885.76aa85984d09550dc7c0506dc2a95805., pid=31, masterSystemTime=1689498668271 2023-07-16 09:11:08,293 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689498667885.9047b3bc6c024e17f80e88fd11b7ad1c., pid=30, masterSystemTime=1689498668271 2023-07-16 09:11:08,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689498667885.76aa85984d09550dc7c0506dc2a95805. 2023-07-16 09:11:08,299 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689498667885.76aa85984d09550dc7c0506dc2a95805. 2023-07-16 09:11:08,303 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=76aa85984d09550dc7c0506dc2a95805, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:08,303 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689498667885.76aa85984d09550dc7c0506dc2a95805.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689498668303"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689498668303"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689498668303"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689498668303"}]},"ts":"1689498668303"} 2023-07-16 09:11:08,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689498667885.9047b3bc6c024e17f80e88fd11b7ad1c. 2023-07-16 09:11:08,305 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689498667885.9047b3bc6c024e17f80e88fd11b7ad1c. 2023-07-16 09:11:08,305 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=9047b3bc6c024e17f80e88fd11b7ad1c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:08,307 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689498667885.9047b3bc6c024e17f80e88fd11b7ad1c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689498668305"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689498668305"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689498668305"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689498668305"}]},"ts":"1689498668305"} 2023-07-16 09:11:08,311 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-16 09:11:08,311 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 76aa85984d09550dc7c0506dc2a95805, server=jenkins-hbase4.apache.org,45437,1689498639234 in 193 msec 2023-07-16 09:11:08,313 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-16 09:11:08,315 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 9047b3bc6c024e17f80e88fd11b7ad1c, server=jenkins-hbase4.apache.org,45805,1689498639118 in 197 msec 2023-07-16 09:11:08,316 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=76aa85984d09550dc7c0506dc2a95805, ASSIGN in 356 msec 2023-07-16 09:11:08,318 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-16 09:11:08,318 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9047b3bc6c024e17f80e88fd11b7ad1c, ASSIGN in 358 msec 2023-07-16 09:11:08,319 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 09:11:08,319 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498668319"}]},"ts":"1689498668319"} 2023-07-16 09:11:08,321 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-16 09:11:08,326 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 09:11:08,327 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-16 09:11:08,329 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37709] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 09:11:08,331 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:08,331 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:08,331 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:08,331 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:08,333 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 09:11:08,333 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 09:11:08,333 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 09:11:08,334 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 09:11:08,335 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 446 msec 2023-07-16 09:11:08,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-16 09:11:08,496 INFO [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-16 09:11:08,499 DEBUG [Listener at jenkins-hbase4.apache.org/33381] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-16 09:11:08,499 DEBUG [Listener at jenkins-hbase4.apache.org/33381] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689498667885.9047b3bc6c024e17f80e88fd11b7ad1c. 2023-07-16 09:11:08,502 INFO [Listener at jenkins-hbase4.apache.org/33381] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 09:11:08,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 09:11:08,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689498668523 (current time:1689498668523). 2023-07-16 09:11:08,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 09:11:08,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(139): Connect 0x06a24158 to 127.0.0.1:64380 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:11:08,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@184014a9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:11:08,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:11:08,533 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55560, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:11:08,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06a24158 to 127.0.0.1:64380 2023-07-16 09:11:08,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:11:08,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(139): Connect 0x0f477105 to 127.0.0.1:64380 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:11:08,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b7b4934, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:11:08,540 DEBUG [hconnection-0x386f3ae-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:11:08,542 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55562, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:11:08,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:11:08,548 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48984, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:11:08,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f477105 to 127.0.0.1:64380 2023-07-16 09:11:08,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:11:08,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 09:11:08,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 09:11:08,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 09:11:08,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 09:11:08,553 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 09:11:08,554 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689499268554 2023-07-16 09:11:08,554 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-16 09:11:08,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 09:11:08,556 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 09:11:08,556 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 09:11:08,557 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 09:11:08,557 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 09:11:08,560 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-16 09:11:08,561 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 09:11:08,563 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689499268562 2023-07-16 09:11:08,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:08,577 INFO [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-16 09:11:08,578 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:11:08,579 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-16 09:11:08,579 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-16 09:11:08,579 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:08,579 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:08,581 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:08,581 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:08,581 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:08,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:08,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:08,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:08,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:08,581 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:08,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:08,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:08,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:08,582 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:08,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:08,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:08,582 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:08,582 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:08,582 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:08,582 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:08,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-16 09:11:08,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:08,583 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:08,583 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 09:11:08,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-16 09:11:08,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:08,583 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 09:11:08,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-16 09:11:08,583 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 09:11:08,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:08,583 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 09:11:08,583 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:08,584 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 09:11:08,584 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:08,584 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:08,584 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:11:08,584 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 09:11:08,585 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 09:11:08,585 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-16 09:11:08,584 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 09:11:08,585 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45805,1689498639118' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-16 09:11:08,585 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:11:08,585 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:11:08,586 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 09:11:08,587 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-16 09:11:08,587 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 09:11:08,587 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-16 09:11:08,587 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45437,1689498639234' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-16 09:11:08,587 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37709,1689498639179' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-16 09:11:08,588 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:08,588 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:08,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:08,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:08,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:08,594 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:08,594 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:08,595 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:08,595 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:08,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:08,595 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:11:08,595 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:11:08,595 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:08,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:08,596 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:08,596 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:11:08,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:08,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:08,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:08,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:08,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:08,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45805,1689498639118' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-16 09:11:08,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d25db8e[Count = 1] remaining members to acquire global barrier 2023-07-16 09:11:08,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:08,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:08,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:08,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:08,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:08,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:08,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:08,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:08,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:08,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:08,600 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45437,1689498639234' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-16 09:11:08,600 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d25db8e[Count = 0] remaining members to acquire global barrier 2023-07-16 09:11:08,600 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-16 09:11:08,600 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:08,601 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:08,601 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:08,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:08,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:08,601 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:08,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:08,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:08,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:08,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:08,601 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 09:11:08,601 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 09:11:08,601 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:08,601 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 09:11:08,601 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-16 09:11:08,601 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:11:08,602 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:11:08,602 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689498667885.9047b3bc6c024e17f80e88fd11b7ad1c. 2023-07-16 09:11:08,601 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37709,1689498639179' in zk 2023-07-16 09:11:08,602 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689498667885.76aa85984d09550dc7c0506dc2a95805. 2023-07-16 09:11:08,602 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689498667885.9047b3bc6c024e17f80e88fd11b7ad1c. started... 2023-07-16 09:11:08,602 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:08,602 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 09:11:08,602 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:11:08,602 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:11:08,602 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689498667885.76aa85984d09550dc7c0506dc2a95805. started... 2023-07-16 09:11:08,602 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9047b3bc6c024e17f80e88fd11b7ad1c: 2023-07-16 09:11:08,603 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 76aa85984d09550dc7c0506dc2a95805: 2023-07-16 09:11:08,603 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689498667885.9047b3bc6c024e17f80e88fd11b7ad1c.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:08,603 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:11:08,603 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689498667885.76aa85984d09550dc7c0506dc2a95805.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:08,603 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 09:11:08,603 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:11:08,604 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 09:11:08,606 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 09:11:08,606 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:11:08,606 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-16 09:11:08,625 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689498667885.9047b3bc6c024e17f80e88fd11b7ad1c. completed. 2023-07-16 09:11:08,625 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689498667885.9047b3bc6c024e17f80e88fd11b7ad1c. 2023-07-16 09:11:08,626 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:11:08,626 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:11:08,626 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:08,626 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-16 09:11:08,626 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45805,1689498639118' in zk 2023-07-16 09:11:08,627 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 09:11:08,627 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:11:08,627 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:08,627 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-16 09:11:08,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:08,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:08,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:08,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:08,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:08,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:08,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:08,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:08,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:08,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:08,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:08,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:08,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:08,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45805,1689498639118': 2023-07-16 09:11:08,633 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45805,1689498639118' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-16 09:11:08,656 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:11:08,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 09:11:08,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:11:08,657 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 09:11:08,858 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:11:08,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 09:11:08,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:11:08,859 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 09:11:09,026 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689498667885.76aa85984d09550dc7c0506dc2a95805. completed. 2023-07-16 09:11:09,026 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689498667885.76aa85984d09550dc7c0506dc2a95805. 2023-07-16 09:11:09,026 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:11:09,026 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:11:09,026 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:09,026 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-16 09:11:09,026 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45437,1689498639234' in zk 2023-07-16 09:11:09,029 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:09,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:09,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:09,030 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 09:11:09,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:09,030 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:11:09,030 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-16 09:11:09,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:09,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:09,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:09,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:09,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:09,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:09,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:09,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:09,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:09,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45437,1689498639234': 2023-07-16 09:11:09,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45437,1689498639234' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-16 09:11:09,036 INFO [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-16 09:11:09,036 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 09:11:09,036 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 09:11:09,036 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,036 INFO [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 09:11:09,038 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,038 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,038 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,038 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:09,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:09,038 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:09,038 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,039 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:09,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:09,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:09,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:09,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:09,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:09,040 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:09,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:09,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:09,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:09,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,040 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:09,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,041 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:09,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:09,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:09,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:09,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:09,043 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:09,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:09,043 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:09,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,044 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:09,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:09,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:09,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:09,048 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:09,048 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:09,048 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,048 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:09,048 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:09,048 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:09,048 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:09,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:09,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:09,048 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:09,048 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:09,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:09,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:09,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:09,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:09,048 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:09,049 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:11:09,049 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,049 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,049 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-16 09:11:09,050 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:09,051 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,051 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:09,051 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:09,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:09,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:09,051 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:09,051 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:09,051 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 09:11:09,051 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,052 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-16 09:11:09,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:09,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:09,063 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,064 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,093 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,130 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-16 09:11:09,130 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,131 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:09,131 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689498668555Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689498669063 (+508 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689498669063Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689498669064 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689498669071 (+7 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689498669085 (+14 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689498669130 (+45 ms) 2023-07-16 09:11:09,134 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 09:11:09,137 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 579 msec 2023-07-16 09:11:09,159 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:11:09,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 09:11:09,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 09:11:09,169 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45437] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689498667885.76aa85984d09550dc7c0506dc2a95805. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 09:11:09,172 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45805] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689498667885.9047b3bc6c024e17f80e88fd11b7ad1c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 09:11:09,175 DEBUG [Listener at jenkins-hbase4.apache.org/33381] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-16 09:11:09,176 DEBUG [Listener at jenkins-hbase4.apache.org/33381] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689498667885.9047b3bc6c024e17f80e88fd11b7ad1c. 2023-07-16 09:11:09,176 INFO [Listener at jenkins-hbase4.apache.org/33381] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 09:11:09,190 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 09:11:09,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689498669190 (current time:1689498669190). 2023-07-16 09:11:09,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 09:11:09,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(139): Connect 0x656b7a34 to 127.0.0.1:64380 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:11:09,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@247f68ed, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:11:09,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:11:09,213 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55574, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:11:09,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x656b7a34 to 127.0.0.1:64380 2023-07-16 09:11:09,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:11:09,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(139): Connect 0x7b9d4185 to 127.0.0.1:64380 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:11:09,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1afe1e56, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:11:09,226 DEBUG [hconnection-0x6647a50d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:11:09,227 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55590, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:11:09,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:11:09,235 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49000, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:11:09,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b9d4185 to 127.0.0.1:64380 2023-07-16 09:11:09,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:11:09,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 09:11:09,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 09:11:09,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 09:11:09,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 09:11:09,241 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 09:11:09,242 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689499269242 2023-07-16 09:11:09,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 09:11:09,243 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-16 09:11:09,244 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 09:11:09,244 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 09:11:09,246 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-16 09:11:09,246 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 09:11:09,248 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-16 09:11:09,249 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 09:11:09,250 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689499269250 2023-07-16 09:11:09,276 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-16 09:11:09,276 INFO [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-16 09:11:09,276 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:11:09,278 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-16 09:11:09,278 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-16 09:11:09,278 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,278 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,279 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:09,280 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:09,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:09,280 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:09,280 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:09,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:09,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:09,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:09,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:09,280 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:09,280 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:09,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:09,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,281 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:09,281 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 09:11:09,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,281 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,281 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-16 09:11:09,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-16 09:11:09,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,281 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 09:11:09,281 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,281 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 09:11:09,282 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-16 09:11:09,282 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 09:11:09,282 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-16 09:11:09,282 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:11:09,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-16 09:11:09,283 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 09:11:09,283 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-16 09:11:09,282 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 09:11:09,283 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37709,1689498639179' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-16 09:11:09,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,283 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:11:09,285 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 09:11:09,285 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-16 09:11:09,285 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-16 09:11:09,285 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45805,1689498639118' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-16 09:11:09,285 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-16 09:11:09,285 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-16 09:11:09,285 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:11:09,286 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-16 09:11:09,286 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-16 09:11:09,286 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45437,1689498639234' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-16 09:11:09,287 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,287 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,287 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:09,287 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:09,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:09,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:09,288 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:11:09,288 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,288 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:11:09,290 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:09,290 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:09,291 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:09,291 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:11:09,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 09:11:09,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:09,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:09,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:09,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:09,292 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45805,1689498639118' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-16 09:11:09,292 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64e898e4[Count = 1] remaining members to acquire global barrier 2023-07-16 09:11:09,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:09,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:09,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:09,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:09,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:09,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 09:11:09,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:09,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:09,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:09,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:09,295 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45437,1689498639234' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-16 09:11:09,295 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64e898e4[Count = 0] remaining members to acquire global barrier 2023-07-16 09:11:09,295 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-16 09:11:09,295 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,296 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,296 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,296 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,297 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:09,297 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 09:11:09,297 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 09:11:09,297 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-16 09:11:09,297 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-16 09:11:09,297 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:11:09,297 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:11:09,297 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37709,1689498639179' in zk 2023-07-16 09:11:09,297 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689498667885.76aa85984d09550dc7c0506dc2a95805. 2023-07-16 09:11:09,298 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:09,298 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 09:11:09,297 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:11:09,298 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:11:09,297 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689498667885.9047b3bc6c024e17f80e88fd11b7ad1c. 2023-07-16 09:11:09,298 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689498667885.76aa85984d09550dc7c0506dc2a95805. started... 2023-07-16 09:11:09,298 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689498667885.9047b3bc6c024e17f80e88fd11b7ad1c. started... 2023-07-16 09:11:09,298 INFO [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9047b3bc6c024e17f80e88fd11b7ad1c 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-16 09:11:09,298 INFO [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 76aa85984d09550dc7c0506dc2a95805 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-16 09:11:09,299 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 09:11:09,299 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:11:09,299 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-16 09:11:09,344 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:11:09,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 09:11:09,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:11:09,346 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 09:11:09,357 INFO [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230716ada92c3d7e47495db3085ff631f4f2e6 to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230716ada92c3d7e47495db3085ff631f4f2e6 2023-07-16 09:11:09,357 INFO [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307161bbbcba60174424eb69c92fbb4fafa60 to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307161bbbcba60174424eb69c92fbb4fafa60 2023-07-16 09:11:09,379 INFO [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemState/76aa85984d09550dc7c0506dc2a95805/.tmp/cf/cf372114d7ab445d86399a4318fb7622 2023-07-16 09:11:09,389 INFO [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemState/9047b3bc6c024e17f80e88fd11b7ad1c/.tmp/cf/705964d6d5ac46e9a9531dbc8e4b7476 2023-07-16 09:11:09,393 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemState/76aa85984d09550dc7c0506dc2a95805/.tmp/cf/cf372114d7ab445d86399a4318fb7622 as hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemState/76aa85984d09550dc7c0506dc2a95805/cf/cf372114d7ab445d86399a4318fb7622 2023-07-16 09:11:09,398 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemState/9047b3bc6c024e17f80e88fd11b7ad1c/.tmp/cf/705964d6d5ac46e9a9531dbc8e4b7476 as hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemState/9047b3bc6c024e17f80e88fd11b7ad1c/cf/705964d6d5ac46e9a9531dbc8e4b7476 2023-07-16 09:11:09,404 INFO [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemState/76aa85984d09550dc7c0506dc2a95805/cf/cf372114d7ab445d86399a4318fb7622, entries=48, sequenceid=6, filesize=13.0 K 2023-07-16 09:11:09,405 INFO [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemState/9047b3bc6c024e17f80e88fd11b7ad1c/cf/705964d6d5ac46e9a9531dbc8e4b7476, entries=2, sequenceid=6, filesize=5.2 K 2023-07-16 09:11:09,407 INFO [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 9047b3bc6c024e17f80e88fd11b7ad1c in 109ms, sequenceid=6, compaction requested=false 2023-07-16 09:11:09,407 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-16 09:11:09,407 INFO [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 76aa85984d09550dc7c0506dc2a95805 in 109ms, sequenceid=6, compaction requested=false 2023-07-16 09:11:09,408 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9047b3bc6c024e17f80e88fd11b7ad1c: 2023-07-16 09:11:09,409 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 76aa85984d09550dc7c0506dc2a95805: 2023-07-16 09:11:09,409 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689498667885.9047b3bc6c024e17f80e88fd11b7ad1c.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-16 09:11:09,409 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689498667885.76aa85984d09550dc7c0506dc2a95805.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-16 09:11:09,409 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:11:09,409 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:11:09,410 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemState/9047b3bc6c024e17f80e88fd11b7ad1c/cf/705964d6d5ac46e9a9531dbc8e4b7476] hfiles 2023-07-16 09:11:09,410 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemState/76aa85984d09550dc7c0506dc2a95805/cf/cf372114d7ab445d86399a4318fb7622] hfiles 2023-07-16 09:11:09,410 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemState/9047b3bc6c024e17f80e88fd11b7ad1c/cf/705964d6d5ac46e9a9531dbc8e4b7476 for snapshot=snaptb0-testExportFileSystemState 2023-07-16 09:11:09,410 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemState/76aa85984d09550dc7c0506dc2a95805/cf/cf372114d7ab445d86399a4318fb7622 for snapshot=snaptb0-testExportFileSystemState 2023-07-16 09:11:09,439 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689498667885.9047b3bc6c024e17f80e88fd11b7ad1c. completed. 2023-07-16 09:11:09,439 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689498667885.9047b3bc6c024e17f80e88fd11b7ad1c. 2023-07-16 09:11:09,439 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:11:09,439 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:11:09,439 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:09,439 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-16 09:11:09,439 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45805,1689498639118' in zk 2023-07-16 09:11:09,439 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689498667885.76aa85984d09550dc7c0506dc2a95805. completed. 2023-07-16 09:11:09,439 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689498667885.76aa85984d09550dc7c0506dc2a95805. 2023-07-16 09:11:09,439 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:11:09,440 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:11:09,440 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:09,440 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-16 09:11:09,440 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45437,1689498639234' in zk 2023-07-16 09:11:09,445 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 09:11:09,445 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:09,445 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:11:09,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:09,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:09,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:09,447 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:09,445 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-16 09:11:09,447 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-16 09:11:09,448 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:11:09,448 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-16 09:11:09,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:09,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:09,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 09:11:09,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:09,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:09,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:09,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:09,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 09:11:09,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:09,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:09,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:09,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45805,1689498639118': 2023-07-16 09:11:09,452 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45805,1689498639118' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-16 09:11:09,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:09,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:09,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:09,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:09,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:09,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 09:11:09,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:09,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:09,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:09,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:09,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 09:11:09,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:09,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:09,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:09,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45437,1689498639234': 2023-07-16 09:11:09,457 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45437,1689498639234' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-16 09:11:09,457 INFO [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-16 09:11:09,457 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 09:11:09,457 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 09:11:09,457 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-16 09:11:09,457 INFO [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 09:11:09,459 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,460 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:09,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,460 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,460 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:09,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,461 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,461 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,461 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:09,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:09,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:09,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:09,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:09,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:09,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:09,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:09,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:09,463 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:09,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:09,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,465 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:09,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 09:11:09,466 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:09,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:09,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 09:11:09,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:09,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:09,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:09,470 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:09,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:09,470 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:09,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-16 09:11:09,470 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:09,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:09,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:09,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:09,476 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:09,476 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,476 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:09,476 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:09,476 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:09,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:09,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:09,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:09,476 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:09,476 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:09,476 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:11:09,476 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-16 09:11:09,476 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:09,476 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:09,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:09,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:09,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:09,479 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:09,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:09,479 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:09,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:09,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:09,479 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-16 09:11:09,480 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-16 09:11:09,480 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 09:11:09,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:09,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:09,480 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:09,481 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,481 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:09,481 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:09,481 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,481 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,481 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230716ada92c3d7e47495db3085ff631f4f2e6, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307161bbbcba60174424eb69c92fbb4fafa60] mob files 2023-07-16 09:11:09,481 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230716ada92c3d7e47495db3085ff631f4f2e6 2023-07-16 09:11:09,481 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307161bbbcba60174424eb69c92fbb4fafa60 2023-07-16 09:11:09,495 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-16 09:11:09,496 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,525 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,547 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:11:09,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 09:11:09,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:11:09,548 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 09:11:09,576 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-16 09:11:09,576 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,577 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689498669243Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689498669495 (+252 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689498669495Loading Region manifests for snaptb0-testExportFileSystemState at 1689498669495Writing data manifest for snaptb0-testExportFileSystemState at 1689498669499 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689498669510 (+11 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689498669576 (+66 ms) 2023-07-16 09:11:09,580 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-16 09:11:09,582 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 336 msec 2023-07-16 09:11:09,848 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:11:09,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 09:11:09,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 09:11:09,850 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498669850 2023-07-16 09:11:09,850 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43477, tgtDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498669850, rawTgtDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498669850, srcFsUri=hdfs://localhost:43477, srcDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae 2023-07-16 09:11:09,876 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43477, inputRoot=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae 2023-07-16 09:11:09,876 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-319321889_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498669850, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498669850/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,876 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43477, inputRoot=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae, snapshotDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-16 09:11:09,887 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498669850/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-16 09:11:09,950 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:09,951 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:09,951 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:09,952 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:09,952 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:09,953 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:09,953 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:10,045 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/hadoop-5978981592670981517.jar 2023-07-16 09:11:10,046 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:10,046 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:10,047 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:10,047 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:10,048 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:10,048 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:10,049 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 09:11:10,049 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 09:11:10,050 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 09:11:10,051 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 09:11:10,051 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 09:11:10,052 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 09:11:10,052 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 09:11:10,052 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 09:11:10,053 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 09:11:10,053 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 09:11:10,054 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:11:10,054 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:11:10,055 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 09:11:10,055 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:11:10,055 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:11:10,056 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 09:11:10,056 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 09:11:11,076 WARN [Listener at jenkins-hbase4.apache.org/33381] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 09:11:11,079 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-16 09:11:11,081 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-16 09:11:11,737 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 09:11:11,737 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 09:11:11,744 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647086_0001_000001 (auth:SIMPLE) 2023-07-16 09:11:12,497 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647086_0002_000001 (auth:SIMPLE) 2023-07-16 09:11:13,150 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 09:11:17,239 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647086_0002_000001 (auth:SIMPLE) 2023-07-16 09:11:19,473 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647086_0002_000001 (auth:SIMPLE) 2023-07-16 09:11:22,978 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647086_0002_000001 (auth:SIMPLE) 2023-07-16 09:11:24,288 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 09:11:24,290 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 09:11:24,310 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-16 09:11:24,310 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 09:11:24,311 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 09:11:24,311 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_583604367_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-16 09:11:24,312 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(367): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-16 09:11:24,312 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(367): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-16 09:11:24,312 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_583604367_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498669850/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498669850/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-16 09:11:24,312 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(367): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498669850/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-16 09:11:24,312 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(367): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498669850/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-16 09:11:24,320 INFO [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-16 09:11:24,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-16 09:11:24,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-16 09:11:24,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-16 09:11:24,327 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498684327"}]},"ts":"1689498684327"} 2023-07-16 09:11:24,328 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-16 09:11:24,330 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-16 09:11:24,331 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9047b3bc6c024e17f80e88fd11b7ad1c, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=76aa85984d09550dc7c0506dc2a95805, UNASSIGN}] 2023-07-16 09:11:24,333 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9047b3bc6c024e17f80e88fd11b7ad1c, UNASSIGN 2023-07-16 09:11:24,334 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=76aa85984d09550dc7c0506dc2a95805, UNASSIGN 2023-07-16 09:11:24,338 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=9047b3bc6c024e17f80e88fd11b7ad1c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:24,339 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=76aa85984d09550dc7c0506dc2a95805, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:24,339 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689498667885.9047b3bc6c024e17f80e88fd11b7ad1c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689498684338"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498684338"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498684338"}]},"ts":"1689498684338"} 2023-07-16 09:11:24,339 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689498667885.76aa85984d09550dc7c0506dc2a95805.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689498684338"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498684338"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498684338"}]},"ts":"1689498684338"} 2023-07-16 09:11:24,340 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 9047b3bc6c024e17f80e88fd11b7ad1c, server=jenkins-hbase4.apache.org,45805,1689498639118}] 2023-07-16 09:11:24,341 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 76aa85984d09550dc7c0506dc2a95805, server=jenkins-hbase4.apache.org,45437,1689498639234}] 2023-07-16 09:11:24,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-16 09:11:24,493 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9047b3bc6c024e17f80e88fd11b7ad1c 2023-07-16 09:11:24,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9047b3bc6c024e17f80e88fd11b7ad1c, disabling compactions & flushes 2023-07-16 09:11:24,493 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689498667885.9047b3bc6c024e17f80e88fd11b7ad1c. 2023-07-16 09:11:24,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689498667885.9047b3bc6c024e17f80e88fd11b7ad1c. 2023-07-16 09:11:24,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689498667885.9047b3bc6c024e17f80e88fd11b7ad1c. after waiting 0 ms 2023-07-16 09:11:24,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689498667885.9047b3bc6c024e17f80e88fd11b7ad1c. 2023-07-16 09:11:24,495 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 76aa85984d09550dc7c0506dc2a95805 2023-07-16 09:11:24,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 76aa85984d09550dc7c0506dc2a95805, disabling compactions & flushes 2023-07-16 09:11:24,497 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689498667885.76aa85984d09550dc7c0506dc2a95805. 2023-07-16 09:11:24,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689498667885.76aa85984d09550dc7c0506dc2a95805. 2023-07-16 09:11:24,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689498667885.76aa85984d09550dc7c0506dc2a95805. after waiting 0 ms 2023-07-16 09:11:24,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689498667885.76aa85984d09550dc7c0506dc2a95805. 2023-07-16 09:11:24,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemState/9047b3bc6c024e17f80e88fd11b7ad1c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 09:11:24,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemState/76aa85984d09550dc7c0506dc2a95805/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 09:11:24,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:11:24,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:11:24,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689498667885.9047b3bc6c024e17f80e88fd11b7ad1c. 2023-07-16 09:11:24,511 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689498667885.76aa85984d09550dc7c0506dc2a95805. 2023-07-16 09:11:24,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9047b3bc6c024e17f80e88fd11b7ad1c: 2023-07-16 09:11:24,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 76aa85984d09550dc7c0506dc2a95805: 2023-07-16 09:11:24,513 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 76aa85984d09550dc7c0506dc2a95805 2023-07-16 09:11:24,514 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=76aa85984d09550dc7c0506dc2a95805, regionState=CLOSED 2023-07-16 09:11:24,514 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9047b3bc6c024e17f80e88fd11b7ad1c 2023-07-16 09:11:24,514 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689498667885.76aa85984d09550dc7c0506dc2a95805.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689498684514"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498684514"}]},"ts":"1689498684514"} 2023-07-16 09:11:24,515 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=9047b3bc6c024e17f80e88fd11b7ad1c, regionState=CLOSED 2023-07-16 09:11:24,515 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689498667885.9047b3bc6c024e17f80e88fd11b7ad1c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689498684515"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498684515"}]},"ts":"1689498684515"} 2023-07-16 09:11:24,518 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-16 09:11:24,519 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 76aa85984d09550dc7c0506dc2a95805, server=jenkins-hbase4.apache.org,45437,1689498639234 in 175 msec 2023-07-16 09:11:24,520 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-16 09:11:24,520 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 9047b3bc6c024e17f80e88fd11b7ad1c, server=jenkins-hbase4.apache.org,45805,1689498639118 in 177 msec 2023-07-16 09:11:24,521 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=76aa85984d09550dc7c0506dc2a95805, UNASSIGN in 188 msec 2023-07-16 09:11:24,522 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-16 09:11:24,522 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9047b3bc6c024e17f80e88fd11b7ad1c, UNASSIGN in 189 msec 2023-07-16 09:11:24,523 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498684523"}]},"ts":"1689498684523"} 2023-07-16 09:11:24,527 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-16 09:11:24,530 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-16 09:11:24,534 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 210 msec 2023-07-16 09:11:24,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-16 09:11:24,630 INFO [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-16 09:11:24,630 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-16 09:11:24,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 09:11:24,635 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 09:11:24,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-16 09:11:24,636 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 09:11:24,637 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37709] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-16 09:11:24,642 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 09:11:24,642 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 09:11:24,642 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 09:11:24,642 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 09:11:24,642 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-16 09:11:24,642 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemState/9047b3bc6c024e17f80e88fd11b7ad1c 2023-07-16 09:11:24,643 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemState/76aa85984d09550dc7c0506dc2a95805 2023-07-16 09:11:24,643 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-16 09:11:24,643 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-16 09:11:24,643 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-16 09:11:24,644 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 09:11:24,644 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:24,645 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 09:11:24,645 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:24,645 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 09:11:24,645 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:24,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-16 09:11:24,645 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemState/9047b3bc6c024e17f80e88fd11b7ad1c/cf, FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemState/9047b3bc6c024e17f80e88fd11b7ad1c/recovered.edits] 2023-07-16 09:11:24,646 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-16 09:11:24,646 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:24,649 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemState/76aa85984d09550dc7c0506dc2a95805/cf, FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemState/76aa85984d09550dc7c0506dc2a95805/recovered.edits] 2023-07-16 09:11:24,654 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemState/9047b3bc6c024e17f80e88fd11b7ad1c/cf/705964d6d5ac46e9a9531dbc8e4b7476 to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testExportFileSystemState/9047b3bc6c024e17f80e88fd11b7ad1c/cf/705964d6d5ac46e9a9531dbc8e4b7476 2023-07-16 09:11:24,656 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemState/76aa85984d09550dc7c0506dc2a95805/cf/cf372114d7ab445d86399a4318fb7622 to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testExportFileSystemState/76aa85984d09550dc7c0506dc2a95805/cf/cf372114d7ab445d86399a4318fb7622 2023-07-16 09:11:24,659 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemState/9047b3bc6c024e17f80e88fd11b7ad1c/recovered.edits/9.seqid to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testExportFileSystemState/9047b3bc6c024e17f80e88fd11b7ad1c/recovered.edits/9.seqid 2023-07-16 09:11:24,660 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemState/9047b3bc6c024e17f80e88fd11b7ad1c 2023-07-16 09:11:24,661 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemState/76aa85984d09550dc7c0506dc2a95805/recovered.edits/9.seqid to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testExportFileSystemState/76aa85984d09550dc7c0506dc2a95805/recovered.edits/9.seqid 2023-07-16 09:11:24,662 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemState/76aa85984d09550dc7c0506dc2a95805 2023-07-16 09:11:24,662 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-16 09:11:24,663 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-16 09:11:24,664 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-16 09:11:24,669 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230716ada92c3d7e47495db3085ff631f4f2e6 to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230716ada92c3d7e47495db3085ff631f4f2e6 2023-07-16 09:11:24,671 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307161bbbcba60174424eb69c92fbb4fafa60 to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307161bbbcba60174424eb69c92fbb4fafa60 2023-07-16 09:11:24,672 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-16 09:11:24,679 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 09:11:24,683 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-16 09:11:24,691 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-16 09:11:24,693 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 09:11:24,693 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-16 09:11:24,693 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689498667885.9047b3bc6c024e17f80e88fd11b7ad1c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689498684693"}]},"ts":"9223372036854775807"} 2023-07-16 09:11:24,694 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689498667885.76aa85984d09550dc7c0506dc2a95805.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689498684693"}]},"ts":"9223372036854775807"} 2023-07-16 09:11:24,712 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 09:11:24,712 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9047b3bc6c024e17f80e88fd11b7ad1c, NAME => 'testtb-testExportFileSystemState,,1689498667885.9047b3bc6c024e17f80e88fd11b7ad1c.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 76aa85984d09550dc7c0506dc2a95805, NAME => 'testtb-testExportFileSystemState,1,1689498667885.76aa85984d09550dc7c0506dc2a95805.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 09:11:24,712 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-16 09:11:24,713 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689498684712"}]},"ts":"9223372036854775807"} 2023-07-16 09:11:24,715 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-16 09:11:24,718 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-16 09:11:24,720 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 87 msec 2023-07-16 09:11:24,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-16 09:11:24,748 INFO [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-16 09:11:24,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-16 09:11:24,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-16 09:11:24,763 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-16 09:11:24,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-16 09:11:24,797 INFO [Listener at jenkins-hbase4.apache.org/33381] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=761 (was 751) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_583604367_17 at /127.0.0.1:38958 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1670260800_1 at /127.0.0.1:38936 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1104155582) connection to jenkins-hbase4.apache.org/172.31.14.131:40755 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1670260800_1 at /127.0.0.1:35548 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x404319e1-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x404319e1-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x404319e1-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_583604367_17 at /127.0.0.1:35576 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_583604367_17 at /127.0.0.1:53446 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x404319e1-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2025 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) - Thread LEAK? -, OpenFileDescriptor=921 (was 921), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=501 (was 453) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 181), AvailableMemoryMB=2741 (was 2793) 2023-07-16 09:11:24,797 WARN [Listener at jenkins-hbase4.apache.org/33381] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-16 09:11:24,817 INFO [Listener at jenkins-hbase4.apache.org/33381] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=761, OpenFileDescriptor=921, MaxFileDescriptor=60000, SystemLoadAverage=501, ProcessCount=181, AvailableMemoryMB=2740 2023-07-16 09:11:24,817 WARN [Listener at jenkins-hbase4.apache.org/33381] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-16 09:11:24,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-16 09:11:24,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-16 09:11:24,823 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 09:11:24,823 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-16 09:11:24,824 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 09:11:24,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-16 09:11:24,826 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testConsecutiveExports/b47328aa8958f2d7a7fe515d41d5513c 2023-07-16 09:11:24,826 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testConsecutiveExports/3cbe889c36af7edac098104493fc0bf0 2023-07-16 09:11:24,827 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testConsecutiveExports/b47328aa8958f2d7a7fe515d41d5513c empty. 2023-07-16 09:11:24,827 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testConsecutiveExports/3cbe889c36af7edac098104493fc0bf0 empty. 2023-07-16 09:11:24,827 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testConsecutiveExports/b47328aa8958f2d7a7fe515d41d5513c 2023-07-16 09:11:24,827 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testConsecutiveExports/3cbe889c36af7edac098104493fc0bf0 2023-07-16 09:11:24,828 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-16 09:11:24,847 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-16 09:11:24,848 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => b47328aa8958f2d7a7fe515d41d5513c, NAME => 'testtb-testConsecutiveExports,,1689498684819.b47328aa8958f2d7a7fe515d41d5513c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp 2023-07-16 09:11:24,848 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 3cbe889c36af7edac098104493fc0bf0, NAME => 'testtb-testConsecutiveExports,1,1689498684819.3cbe889c36af7edac098104493fc0bf0.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp 2023-07-16 09:11:24,867 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689498684819.3cbe889c36af7edac098104493fc0bf0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:11:24,867 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 3cbe889c36af7edac098104493fc0bf0, disabling compactions & flushes 2023-07-16 09:11:24,867 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689498684819.3cbe889c36af7edac098104493fc0bf0. 2023-07-16 09:11:24,867 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689498684819.3cbe889c36af7edac098104493fc0bf0. 2023-07-16 09:11:24,867 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689498684819.3cbe889c36af7edac098104493fc0bf0. after waiting 0 ms 2023-07-16 09:11:24,867 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689498684819.b47328aa8958f2d7a7fe515d41d5513c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:11:24,867 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689498684819.3cbe889c36af7edac098104493fc0bf0. 2023-07-16 09:11:24,867 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing b47328aa8958f2d7a7fe515d41d5513c, disabling compactions & flushes 2023-07-16 09:11:24,867 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689498684819.3cbe889c36af7edac098104493fc0bf0. 2023-07-16 09:11:24,867 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689498684819.b47328aa8958f2d7a7fe515d41d5513c. 2023-07-16 09:11:24,867 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 3cbe889c36af7edac098104493fc0bf0: 2023-07-16 09:11:24,867 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689498684819.b47328aa8958f2d7a7fe515d41d5513c. 2023-07-16 09:11:24,867 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689498684819.b47328aa8958f2d7a7fe515d41d5513c. after waiting 0 ms 2023-07-16 09:11:24,867 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689498684819.b47328aa8958f2d7a7fe515d41d5513c. 2023-07-16 09:11:24,867 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689498684819.b47328aa8958f2d7a7fe515d41d5513c. 2023-07-16 09:11:24,867 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for b47328aa8958f2d7a7fe515d41d5513c: 2023-07-16 09:11:24,870 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 09:11:24,871 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689498684819.3cbe889c36af7edac098104493fc0bf0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689498684871"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498684871"}]},"ts":"1689498684871"} 2023-07-16 09:11:24,871 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689498684819.b47328aa8958f2d7a7fe515d41d5513c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689498684871"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498684871"}]},"ts":"1689498684871"} 2023-07-16 09:11:24,874 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 09:11:24,875 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 09:11:24,875 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498684875"}]},"ts":"1689498684875"} 2023-07-16 09:11:24,877 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-16 09:11:24,881 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 09:11:24,882 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 09:11:24,882 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 09:11:24,882 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 09:11:24,882 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 09:11:24,883 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b47328aa8958f2d7a7fe515d41d5513c, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3cbe889c36af7edac098104493fc0bf0, ASSIGN}] 2023-07-16 09:11:24,885 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3cbe889c36af7edac098104493fc0bf0, ASSIGN 2023-07-16 09:11:24,885 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b47328aa8958f2d7a7fe515d41d5513c, ASSIGN 2023-07-16 09:11:24,886 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3cbe889c36af7edac098104493fc0bf0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37709,1689498639179; forceNewPlan=false, retain=false 2023-07-16 09:11:24,886 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b47328aa8958f2d7a7fe515d41d5513c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45437,1689498639234; forceNewPlan=false, retain=false 2023-07-16 09:11:24,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-16 09:11:25,036 INFO [jenkins-hbase4:46005] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 09:11:25,039 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=b47328aa8958f2d7a7fe515d41d5513c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:25,039 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=3cbe889c36af7edac098104493fc0bf0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:25,039 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689498684819.b47328aa8958f2d7a7fe515d41d5513c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689498685039"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498685039"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498685039"}]},"ts":"1689498685039"} 2023-07-16 09:11:25,039 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689498684819.3cbe889c36af7edac098104493fc0bf0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689498685039"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498685039"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498685039"}]},"ts":"1689498685039"} 2023-07-16 09:11:25,041 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure b47328aa8958f2d7a7fe515d41d5513c, server=jenkins-hbase4.apache.org,45437,1689498639234}] 2023-07-16 09:11:25,042 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 3cbe889c36af7edac098104493fc0bf0, server=jenkins-hbase4.apache.org,37709,1689498639179}] 2023-07-16 09:11:25,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-16 09:11:25,200 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689498684819.b47328aa8958f2d7a7fe515d41d5513c. 2023-07-16 09:11:25,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b47328aa8958f2d7a7fe515d41d5513c, NAME => 'testtb-testConsecutiveExports,,1689498684819.b47328aa8958f2d7a7fe515d41d5513c.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 09:11:25,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689498684819.b47328aa8958f2d7a7fe515d41d5513c. service=AccessControlService 2023-07-16 09:11:25,200 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:11:25,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports b47328aa8958f2d7a7fe515d41d5513c 2023-07-16 09:11:25,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689498684819.b47328aa8958f2d7a7fe515d41d5513c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:11:25,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b47328aa8958f2d7a7fe515d41d5513c 2023-07-16 09:11:25,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b47328aa8958f2d7a7fe515d41d5513c 2023-07-16 09:11:25,201 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689498684819.3cbe889c36af7edac098104493fc0bf0. 2023-07-16 09:11:25,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3cbe889c36af7edac098104493fc0bf0, NAME => 'testtb-testConsecutiveExports,1,1689498684819.3cbe889c36af7edac098104493fc0bf0.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 09:11:25,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689498684819.3cbe889c36af7edac098104493fc0bf0. service=AccessControlService 2023-07-16 09:11:25,202 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:11:25,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 3cbe889c36af7edac098104493fc0bf0 2023-07-16 09:11:25,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689498684819.3cbe889c36af7edac098104493fc0bf0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:11:25,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3cbe889c36af7edac098104493fc0bf0 2023-07-16 09:11:25,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3cbe889c36af7edac098104493fc0bf0 2023-07-16 09:11:25,202 INFO [StoreOpener-b47328aa8958f2d7a7fe515d41d5513c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b47328aa8958f2d7a7fe515d41d5513c 2023-07-16 09:11:25,203 INFO [StoreOpener-3cbe889c36af7edac098104493fc0bf0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3cbe889c36af7edac098104493fc0bf0 2023-07-16 09:11:25,204 DEBUG [StoreOpener-b47328aa8958f2d7a7fe515d41d5513c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testConsecutiveExports/b47328aa8958f2d7a7fe515d41d5513c/cf 2023-07-16 09:11:25,204 DEBUG [StoreOpener-b47328aa8958f2d7a7fe515d41d5513c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testConsecutiveExports/b47328aa8958f2d7a7fe515d41d5513c/cf 2023-07-16 09:11:25,205 INFO [StoreOpener-b47328aa8958f2d7a7fe515d41d5513c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b47328aa8958f2d7a7fe515d41d5513c columnFamilyName cf 2023-07-16 09:11:25,205 DEBUG [StoreOpener-3cbe889c36af7edac098104493fc0bf0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testConsecutiveExports/3cbe889c36af7edac098104493fc0bf0/cf 2023-07-16 09:11:25,205 DEBUG [StoreOpener-3cbe889c36af7edac098104493fc0bf0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testConsecutiveExports/3cbe889c36af7edac098104493fc0bf0/cf 2023-07-16 09:11:25,205 INFO [StoreOpener-3cbe889c36af7edac098104493fc0bf0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3cbe889c36af7edac098104493fc0bf0 columnFamilyName cf 2023-07-16 09:11:25,206 INFO [StoreOpener-b47328aa8958f2d7a7fe515d41d5513c-1] regionserver.HStore(310): Store=b47328aa8958f2d7a7fe515d41d5513c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:11:25,207 INFO [StoreOpener-3cbe889c36af7edac098104493fc0bf0-1] regionserver.HStore(310): Store=3cbe889c36af7edac098104493fc0bf0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:11:25,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testConsecutiveExports/b47328aa8958f2d7a7fe515d41d5513c 2023-07-16 09:11:25,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testConsecutiveExports/b47328aa8958f2d7a7fe515d41d5513c 2023-07-16 09:11:25,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testConsecutiveExports/3cbe889c36af7edac098104493fc0bf0 2023-07-16 09:11:25,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testConsecutiveExports/3cbe889c36af7edac098104493fc0bf0 2023-07-16 09:11:25,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b47328aa8958f2d7a7fe515d41d5513c 2023-07-16 09:11:25,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3cbe889c36af7edac098104493fc0bf0 2023-07-16 09:11:25,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testConsecutiveExports/b47328aa8958f2d7a7fe515d41d5513c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 09:11:25,213 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b47328aa8958f2d7a7fe515d41d5513c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65900582, jitterRate=-0.018004804849624634}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 09:11:25,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b47328aa8958f2d7a7fe515d41d5513c: 2023-07-16 09:11:25,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testConsecutiveExports/3cbe889c36af7edac098104493fc0bf0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 09:11:25,215 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3cbe889c36af7edac098104493fc0bf0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69534887, jitterRate=0.03615055978298187}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 09:11:25,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3cbe889c36af7edac098104493fc0bf0: 2023-07-16 09:11:25,215 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689498684819.b47328aa8958f2d7a7fe515d41d5513c., pid=45, masterSystemTime=1689498685193 2023-07-16 09:11:25,216 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689498684819.3cbe889c36af7edac098104493fc0bf0., pid=46, masterSystemTime=1689498685194 2023-07-16 09:11:25,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689498684819.b47328aa8958f2d7a7fe515d41d5513c. 2023-07-16 09:11:25,217 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689498684819.b47328aa8958f2d7a7fe515d41d5513c. 2023-07-16 09:11:25,218 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=b47328aa8958f2d7a7fe515d41d5513c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:25,218 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689498684819.b47328aa8958f2d7a7fe515d41d5513c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689498685218"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689498685218"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689498685218"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689498685218"}]},"ts":"1689498685218"} 2023-07-16 09:11:25,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689498684819.3cbe889c36af7edac098104493fc0bf0. 2023-07-16 09:11:25,218 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689498684819.3cbe889c36af7edac098104493fc0bf0. 2023-07-16 09:11:25,219 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=3cbe889c36af7edac098104493fc0bf0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:25,219 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689498684819.3cbe889c36af7edac098104493fc0bf0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689498685219"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689498685219"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689498685219"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689498685219"}]},"ts":"1689498685219"} 2023-07-16 09:11:25,223 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-16 09:11:25,223 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure b47328aa8958f2d7a7fe515d41d5513c, server=jenkins-hbase4.apache.org,45437,1689498639234 in 179 msec 2023-07-16 09:11:25,224 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-16 09:11:25,224 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 3cbe889c36af7edac098104493fc0bf0, server=jenkins-hbase4.apache.org,37709,1689498639179 in 179 msec 2023-07-16 09:11:25,224 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b47328aa8958f2d7a7fe515d41d5513c, ASSIGN in 341 msec 2023-07-16 09:11:25,227 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-16 09:11:25,227 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3cbe889c36af7edac098104493fc0bf0, ASSIGN in 342 msec 2023-07-16 09:11:25,228 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 09:11:25,228 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498685228"}]},"ts":"1689498685228"} 2023-07-16 09:11:25,230 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-16 09:11:25,234 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 09:11:25,234 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-16 09:11:25,237 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37709] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-16 09:11:25,238 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:25,238 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:25,239 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:25,239 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:25,242 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-16 09:11:25,242 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-16 09:11:25,242 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-16 09:11:25,242 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-16 09:11:25,244 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 423 msec 2023-07-16 09:11:25,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-16 09:11:25,428 INFO [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-16 09:11:25,431 DEBUG [Listener at jenkins-hbase4.apache.org/33381] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-16 09:11:25,431 DEBUG [Listener at jenkins-hbase4.apache.org/33381] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689498684819.b47328aa8958f2d7a7fe515d41d5513c. 2023-07-16 09:11:25,433 INFO [Listener at jenkins-hbase4.apache.org/33381] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 09:11:25,444 DEBUG [hconnection-0x4968aca5-shared-pool-17] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:11:25,451 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50040, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:11:25,456 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 09:11:25,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689498685456 (current time:1689498685456). 2023-07-16 09:11:25,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 09:11:25,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(139): Connect 0x58f66578 to 127.0.0.1:64380 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:11:25,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d3168c8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:11:25,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:11:25,472 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38960, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:11:25,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58f66578 to 127.0.0.1:64380 2023-07-16 09:11:25,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:11:25,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(139): Connect 0x645c719f to 127.0.0.1:64380 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:11:25,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@fea05c9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:11:25,485 DEBUG [hconnection-0x39ab5bd4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:11:25,488 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38962, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:11:25,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:11:25,496 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50044, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:11:25,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x645c719f to 127.0.0.1:64380 2023-07-16 09:11:25,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:11:25,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-16 09:11:25,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 09:11:25,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 09:11:25,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 09:11:25,503 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 09:11:25,504 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689499285504 2023-07-16 09:11:25,504 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-16 09:11:25,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 09:11:25,505 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 09:11:25,506 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 09:11:25,507 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 09:11:25,507 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 09:11:25,508 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-07-16 09:11:25,509 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 09:11:25,510 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689499285510 2023-07-16 09:11:25,525 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,525 INFO [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-16 09:11:25,526 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:11:25,527 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-16 09:11:25,527 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-16 09:11:25,528 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,528 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,532 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:25,532 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:25,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:25,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:25,532 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:25,532 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:25,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:25,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:25,532 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:25,532 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:25,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:25,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:25,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,533 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,533 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:25,533 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 09:11:25,533 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,533 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-16 09:11:25,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-16 09:11:25,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-16 09:11:25,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,533 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 09:11:25,534 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 09:11:25,533 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 09:11:25,534 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,534 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 09:11:25,534 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,534 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:11:25,534 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 09:11:25,534 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:11:25,535 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 09:11:25,537 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 09:11:25,537 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-16 09:11:25,536 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,537 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45437,1689498639234' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-16 09:11:25,537 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-16 09:11:25,537 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37709,1689498639179' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-16 09:11:25,537 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 09:11:25,537 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:11:25,541 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 09:11:25,541 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-16 09:11:25,541 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45805,1689498639118' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-16 09:11:25,542 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:25,542 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:25,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:25,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:25,542 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:25,543 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,544 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:25,544 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,544 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:11:25,544 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,544 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:11:25,544 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,544 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:11:25,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:25,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:25,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:25,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:25,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:25,546 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45437,1689498639234' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-16 09:11:25,546 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15cc36dc[Count = 1] remaining members to acquire global barrier 2023-07-16 09:11:25,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:25,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:25,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:25,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:25,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:25,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:25,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:25,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:25,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:25,549 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37709,1689498639179' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-16 09:11:25,549 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15cc36dc[Count = 0] remaining members to acquire global barrier 2023-07-16 09:11:25,549 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-16 09:11:25,549 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,554 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,555 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,555 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,555 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 09:11:25,555 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:25,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,555 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-16 09:11:25,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,555 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45805,1689498639118' in zk 2023-07-16 09:11:25,555 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 09:11:25,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,555 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:25,555 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 09:11:25,555 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 09:11:25,555 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:11:25,556 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689498684819.3cbe889c36af7edac098104493fc0bf0. 2023-07-16 09:11:25,556 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:11:25,556 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689498684819.3cbe889c36af7edac098104493fc0bf0. started... 2023-07-16 09:11:25,556 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689498684819.b47328aa8958f2d7a7fe515d41d5513c. 2023-07-16 09:11:25,556 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:11:25,556 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689498684819.b47328aa8958f2d7a7fe515d41d5513c. started... 2023-07-16 09:11:25,556 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:11:25,558 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3cbe889c36af7edac098104493fc0bf0: 2023-07-16 09:11:25,558 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b47328aa8958f2d7a7fe515d41d5513c: 2023-07-16 09:11:25,558 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689498684819.3cbe889c36af7edac098104493fc0bf0.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,558 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:11:25,558 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689498684819.b47328aa8958f2d7a7fe515d41d5513c.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,558 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 09:11:25,558 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:11:25,558 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 09:11:25,560 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 09:11:25,560 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:11:25,561 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-16 09:11:25,576 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689498684819.3cbe889c36af7edac098104493fc0bf0. completed. 2023-07-16 09:11:25,577 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689498684819.3cbe889c36af7edac098104493fc0bf0. 2023-07-16 09:11:25,577 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:11:25,577 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:11:25,577 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:25,577 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-16 09:11:25,577 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37709,1689498639179' in zk 2023-07-16 09:11:25,578 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 09:11:25,580 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:11:25,580 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-16 09:11:25,582 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:25,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:25,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:25,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:25,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:25,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:25,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,584 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689498684819.b47328aa8958f2d7a7fe515d41d5513c. completed. 2023-07-16 09:11:25,584 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689498684819.b47328aa8958f2d7a7fe515d41d5513c. 2023-07-16 09:11:25,584 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:11:25,584 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:11:25,584 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:25,584 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-16 09:11:25,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:25,584 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45437,1689498639234' in zk 2023-07-16 09:11:25,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:25,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:25,587 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 09:11:25,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:25,587 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:25,587 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:11:25,587 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-16 09:11:25,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:25,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:25,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:25,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37709,1689498639179': 2023-07-16 09:11:25,591 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37709,1689498639179' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-16 09:11:25,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:25,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:25,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:25,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:25,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:25,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:25,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:25,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:25,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:25,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:25,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:25,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:25,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,45437,1689498639234': 2023-07-16 09:11:25,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45437,1689498639234' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-16 09:11:25,597 INFO [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-16 09:11:25,597 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 09:11:25,597 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 09:11:25,597 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,597 INFO [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 09:11:25,599 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,599 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,599 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,599 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:25,599 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,599 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:25,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:25,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:25,599 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:25,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,600 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:25,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:25,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:25,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:25,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:25,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:25,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:25,601 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:25,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:25,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,603 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:25,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:25,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:25,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:25,606 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:11:25,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:25,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:25,606 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:25,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-16 09:11:25,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:11:25,607 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:25,607 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 09:11:25,608 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:25,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:25,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:25,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:25,615 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:25,615 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:25,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:25,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:25,615 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:11:25,615 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:25,615 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,617 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:25,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:25,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:25,615 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:25,615 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:25,615 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:25,617 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-16 09:11:25,618 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:25,618 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:25,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:25,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:25,618 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 09:11:25,618 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:25,618 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:25,618 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,618 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:25,618 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,618 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:25,618 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:25,618 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,618 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:25,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:25,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:25,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:25,619 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-16 09:11:25,640 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,641 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,675 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,705 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-16 09:11:25,706 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,706 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:25,706 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689498685504Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689498685640 (+136 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689498685640Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689498685640Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689498685645 (+5 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689498685665 (+20 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689498685705 (+40 ms) 2023-07-16 09:11:25,712 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 09:11:25,714 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 207 msec 2023-07-16 09:11:25,808 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:11:25,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-16 09:11:25,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 09:11:25,814 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37709] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689498684819.3cbe889c36af7edac098104493fc0bf0. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 09:11:25,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45437] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689498684819.b47328aa8958f2d7a7fe515d41d5513c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 09:11:25,822 DEBUG [Listener at jenkins-hbase4.apache.org/33381] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-16 09:11:25,822 DEBUG [Listener at jenkins-hbase4.apache.org/33381] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689498684819.b47328aa8958f2d7a7fe515d41d5513c. 2023-07-16 09:11:25,823 INFO [Listener at jenkins-hbase4.apache.org/33381] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 09:11:25,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 09:11:25,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689498685837 (current time:1689498685837). 2023-07-16 09:11:25,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 09:11:25,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(139): Connect 0x110d9eae to 127.0.0.1:64380 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:11:25,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22999d8f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:11:25,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:11:25,854 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38964, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:11:25,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x110d9eae to 127.0.0.1:64380 2023-07-16 09:11:25,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:11:25,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(139): Connect 0x75d5f1cc to 127.0.0.1:64380 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:11:25,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8d0e936, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:11:25,870 DEBUG [hconnection-0x66cb6846-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:11:25,874 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38978, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:11:25,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:11:25,879 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50048, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:11:25,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75d5f1cc to 127.0.0.1:64380 2023-07-16 09:11:25,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:11:25,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-16 09:11:25,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 09:11:25,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 09:11:25,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 09:11:25,886 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 09:11:25,887 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689499285887 2023-07-16 09:11:25,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-16 09:11:25,887 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-16 09:11:25,888 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 09:11:25,888 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 09:11:25,890 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-16 09:11:25,890 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 09:11:25,891 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-07-16 09:11:25,892 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 09:11:25,893 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689499285893 2023-07-16 09:11:25,907 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-16 09:11:25,907 INFO [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-16 09:11:25,907 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:11:25,909 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-16 09:11:25,909 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-16 09:11:25,909 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,910 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,911 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:25,911 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:25,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:25,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:25,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:25,911 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:25,911 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:25,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:25,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:25,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:25,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,912 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:25,912 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:25,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,912 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,912 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:25,912 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 09:11:25,912 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,912 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-16 09:11:25,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,912 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 09:11:25,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-16 09:11:25,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-16 09:11:25,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,913 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 09:11:25,913 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-16 09:11:25,913 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-16 09:11:25,913 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 09:11:25,913 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-16 09:11:25,913 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:11:25,913 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 09:11:25,913 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:11:25,914 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-16 09:11:25,916 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 09:11:25,916 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-16 09:11:25,916 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 09:11:25,916 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-16 09:11:25,916 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37709,1689498639179' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-16 09:11:25,916 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45805,1689498639118' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-16 09:11:25,916 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-16 09:11:25,916 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:11:25,918 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-16 09:11:25,918 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-16 09:11:25,918 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45437,1689498639234' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-16 09:11:25,919 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:25,919 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:25,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:25,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:25,921 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,921 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:25,921 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,921 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:11:25,921 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:25,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:25,921 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,921 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,922 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:11:25,921 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:11:25,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 09:11:25,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:25,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:25,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:25,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:25,923 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37709,1689498639179' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-16 09:11:25,923 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70dfdceb[Count = 1] remaining members to acquire global barrier 2023-07-16 09:11:25,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:25,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:25,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:25,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:25,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:25,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 09:11:25,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:25,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:25,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:25,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:25,926 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45437,1689498639234' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-16 09:11:25,926 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70dfdceb[Count = 0] remaining members to acquire global barrier 2023-07-16 09:11:25,926 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-16 09:11:25,926 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,927 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,927 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,927 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 09:11:25,927 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 09:11:25,927 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,927 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:25,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,927 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:11:25,927 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689498684819.b47328aa8958f2d7a7fe515d41d5513c. 2023-07-16 09:11:25,927 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:11:25,928 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689498684819.3cbe889c36af7edac098104493fc0bf0. 2023-07-16 09:11:25,927 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:11:25,928 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:25,928 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 09:11:25,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 09:11:25,928 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689498684819.3cbe889c36af7edac098104493fc0bf0. started... 2023-07-16 09:11:25,928 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-16 09:11:25,928 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-16 09:11:25,928 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:11:25,928 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689498684819.b47328aa8958f2d7a7fe515d41d5513c. started... 2023-07-16 09:11:25,928 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45805,1689498639118' in zk 2023-07-16 09:11:25,928 INFO [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b47328aa8958f2d7a7fe515d41d5513c 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-16 09:11:25,928 INFO [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3cbe889c36af7edac098104493fc0bf0 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-16 09:11:25,931 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 09:11:25,931 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:11:25,931 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-16 09:11:25,964 INFO [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307169255fcb752054c02b6123a7124ad6e39 to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307169255fcb752054c02b6123a7124ad6e39 2023-07-16 09:11:25,966 INFO [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071623b006fbdd574dba8b116a4fd43fd16f to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071623b006fbdd574dba8b116a4fd43fd16f 2023-07-16 09:11:25,973 INFO [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testConsecutiveExports/b47328aa8958f2d7a7fe515d41d5513c/.tmp/cf/08e1ba1678594d149dcdddbe98a1d154 2023-07-16 09:11:25,975 INFO [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testConsecutiveExports/3cbe889c36af7edac098104493fc0bf0/.tmp/cf/b3a80e25f6ff406580f417326dc7f0b5 2023-07-16 09:11:25,979 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testConsecutiveExports/b47328aa8958f2d7a7fe515d41d5513c/.tmp/cf/08e1ba1678594d149dcdddbe98a1d154 as hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testConsecutiveExports/b47328aa8958f2d7a7fe515d41d5513c/cf/08e1ba1678594d149dcdddbe98a1d154 2023-07-16 09:11:25,981 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testConsecutiveExports/3cbe889c36af7edac098104493fc0bf0/.tmp/cf/b3a80e25f6ff406580f417326dc7f0b5 as hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testConsecutiveExports/3cbe889c36af7edac098104493fc0bf0/cf/b3a80e25f6ff406580f417326dc7f0b5 2023-07-16 09:11:25,984 INFO [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testConsecutiveExports/b47328aa8958f2d7a7fe515d41d5513c/cf/08e1ba1678594d149dcdddbe98a1d154, entries=3, sequenceid=6, filesize=5.4 K 2023-07-16 09:11:25,986 INFO [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for b47328aa8958f2d7a7fe515d41d5513c in 58ms, sequenceid=6, compaction requested=false 2023-07-16 09:11:25,986 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-16 09:11:25,987 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b47328aa8958f2d7a7fe515d41d5513c: 2023-07-16 09:11:25,987 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689498684819.b47328aa8958f2d7a7fe515d41d5513c.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-16 09:11:25,987 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:11:25,987 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testConsecutiveExports/b47328aa8958f2d7a7fe515d41d5513c/cf/08e1ba1678594d149dcdddbe98a1d154] hfiles 2023-07-16 09:11:25,987 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testConsecutiveExports/b47328aa8958f2d7a7fe515d41d5513c/cf/08e1ba1678594d149dcdddbe98a1d154 for snapshot=snaptb0-testConsecutiveExports 2023-07-16 09:11:25,987 INFO [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testConsecutiveExports/3cbe889c36af7edac098104493fc0bf0/cf/b3a80e25f6ff406580f417326dc7f0b5, entries=47, sequenceid=6, filesize=12.7 K 2023-07-16 09:11:25,988 INFO [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 3cbe889c36af7edac098104493fc0bf0 in 60ms, sequenceid=6, compaction requested=false 2023-07-16 09:11:25,990 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:11:25,990 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3cbe889c36af7edac098104493fc0bf0: 2023-07-16 09:11:25,991 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689498684819.3cbe889c36af7edac098104493fc0bf0.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-16 09:11:25,991 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:11:25,991 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testConsecutiveExports/3cbe889c36af7edac098104493fc0bf0/cf/b3a80e25f6ff406580f417326dc7f0b5] hfiles 2023-07-16 09:11:25,991 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testConsecutiveExports/3cbe889c36af7edac098104493fc0bf0/cf/b3a80e25f6ff406580f417326dc7f0b5 for snapshot=snaptb0-testConsecutiveExports 2023-07-16 09:11:25,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-16 09:11:25,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:11:25,992 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 09:11:26,015 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689498684819.b47328aa8958f2d7a7fe515d41d5513c. completed. 2023-07-16 09:11:26,015 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689498684819.b47328aa8958f2d7a7fe515d41d5513c. 2023-07-16 09:11:26,015 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:11:26,015 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:11:26,015 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:26,015 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-16 09:11:26,015 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45437,1689498639234' in zk 2023-07-16 09:11:26,016 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689498684819.3cbe889c36af7edac098104493fc0bf0. completed. 2023-07-16 09:11:26,016 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689498684819.3cbe889c36af7edac098104493fc0bf0. 2023-07-16 09:11:26,016 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:11:26,016 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:11:26,016 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:26,016 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-16 09:11:26,016 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37709,1689498639179' in zk 2023-07-16 09:11:26,017 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 09:11:26,018 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:26,018 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:11:26,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:26,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:26,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:26,020 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:26,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:26,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:26,021 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-16 09:11:26,021 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:11:26,021 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-16 09:11:26,018 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-16 09:11:26,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 09:11:26,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:26,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:26,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:26,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:26,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 09:11:26,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:26,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:26,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:26,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,45437,1689498639234': 2023-07-16 09:11:26,031 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45437,1689498639234' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-16 09:11:26,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:26,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:26,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:26,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:26,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:26,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 09:11:26,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:26,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:26,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:26,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:26,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 09:11:26,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:26,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:26,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:26,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37709,1689498639179': 2023-07-16 09:11:26,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37709,1689498639179' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-16 09:11:26,041 INFO [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-16 09:11:26,041 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 09:11:26,041 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 09:11:26,041 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-16 09:11:26,041 INFO [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 09:11:26,043 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 09:11:26,043 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 09:11:26,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 09:11:26,044 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 09:11:26,044 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 09:11:26,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 09:11:26,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 09:11:26,044 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:26,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 09:11:26,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:26,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:26,044 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:26,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 09:11:26,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 09:11:26,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 09:11:26,044 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:26,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:26,044 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:26,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:26,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:26,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:26,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:26,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:26,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:26,045 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:26,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 09:11:26,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 09:11:26,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 09:11:26,045 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:26,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 09:11:26,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:26,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 09:11:26,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:26,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:26,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:26,048 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:26,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:26,048 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:26,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-16 09:11:26,049 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:26,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:26,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:26,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:26,055 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:26,055 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:26,055 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 09:11:26,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:26,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:26,055 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:26,056 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:26,056 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:26,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:26,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:26,056 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:26,056 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:11:26,056 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-16 09:11:26,058 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-16 09:11:26,058 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-16 09:11:26,056 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:26,056 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-16 09:11:26,056 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:26,058 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:26,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:26,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:26,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:26,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:26,058 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 09:11:26,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:26,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:26,056 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:26,059 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 09:11:26,059 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:26,059 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:26,059 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-16 09:11:26,059 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-16 09:11:26,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:26,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:26,060 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071623b006fbdd574dba8b116a4fd43fd16f, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307169255fcb752054c02b6123a7124ad6e39] mob files 2023-07-16 09:11:26,060 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071623b006fbdd574dba8b116a4fd43fd16f 2023-07-16 09:11:26,060 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307169255fcb752054c02b6123a7124ad6e39 2023-07-16 09:11:26,074 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-16 09:11:26,075 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 09:11:26,101 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-16 09:11:26,129 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-16 09:11:26,129 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 09:11:26,130 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 09:11:26,130 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689498685887Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689498686074 (+187 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689498686074Loading Region manifests for snaptb0-testConsecutiveExports at 1689498686074Writing data manifest for snaptb0-testConsecutiveExports at 1689498686078 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689498686092 (+14 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689498686129 (+37 ms) 2023-07-16 09:11:26,133 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-16 09:11:26,135 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 245 msec 2023-07-16 09:11:26,192 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:11:26,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-16 09:11:26,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 09:11:26,194 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/local-export-1689498686194 2023-07-16 09:11:26,194 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/local-export-1689498686194, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/local-export-1689498686194, srcFsUri=hdfs://localhost:43477, srcDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae 2023-07-16 09:11:26,223 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43477, inputRoot=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae 2023-07-16 09:11:26,223 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@225359a0, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/local-export-1689498686194, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/local-export-1689498686194/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 09:11:26,223 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43477, inputRoot=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae, snapshotDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-16 09:11:26,235 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/local-export-1689498686194/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 09:11:26,256 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:26,257 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:26,257 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:26,258 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:26,258 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:26,259 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:26,259 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:26,339 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/hadoop-5608447516991853436.jar 2023-07-16 09:11:26,339 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:26,340 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:26,341 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:26,341 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:26,342 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:26,342 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:26,343 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 09:11:26,343 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 09:11:26,344 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 09:11:26,345 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 09:11:26,345 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 09:11:26,345 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 09:11:26,346 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 09:11:26,346 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 09:11:26,347 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 09:11:26,347 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 09:11:26,348 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:11:26,349 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:11:26,349 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 09:11:26,349 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:11:26,350 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:11:26,350 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 09:11:26,351 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 09:11:26,731 WARN [Listener at jenkins-hbase4.apache.org/33381] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 09:11:26,733 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-16 09:11:26,735 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-16 09:11:29,153 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 09:11:29,154 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 09:11:29,154 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647086_0002_000001 (auth:SIMPLE) 2023-07-16 09:11:29,750 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647086_0003_000001 (auth:SIMPLE) 2023-07-16 09:11:30,092 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 09:11:34,321 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647086_0003_000001 (auth:SIMPLE) 2023-07-16 09:11:36,577 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647086_0003_000001 (auth:SIMPLE) 2023-07-16 09:11:39,382 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647086_0003_000001 (auth:SIMPLE) 2023-07-16 09:11:40,917 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 09:11:40,917 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 09:11:40,922 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-16 09:11:40,923 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 09:11:40,924 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 09:11:40,924 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_583604367_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-16 09:11:40,926 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(367): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-16 09:11:40,926 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(367): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-16 09:11:40,926 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@489302ff in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/local-export-1689498686194/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/local-export-1689498686194/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-16 09:11:40,927 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/local-export-1689498686194/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-16 09:11:40,927 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/local-export-1689498686194/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-16 09:11:40,928 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/local-export-1689498686194, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/local-export-1689498686194, srcFsUri=hdfs://localhost:43477, srcDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae 2023-07-16 09:11:40,953 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43477, inputRoot=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae 2023-07-16 09:11:40,953 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@7777222c, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/local-export-1689498686194, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/local-export-1689498686194/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 09:11:40,953 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43477, inputRoot=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae, snapshotDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-16 09:11:40,968 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/local-export-1689498686194/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-16 09:11:40,980 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:40,981 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:40,981 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:40,982 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:40,982 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:40,982 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:40,983 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:41,050 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/hadoop-1060857540317288262.jar 2023-07-16 09:11:41,050 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:41,051 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:41,051 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:41,051 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:41,052 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:41,052 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 09:11:41,052 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 09:11:41,053 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 09:11:41,053 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 09:11:41,054 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 09:11:41,054 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 09:11:41,054 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 09:11:41,055 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 09:11:41,055 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 09:11:41,056 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 09:11:41,056 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 09:11:41,056 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:11:41,057 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:11:41,057 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 09:11:41,057 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:11:41,058 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:11:41,058 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 09:11:41,058 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 09:11:41,522 WARN [Listener at jenkins-hbase4.apache.org/33381] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 09:11:41,525 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-16 09:11:41,527 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-16 09:11:45,558 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 09:11:45,558 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 09:11:45,561 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647086_0003_000001 (auth:SIMPLE) 2023-07-16 09:11:46,169 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647086_0004_000001 (auth:SIMPLE) 2023-07-16 09:11:50,726 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647086_0004_000001 (auth:SIMPLE) 2023-07-16 09:11:52,955 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647086_0004_000001 (auth:SIMPLE) 2023-07-16 09:11:55,996 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647086_0004_000001 (auth:SIMPLE) 2023-07-16 09:11:57,798 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 09:11:57,798 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 09:11:57,801 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-16 09:11:57,801 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 09:11:57,802 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 09:11:57,802 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_583604367_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-16 09:11:57,810 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(367): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-16 09:11:57,811 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(367): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-16 09:11:57,811 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@489302ff in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/local-export-1689498686194/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/local-export-1689498686194/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-16 09:11:57,811 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/local-export-1689498686194/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-16 09:11:57,811 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/local-export-1689498686194/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-16 09:11:57,850 INFO [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-16 09:11:57,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-16 09:11:57,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-16 09:11:57,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-16 09:11:57,855 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498717855"}]},"ts":"1689498717855"} 2023-07-16 09:11:57,857 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-16 09:11:57,859 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-16 09:11:57,860 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b47328aa8958f2d7a7fe515d41d5513c, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3cbe889c36af7edac098104493fc0bf0, UNASSIGN}] 2023-07-16 09:11:57,862 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b47328aa8958f2d7a7fe515d41d5513c, UNASSIGN 2023-07-16 09:11:57,862 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3cbe889c36af7edac098104493fc0bf0, UNASSIGN 2023-07-16 09:11:57,863 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=b47328aa8958f2d7a7fe515d41d5513c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:57,863 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689498684819.b47328aa8958f2d7a7fe515d41d5513c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689498717863"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498717863"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498717863"}]},"ts":"1689498717863"} 2023-07-16 09:11:57,863 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=3cbe889c36af7edac098104493fc0bf0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:57,863 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689498684819.3cbe889c36af7edac098104493fc0bf0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689498717863"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498717863"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498717863"}]},"ts":"1689498717863"} 2023-07-16 09:11:57,864 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure b47328aa8958f2d7a7fe515d41d5513c, server=jenkins-hbase4.apache.org,45437,1689498639234}] 2023-07-16 09:11:57,865 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 3cbe889c36af7edac098104493fc0bf0, server=jenkins-hbase4.apache.org,37709,1689498639179}] 2023-07-16 09:11:57,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-16 09:11:58,017 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b47328aa8958f2d7a7fe515d41d5513c 2023-07-16 09:11:58,017 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3cbe889c36af7edac098104493fc0bf0 2023-07-16 09:11:58,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b47328aa8958f2d7a7fe515d41d5513c, disabling compactions & flushes 2023-07-16 09:11:58,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3cbe889c36af7edac098104493fc0bf0, disabling compactions & flushes 2023-07-16 09:11:58,017 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689498684819.b47328aa8958f2d7a7fe515d41d5513c. 2023-07-16 09:11:58,017 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689498684819.3cbe889c36af7edac098104493fc0bf0. 2023-07-16 09:11:58,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689498684819.b47328aa8958f2d7a7fe515d41d5513c. 2023-07-16 09:11:58,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689498684819.3cbe889c36af7edac098104493fc0bf0. 2023-07-16 09:11:58,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689498684819.b47328aa8958f2d7a7fe515d41d5513c. after waiting 0 ms 2023-07-16 09:11:58,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689498684819.3cbe889c36af7edac098104493fc0bf0. after waiting 0 ms 2023-07-16 09:11:58,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689498684819.b47328aa8958f2d7a7fe515d41d5513c. 2023-07-16 09:11:58,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689498684819.3cbe889c36af7edac098104493fc0bf0. 2023-07-16 09:11:58,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testConsecutiveExports/b47328aa8958f2d7a7fe515d41d5513c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 09:11:58,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:11:58,032 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689498684819.b47328aa8958f2d7a7fe515d41d5513c. 2023-07-16 09:11:58,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b47328aa8958f2d7a7fe515d41d5513c: 2023-07-16 09:11:58,037 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b47328aa8958f2d7a7fe515d41d5513c 2023-07-16 09:11:58,038 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=b47328aa8958f2d7a7fe515d41d5513c, regionState=CLOSED 2023-07-16 09:11:58,039 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689498684819.b47328aa8958f2d7a7fe515d41d5513c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689498718038"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498718038"}]},"ts":"1689498718038"} 2023-07-16 09:11:58,044 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-16 09:11:58,045 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure b47328aa8958f2d7a7fe515d41d5513c, server=jenkins-hbase4.apache.org,45437,1689498639234 in 176 msec 2023-07-16 09:11:58,047 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b47328aa8958f2d7a7fe515d41d5513c, UNASSIGN in 185 msec 2023-07-16 09:11:58,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testConsecutiveExports/3cbe889c36af7edac098104493fc0bf0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 09:11:58,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:11:58,055 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689498684819.3cbe889c36af7edac098104493fc0bf0. 2023-07-16 09:11:58,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3cbe889c36af7edac098104493fc0bf0: 2023-07-16 09:11:58,057 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3cbe889c36af7edac098104493fc0bf0 2023-07-16 09:11:58,058 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=3cbe889c36af7edac098104493fc0bf0, regionState=CLOSED 2023-07-16 09:11:58,058 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689498684819.3cbe889c36af7edac098104493fc0bf0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689498718058"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498718058"}]},"ts":"1689498718058"} 2023-07-16 09:11:58,062 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-16 09:11:58,062 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 3cbe889c36af7edac098104493fc0bf0, server=jenkins-hbase4.apache.org,37709,1689498639179 in 195 msec 2023-07-16 09:11:58,064 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-16 09:11:58,064 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3cbe889c36af7edac098104493fc0bf0, UNASSIGN in 202 msec 2023-07-16 09:11:58,065 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498718065"}]},"ts":"1689498718065"} 2023-07-16 09:11:58,066 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-16 09:11:58,068 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-16 09:11:58,070 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 218 msec 2023-07-16 09:11:58,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-16 09:11:58,157 INFO [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-16 09:11:58,159 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-16 09:11:58,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 09:11:58,162 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 09:11:58,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-16 09:11:58,163 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 09:11:58,165 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37709] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-16 09:11:58,168 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 09:11:58,168 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 09:11:58,168 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 09:11:58,168 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 09:11:58,169 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-16 09:11:58,169 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-16 09:11:58,169 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-16 09:11:58,169 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-16 09:11:58,170 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testConsecutiveExports/b47328aa8958f2d7a7fe515d41d5513c 2023-07-16 09:11:58,170 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testConsecutiveExports/3cbe889c36af7edac098104493fc0bf0 2023-07-16 09:11:58,171 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testConsecutiveExports/b47328aa8958f2d7a7fe515d41d5513c/cf, FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testConsecutiveExports/b47328aa8958f2d7a7fe515d41d5513c/recovered.edits] 2023-07-16 09:11:58,172 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testConsecutiveExports/3cbe889c36af7edac098104493fc0bf0/cf, FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testConsecutiveExports/3cbe889c36af7edac098104493fc0bf0/recovered.edits] 2023-07-16 09:11:58,176 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 09:11:58,176 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 09:11:58,176 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:58,176 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 09:11:58,176 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:58,176 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-16 09:11:58,176 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:58,177 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:58,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-16 09:11:58,179 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testConsecutiveExports/b47328aa8958f2d7a7fe515d41d5513c/cf/08e1ba1678594d149dcdddbe98a1d154 to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testConsecutiveExports/b47328aa8958f2d7a7fe515d41d5513c/cf/08e1ba1678594d149dcdddbe98a1d154 2023-07-16 09:11:58,179 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testConsecutiveExports/3cbe889c36af7edac098104493fc0bf0/cf/b3a80e25f6ff406580f417326dc7f0b5 to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testConsecutiveExports/3cbe889c36af7edac098104493fc0bf0/cf/b3a80e25f6ff406580f417326dc7f0b5 2023-07-16 09:11:58,183 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testConsecutiveExports/b47328aa8958f2d7a7fe515d41d5513c/recovered.edits/9.seqid to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testConsecutiveExports/b47328aa8958f2d7a7fe515d41d5513c/recovered.edits/9.seqid 2023-07-16 09:11:58,183 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testConsecutiveExports/3cbe889c36af7edac098104493fc0bf0/recovered.edits/9.seqid to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testConsecutiveExports/3cbe889c36af7edac098104493fc0bf0/recovered.edits/9.seqid 2023-07-16 09:11:58,184 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testConsecutiveExports/b47328aa8958f2d7a7fe515d41d5513c 2023-07-16 09:11:58,184 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testConsecutiveExports/3cbe889c36af7edac098104493fc0bf0 2023-07-16 09:11:58,184 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-16 09:11:58,184 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-16 09:11:58,185 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-16 09:11:58,189 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071623b006fbdd574dba8b116a4fd43fd16f to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071623b006fbdd574dba8b116a4fd43fd16f 2023-07-16 09:11:58,190 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307169255fcb752054c02b6123a7124ad6e39 to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307169255fcb752054c02b6123a7124ad6e39 2023-07-16 09:11:58,191 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-16 09:11:58,193 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 09:11:58,196 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-16 09:11:58,197 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-16 09:11:58,198 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 09:11:58,198 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-16 09:11:58,198 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689498684819.b47328aa8958f2d7a7fe515d41d5513c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689498718198"}]},"ts":"9223372036854775807"} 2023-07-16 09:11:58,199 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689498684819.3cbe889c36af7edac098104493fc0bf0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689498718198"}]},"ts":"9223372036854775807"} 2023-07-16 09:11:58,200 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 09:11:58,200 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b47328aa8958f2d7a7fe515d41d5513c, NAME => 'testtb-testConsecutiveExports,,1689498684819.b47328aa8958f2d7a7fe515d41d5513c.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 3cbe889c36af7edac098104493fc0bf0, NAME => 'testtb-testConsecutiveExports,1,1689498684819.3cbe889c36af7edac098104493fc0bf0.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 09:11:58,200 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-16 09:11:58,200 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689498718200"}]},"ts":"9223372036854775807"} 2023-07-16 09:11:58,202 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-16 09:11:58,204 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-16 09:11:58,205 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 45 msec 2023-07-16 09:11:58,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-16 09:11:58,279 INFO [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-16 09:11:58,287 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-16 09:11:58,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-16 09:11:58,290 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-16 09:11:58,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-16 09:11:58,317 INFO [Listener at jenkins-hbase4.apache.org/33381] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=744 (was 761), OpenFileDescriptor=899 (was 921), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=512 (was 501) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 181), AvailableMemoryMB=3376 (was 2740) - AvailableMemoryMB LEAK? - 2023-07-16 09:11:58,317 WARN [Listener at jenkins-hbase4.apache.org/33381] hbase.ResourceChecker(130): Thread=744 is superior to 500 2023-07-16 09:11:58,336 INFO [Listener at jenkins-hbase4.apache.org/33381] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=744, OpenFileDescriptor=899, MaxFileDescriptor=60000, SystemLoadAverage=512, ProcessCount=179, AvailableMemoryMB=3375 2023-07-16 09:11:58,336 WARN [Listener at jenkins-hbase4.apache.org/33381] hbase.ResourceChecker(130): Thread=744 is superior to 500 2023-07-16 09:11:58,338 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-16 09:11:58,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:58,341 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 09:11:58,341 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-16 09:11:58,342 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 09:11:58,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-16 09:11:58,345 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/73cb92f4243ac87f0616f4d734709f0b 2023-07-16 09:11:58,345 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/73cb92f4243ac87f0616f4d734709f0b empty. 2023-07-16 09:11:58,345 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b83872bd0bc99ab54da8c5b12b2a9067 2023-07-16 09:11:58,346 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/73cb92f4243ac87f0616f4d734709f0b 2023-07-16 09:11:58,346 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b83872bd0bc99ab54da8c5b12b2a9067 empty. 2023-07-16 09:11:58,346 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b83872bd0bc99ab54da8c5b12b2a9067 2023-07-16 09:11:58,346 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-16 09:11:58,373 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-16 09:11:58,374 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => b83872bd0bc99ab54da8c5b12b2a9067, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689498718337.b83872bd0bc99ab54da8c5b12b2a9067.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp 2023-07-16 09:11:58,374 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 73cb92f4243ac87f0616f4d734709f0b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689498718337.73cb92f4243ac87f0616f4d734709f0b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp 2023-07-16 09:11:58,413 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689498718337.73cb92f4243ac87f0616f4d734709f0b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:11:58,413 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 73cb92f4243ac87f0616f4d734709f0b, disabling compactions & flushes 2023-07-16 09:11:58,413 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689498718337.73cb92f4243ac87f0616f4d734709f0b. 2023-07-16 09:11:58,413 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689498718337.73cb92f4243ac87f0616f4d734709f0b. 2023-07-16 09:11:58,413 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689498718337.b83872bd0bc99ab54da8c5b12b2a9067.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:11:58,413 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689498718337.73cb92f4243ac87f0616f4d734709f0b. after waiting 0 ms 2023-07-16 09:11:58,413 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing b83872bd0bc99ab54da8c5b12b2a9067, disabling compactions & flushes 2023-07-16 09:11:58,413 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689498718337.73cb92f4243ac87f0616f4d734709f0b. 2023-07-16 09:11:58,413 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689498718337.b83872bd0bc99ab54da8c5b12b2a9067. 2023-07-16 09:11:58,413 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689498718337.73cb92f4243ac87f0616f4d734709f0b. 2023-07-16 09:11:58,413 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689498718337.b83872bd0bc99ab54da8c5b12b2a9067. 2023-07-16 09:11:58,413 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 73cb92f4243ac87f0616f4d734709f0b: 2023-07-16 09:11:58,413 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689498718337.b83872bd0bc99ab54da8c5b12b2a9067. after waiting 0 ms 2023-07-16 09:11:58,413 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689498718337.b83872bd0bc99ab54da8c5b12b2a9067. 2023-07-16 09:11:58,414 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689498718337.b83872bd0bc99ab54da8c5b12b2a9067. 2023-07-16 09:11:58,414 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for b83872bd0bc99ab54da8c5b12b2a9067: 2023-07-16 09:11:58,416 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 09:11:58,417 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689498718337.73cb92f4243ac87f0616f4d734709f0b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689498718417"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498718417"}]},"ts":"1689498718417"} 2023-07-16 09:11:58,418 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689498718337.b83872bd0bc99ab54da8c5b12b2a9067.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689498718417"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498718417"}]},"ts":"1689498718417"} 2023-07-16 09:11:58,425 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 09:11:58,426 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 09:11:58,427 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498718426"}]},"ts":"1689498718426"} 2023-07-16 09:11:58,428 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-16 09:11:58,431 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 09:11:58,432 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 09:11:58,432 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 09:11:58,433 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 09:11:58,433 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 09:11:58,433 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=73cb92f4243ac87f0616f4d734709f0b, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b83872bd0bc99ab54da8c5b12b2a9067, ASSIGN}] 2023-07-16 09:11:58,435 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b83872bd0bc99ab54da8c5b12b2a9067, ASSIGN 2023-07-16 09:11:58,435 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=73cb92f4243ac87f0616f4d734709f0b, ASSIGN 2023-07-16 09:11:58,436 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b83872bd0bc99ab54da8c5b12b2a9067, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45437,1689498639234; forceNewPlan=false, retain=false 2023-07-16 09:11:58,436 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=73cb92f4243ac87f0616f4d734709f0b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37709,1689498639179; forceNewPlan=false, retain=false 2023-07-16 09:11:58,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-16 09:11:58,587 INFO [jenkins-hbase4:46005] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 09:11:58,590 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=b83872bd0bc99ab54da8c5b12b2a9067, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:58,590 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=73cb92f4243ac87f0616f4d734709f0b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:58,590 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689498718337.b83872bd0bc99ab54da8c5b12b2a9067.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689498718590"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498718590"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498718590"}]},"ts":"1689498718590"} 2023-07-16 09:11:58,591 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689498718337.73cb92f4243ac87f0616f4d734709f0b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689498718590"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498718590"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498718590"}]},"ts":"1689498718590"} 2023-07-16 09:11:58,593 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure b83872bd0bc99ab54da8c5b12b2a9067, server=jenkins-hbase4.apache.org,45437,1689498639234}] 2023-07-16 09:11:58,595 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 73cb92f4243ac87f0616f4d734709f0b, server=jenkins-hbase4.apache.org,37709,1689498639179}] 2023-07-16 09:11:58,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-16 09:11:58,752 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689498718337.b83872bd0bc99ab54da8c5b12b2a9067. 2023-07-16 09:11:58,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b83872bd0bc99ab54da8c5b12b2a9067, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689498718337.b83872bd0bc99ab54da8c5b12b2a9067.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 09:11:58,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689498718337.b83872bd0bc99ab54da8c5b12b2a9067. service=AccessControlService 2023-07-16 09:11:58,753 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:11:58,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion b83872bd0bc99ab54da8c5b12b2a9067 2023-07-16 09:11:58,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689498718337.b83872bd0bc99ab54da8c5b12b2a9067.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:11:58,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b83872bd0bc99ab54da8c5b12b2a9067 2023-07-16 09:11:58,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b83872bd0bc99ab54da8c5b12b2a9067 2023-07-16 09:11:58,756 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689498718337.73cb92f4243ac87f0616f4d734709f0b. 2023-07-16 09:11:58,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 73cb92f4243ac87f0616f4d734709f0b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689498718337.73cb92f4243ac87f0616f4d734709f0b.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 09:11:58,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689498718337.73cb92f4243ac87f0616f4d734709f0b. service=AccessControlService 2023-07-16 09:11:58,757 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:11:58,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 73cb92f4243ac87f0616f4d734709f0b 2023-07-16 09:11:58,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689498718337.73cb92f4243ac87f0616f4d734709f0b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:11:58,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 73cb92f4243ac87f0616f4d734709f0b 2023-07-16 09:11:58,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 73cb92f4243ac87f0616f4d734709f0b 2023-07-16 09:11:58,759 INFO [StoreOpener-b83872bd0bc99ab54da8c5b12b2a9067-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b83872bd0bc99ab54da8c5b12b2a9067 2023-07-16 09:11:58,761 INFO [StoreOpener-73cb92f4243ac87f0616f4d734709f0b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 73cb92f4243ac87f0616f4d734709f0b 2023-07-16 09:11:58,763 DEBUG [StoreOpener-73cb92f4243ac87f0616f4d734709f0b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion/73cb92f4243ac87f0616f4d734709f0b/cf 2023-07-16 09:11:58,763 DEBUG [StoreOpener-73cb92f4243ac87f0616f4d734709f0b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion/73cb92f4243ac87f0616f4d734709f0b/cf 2023-07-16 09:11:58,764 INFO [StoreOpener-73cb92f4243ac87f0616f4d734709f0b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 73cb92f4243ac87f0616f4d734709f0b columnFamilyName cf 2023-07-16 09:11:58,774 DEBUG [StoreOpener-b83872bd0bc99ab54da8c5b12b2a9067-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion/b83872bd0bc99ab54da8c5b12b2a9067/cf 2023-07-16 09:11:58,775 DEBUG [StoreOpener-b83872bd0bc99ab54da8c5b12b2a9067-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion/b83872bd0bc99ab54da8c5b12b2a9067/cf 2023-07-16 09:11:58,775 INFO [StoreOpener-b83872bd0bc99ab54da8c5b12b2a9067-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b83872bd0bc99ab54da8c5b12b2a9067 columnFamilyName cf 2023-07-16 09:11:58,777 INFO [StoreOpener-73cb92f4243ac87f0616f4d734709f0b-1] regionserver.HStore(310): Store=73cb92f4243ac87f0616f4d734709f0b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:11:58,778 INFO [StoreOpener-b83872bd0bc99ab54da8c5b12b2a9067-1] regionserver.HStore(310): Store=b83872bd0bc99ab54da8c5b12b2a9067/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:11:58,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion/73cb92f4243ac87f0616f4d734709f0b 2023-07-16 09:11:58,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion/b83872bd0bc99ab54da8c5b12b2a9067 2023-07-16 09:11:58,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion/73cb92f4243ac87f0616f4d734709f0b 2023-07-16 09:11:58,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion/b83872bd0bc99ab54da8c5b12b2a9067 2023-07-16 09:11:58,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b83872bd0bc99ab54da8c5b12b2a9067 2023-07-16 09:11:58,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 73cb92f4243ac87f0616f4d734709f0b 2023-07-16 09:11:58,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion/b83872bd0bc99ab54da8c5b12b2a9067/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 09:11:58,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion/73cb92f4243ac87f0616f4d734709f0b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 09:11:58,805 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b83872bd0bc99ab54da8c5b12b2a9067; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68657013, jitterRate=0.023069217801094055}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 09:11:58,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b83872bd0bc99ab54da8c5b12b2a9067: 2023-07-16 09:11:58,806 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 73cb92f4243ac87f0616f4d734709f0b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68643543, jitterRate=0.022868499159812927}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 09:11:58,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 73cb92f4243ac87f0616f4d734709f0b: 2023-07-16 09:11:58,807 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689498718337.b83872bd0bc99ab54da8c5b12b2a9067., pid=60, masterSystemTime=1689498718747 2023-07-16 09:11:58,807 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689498718337.73cb92f4243ac87f0616f4d734709f0b., pid=61, masterSystemTime=1689498718751 2023-07-16 09:11:58,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689498718337.b83872bd0bc99ab54da8c5b12b2a9067. 2023-07-16 09:11:58,809 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689498718337.b83872bd0bc99ab54da8c5b12b2a9067. 2023-07-16 09:11:58,809 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=b83872bd0bc99ab54da8c5b12b2a9067, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:58,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689498718337.73cb92f4243ac87f0616f4d734709f0b. 2023-07-16 09:11:58,810 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689498718337.b83872bd0bc99ab54da8c5b12b2a9067.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689498718809"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689498718809"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689498718809"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689498718809"}]},"ts":"1689498718809"} 2023-07-16 09:11:58,810 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689498718337.73cb92f4243ac87f0616f4d734709f0b. 2023-07-16 09:11:58,810 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=73cb92f4243ac87f0616f4d734709f0b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:58,811 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689498718337.73cb92f4243ac87f0616f4d734709f0b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689498718810"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689498718810"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689498718810"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689498718810"}]},"ts":"1689498718810"} 2023-07-16 09:11:58,815 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-16 09:11:58,815 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure b83872bd0bc99ab54da8c5b12b2a9067, server=jenkins-hbase4.apache.org,45437,1689498639234 in 219 msec 2023-07-16 09:11:58,816 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-16 09:11:58,816 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 73cb92f4243ac87f0616f4d734709f0b, server=jenkins-hbase4.apache.org,37709,1689498639179 in 218 msec 2023-07-16 09:11:58,816 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b83872bd0bc99ab54da8c5b12b2a9067, ASSIGN in 382 msec 2023-07-16 09:11:58,818 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-16 09:11:58,818 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=73cb92f4243ac87f0616f4d734709f0b, ASSIGN in 383 msec 2023-07-16 09:11:58,819 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 09:11:58,819 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498718819"}]},"ts":"1689498718819"} 2023-07-16 09:11:58,820 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-16 09:11:58,830 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 09:11:58,830 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-16 09:11:58,833 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37709] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-16 09:11:58,835 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:58,835 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:58,835 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:58,835 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:11:58,837 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 09:11:58,837 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 09:11:58,837 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 09:11:58,837 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 09:11:58,839 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 499 msec 2023-07-16 09:11:58,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-16 09:11:58,947 INFO [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-16 09:11:58,959 DEBUG [Listener at jenkins-hbase4.apache.org/33381] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:58,959 DEBUG [Listener at jenkins-hbase4.apache.org/33381] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689498718337.73cb92f4243ac87f0616f4d734709f0b. 2023-07-16 09:11:58,962 INFO [Listener at jenkins-hbase4.apache.org/33381] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 09:11:58,987 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 09:11:58,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689498718987 (current time:1689498718987). 2023-07-16 09:11:58,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 09:11:58,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(139): Connect 0x070b89f0 to 127.0.0.1:64380 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:11:58,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a2715d8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:11:58,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:11:59,002 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51190, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:11:59,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x070b89f0 to 127.0.0.1:64380 2023-07-16 09:11:59,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:11:59,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(139): Connect 0x101847da to 127.0.0.1:64380 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:11:59,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b071820, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:11:59,028 DEBUG [hconnection-0x69ac5d4d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:11:59,030 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51204, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:11:59,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:11:59,037 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48928, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:11:59,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x101847da to 127.0.0.1:64380 2023-07-16 09:11:59,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:11:59,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-16 09:11:59,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 09:11:59,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 09:11:59,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 09:11:59,043 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 09:11:59,047 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689499319047 2023-07-16 09:11:59,048 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 09:11:59,049 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 09:11:59,049 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 09:11:59,050 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 09:11:59,050 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 09:11:59,051 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 9 msec 2023-07-16 09:11:59,053 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 09:11:59,053 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689499319053 2023-07-16 09:11:59,077 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,077 INFO [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-16 09:11:59,078 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:11:59,079 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-16 09:11:59,080 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-16 09:11:59,080 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,080 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,081 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:59,081 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:59,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:59,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:59,082 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:59,081 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:59,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:59,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:59,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:59,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:59,083 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:59,083 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:59,083 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,083 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:59,083 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 09:11:59,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-16 09:11:59,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,083 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,083 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 09:11:59,084 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-16 09:11:59,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,084 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 09:11:59,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-16 09:11:59,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,085 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 09:11:59,094 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,094 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 09:11:59,094 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,094 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,094 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 09:11:59,095 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 09:11:59,095 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:11:59,094 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:11:59,096 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 09:11:59,096 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 09:11:59,095 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:11:59,098 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 09:11:59,098 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 09:11:59,098 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37709,1689498639179' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 09:11:59,096 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45437,1689498639234' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 09:11:59,100 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 09:11:59,100 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 09:11:59,100 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45805,1689498639118' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 09:11:59,102 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:59,103 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:59,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:59,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:59,103 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:59,103 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,103 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:59,103 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,103 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:11:59,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:59,104 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,104 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:11:59,104 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,104 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:11:59,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:59,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:59,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:59,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:59,106 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37709,1689498639179' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-16 09:11:59,106 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@134580d5[Count = 1] remaining members to acquire global barrier 2023-07-16 09:11:59,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:59,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:59,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:59,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:59,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:59,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:59,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:59,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:59,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:59,109 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45437,1689498639234' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-16 09:11:59,109 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@134580d5[Count = 0] remaining members to acquire global barrier 2023-07-16 09:11:59,109 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-16 09:11:59,109 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,112 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,112 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,112 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 09:11:59,112 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,112 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 09:11:59,112 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:59,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,112 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 09:11:59,113 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 09:11:59,113 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45805,1689498639118' in zk 2023-07-16 09:11:59,113 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:59,113 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 09:11:59,119 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:11:59,119 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:11:59,119 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689498718337.b83872bd0bc99ab54da8c5b12b2a9067. 2023-07-16 09:11:59,119 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689498718337.b83872bd0bc99ab54da8c5b12b2a9067. started... 2023-07-16 09:11:59,122 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 09:11:59,122 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:11:59,122 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 09:11:59,128 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:11:59,128 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b83872bd0bc99ab54da8c5b12b2a9067: 2023-07-16 09:11:59,128 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:11:59,128 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689498718337.73cb92f4243ac87f0616f4d734709f0b. 2023-07-16 09:11:59,128 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689498718337.73cb92f4243ac87f0616f4d734709f0b. started... 2023-07-16 09:11:59,128 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689498718337.b83872bd0bc99ab54da8c5b12b2a9067.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,129 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:11:59,129 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 73cb92f4243ac87f0616f4d734709f0b: 2023-07-16 09:11:59,129 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 09:11:59,129 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689498718337.73cb92f4243ac87f0616f4d734709f0b.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,129 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:11:59,129 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 09:11:59,149 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:11:59,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 09:11:59,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:11:59,151 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 09:11:59,183 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689498718337.b83872bd0bc99ab54da8c5b12b2a9067. completed. 2023-07-16 09:11:59,183 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689498718337.b83872bd0bc99ab54da8c5b12b2a9067. 2023-07-16 09:11:59,183 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:11:59,183 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:11:59,183 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:59,183 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 09:11:59,183 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45437,1689498639234' in zk 2023-07-16 09:11:59,186 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:59,186 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 09:11:59,186 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:11:59,186 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 09:11:59,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:59,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:59,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:59,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:59,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:59,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:59,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:59,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:59,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:59,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:59,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:59,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,45437,1689498639234': 2023-07-16 09:11:59,196 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45437,1689498639234' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-16 09:11:59,351 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:11:59,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 09:11:59,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:11:59,354 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 09:11:59,637 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689498718337.73cb92f4243ac87f0616f4d734709f0b. completed. 2023-07-16 09:11:59,638 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689498718337.73cb92f4243ac87f0616f4d734709f0b. 2023-07-16 09:11:59,638 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:11:59,638 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:11:59,638 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:59,638 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 09:11:59,638 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37709,1689498639179' in zk 2023-07-16 09:11:59,640 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:59,640 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 09:11:59,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:59,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:59,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:59,640 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:11:59,640 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 09:11:59,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:59,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:59,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:59,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:59,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:59,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:59,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:59,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:59,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:59,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37709,1689498639179': 2023-07-16 09:11:59,647 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37709,1689498639179' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-16 09:11:59,647 INFO [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-16 09:11:59,647 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 09:11:59,647 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 09:11:59,647 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,647 INFO [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 09:11:59,649 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,649 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,649 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,649 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:59,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,649 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:59,649 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:59,649 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:11:59,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:11:59,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:59,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:59,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:59,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:59,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:59,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:59,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:11:59,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,652 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:59,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:11:59,652 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:59,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,653 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:59,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:59,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:59,654 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:11:59,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:59,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:11:59,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 09:11:59,655 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:59,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:11:59,656 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-16 09:11:59,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,659 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:59,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:59,660 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:59,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:59,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:59,664 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:59,664 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:59,664 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:59,664 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:59,664 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,664 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:59,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:59,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:59,664 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:59,664 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:11:59,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:59,664 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:11:59,664 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:11:59,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:11:59,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:59,664 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:59,666 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:59,664 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:11:59,667 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:59,667 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,667 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 09:11:59,667 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:11:59,667 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,667 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:11:59,667 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:11:59,667 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,667 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:59,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:59,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:11:59,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:11:59,668 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-16 09:11:59,684 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,685 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,719 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,757 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-16 09:11:59,758 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,758 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:11:59,758 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689498719048Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689498719684 (+636 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689498719684Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689498719684Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689498719690 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689498719703 (+13 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689498719757 (+54 ms) 2023-07-16 09:11:59,761 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 09:11:59,762 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 712 msec 2023-07-16 09:12:00,156 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:12:00,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 09:12:00,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 09:12:00,171 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37709] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689498718337.73cb92f4243ac87f0616f4d734709f0b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 09:12:00,180 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45437] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689498718337.b83872bd0bc99ab54da8c5b12b2a9067. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 09:12:00,184 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-16 09:12:00,185 DEBUG [Listener at jenkins-hbase4.apache.org/33381] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,185 DEBUG [Listener at jenkins-hbase4.apache.org/33381] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689498718337.73cb92f4243ac87f0616f4d734709f0b. 2023-07-16 09:12:00,186 INFO [Listener at jenkins-hbase4.apache.org/33381] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 09:12:00,199 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 09:12:00,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689498720199 (current time:1689498720199). 2023-07-16 09:12:00,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 09:12:00,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(139): Connect 0x01740c42 to 127.0.0.1:64380 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:12:00,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a3d9591, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:12:00,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:12:00,241 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51212, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:12:00,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x01740c42 to 127.0.0.1:64380 2023-07-16 09:12:00,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:12:00,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(139): Connect 0x375d328c to 127.0.0.1:64380 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:12:00,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@166a2e39, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:12:00,295 DEBUG [hconnection-0x10fdb078-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:12:00,302 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51214, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:12:00,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:12:00,313 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48938, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:12:00,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x375d328c to 127.0.0.1:64380 2023-07-16 09:12:00,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:12:00,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-16 09:12:00,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 09:12:00,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 09:12:00,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 09:12:00,344 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 09:12:00,346 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689499320345 2023-07-16 09:12:00,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-16 09:12:00,346 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,346 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 09:12:00,346 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 09:12:00,355 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 09:12:00,356 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-16 09:12:00,358 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 38 msec 2023-07-16 09:12:00,361 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 09:12:00,362 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689499320362 2023-07-16 09:12:00,406 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,406 INFO [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-16 09:12:00,406 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:00,408 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-16 09:12:00,408 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-16 09:12:00,409 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,409 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,412 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:00,412 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:00,412 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:00,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:00,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:00,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:00,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:00,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:00,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:00,412 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:00,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,413 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:00,413 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:00,413 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,413 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,413 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,414 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:00,414 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 09:12:00,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-16 09:12:00,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-16 09:12:00,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,414 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 09:12:00,414 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 09:12:00,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-16 09:12:00,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,415 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-16 09:12:00,426 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,427 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 09:12:00,427 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:00,427 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,436 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 09:12:00,436 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 09:12:00,436 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 09:12:00,436 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37709,1689498639179' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 09:12:00,427 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,436 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:00,436 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-16 09:12:00,436 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:00,438 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 09:12:00,439 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 09:12:00,439 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45805,1689498639118' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 09:12:00,439 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-16 09:12:00,439 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-16 09:12:00,439 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45437,1689498639234' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-16 09:12:00,440 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,440 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:00,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:00,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:00,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:00,441 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:00,442 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,442 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,442 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:12:00,442 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,442 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:12:00,442 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,442 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:12:00,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:00,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:00,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:00,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:00,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:00,445 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37709,1689498639179' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-16 09:12:00,445 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@33ca15e1[Count = 1] remaining members to acquire global barrier 2023-07-16 09:12:00,446 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:00,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:00,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:00,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:00,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:00,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:00,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:00,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:00,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:00,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:00,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45437,1689498639234' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-16 09:12:00,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@33ca15e1[Count = 0] remaining members to acquire global barrier 2023-07-16 09:12:00,449 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-16 09:12:00,449 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,452 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:12:00,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 09:12:00,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:12:00,453 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 09:12:00,456 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,457 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,457 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,457 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:00,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,457 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 09:12:00,457 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 09:12:00,457 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-16 09:12:00,457 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:00,457 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 09:12:00,457 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 09:12:00,458 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45805,1689498639118' in zk 2023-07-16 09:12:00,458 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689498718337.b83872bd0bc99ab54da8c5b12b2a9067. 2023-07-16 09:12:00,458 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:12:00,458 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:12:00,458 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:12:00,458 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689498718337.b83872bd0bc99ab54da8c5b12b2a9067. started... 2023-07-16 09:12:00,458 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:12:00,458 INFO [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b83872bd0bc99ab54da8c5b12b2a9067 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-16 09:12:00,459 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689498718337.73cb92f4243ac87f0616f4d734709f0b. 2023-07-16 09:12:00,459 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689498718337.73cb92f4243ac87f0616f4d734709f0b. started... 2023-07-16 09:12:00,459 INFO [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 73cb92f4243ac87f0616f4d734709f0b 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-16 09:12:00,459 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 09:12:00,460 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:00,460 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 09:12:00,505 INFO [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230716b40bc394d5af42c9b7779fcde7f52074 to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230716b40bc394d5af42c9b7779fcde7f52074 2023-07-16 09:12:00,526 INFO [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion/73cb92f4243ac87f0616f4d734709f0b/.tmp/cf/f73528c587964868bf9dbef72b2a7216 2023-07-16 09:12:00,531 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion/73cb92f4243ac87f0616f4d734709f0b/.tmp/cf/f73528c587964868bf9dbef72b2a7216 as hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion/73cb92f4243ac87f0616f4d734709f0b/cf/f73528c587964868bf9dbef72b2a7216 2023-07-16 09:12:00,537 INFO [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion/73cb92f4243ac87f0616f4d734709f0b/cf/f73528c587964868bf9dbef72b2a7216, entries=2, sequenceid=6, filesize=5.3 K 2023-07-16 09:12:00,540 INFO [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 73cb92f4243ac87f0616f4d734709f0b in 81ms, sequenceid=6, compaction requested=false 2023-07-16 09:12:00,541 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 73cb92f4243ac87f0616f4d734709f0b: 2023-07-16 09:12:00,542 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689498718337.73cb92f4243ac87f0616f4d734709f0b.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,542 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:12:00,542 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion/73cb92f4243ac87f0616f4d734709f0b/cf/f73528c587964868bf9dbef72b2a7216] hfiles 2023-07-16 09:12:00,542 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion/73cb92f4243ac87f0616f4d734709f0b/cf/f73528c587964868bf9dbef72b2a7216 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,554 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689498718337.73cb92f4243ac87f0616f4d734709f0b. completed. 2023-07-16 09:12:00,554 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689498718337.73cb92f4243ac87f0616f4d734709f0b. 2023-07-16 09:12:00,555 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:12:00,555 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:12:00,555 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:00,555 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 09:12:00,555 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37709,1689498639179' in zk 2023-07-16 09:12:00,556 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 09:12:00,556 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:00,556 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:00,556 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 09:12:00,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:00,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:00,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:00,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:00,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:00,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:00,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:00,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:00,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:00,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:00,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:00,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37709,1689498639179': 2023-07-16 09:12:00,562 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37709,1689498639179' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-16 09:12:00,653 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:12:00,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 09:12:00,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:12:00,655 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 09:12:00,908 INFO [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307167c01cb7bfc7b4c3aaae99e8792084e3e to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307167c01cb7bfc7b4c3aaae99e8792084e3e 2023-07-16 09:12:00,926 INFO [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion/b83872bd0bc99ab54da8c5b12b2a9067/.tmp/cf/972f0988d54b45a8b18ac0d837a9ee56 2023-07-16 09:12:00,933 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion/b83872bd0bc99ab54da8c5b12b2a9067/.tmp/cf/972f0988d54b45a8b18ac0d837a9ee56 as hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion/b83872bd0bc99ab54da8c5b12b2a9067/cf/972f0988d54b45a8b18ac0d837a9ee56 2023-07-16 09:12:00,945 INFO [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion/b83872bd0bc99ab54da8c5b12b2a9067/cf/972f0988d54b45a8b18ac0d837a9ee56, entries=48, sequenceid=6, filesize=13.7 K 2023-07-16 09:12:00,948 INFO [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for b83872bd0bc99ab54da8c5b12b2a9067 in 490ms, sequenceid=6, compaction requested=false 2023-07-16 09:12:00,948 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b83872bd0bc99ab54da8c5b12b2a9067: 2023-07-16 09:12:00,948 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689498718337.b83872bd0bc99ab54da8c5b12b2a9067.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,949 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:12:00,949 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion/b83872bd0bc99ab54da8c5b12b2a9067/cf/972f0988d54b45a8b18ac0d837a9ee56] hfiles 2023-07-16 09:12:00,949 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion/b83872bd0bc99ab54da8c5b12b2a9067/cf/972f0988d54b45a8b18ac0d837a9ee56 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,955 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:12:00,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 09:12:00,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:12:00,957 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-16 09:12:00,966 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689498718337.b83872bd0bc99ab54da8c5b12b2a9067. completed. 2023-07-16 09:12:00,966 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689498718337.b83872bd0bc99ab54da8c5b12b2a9067. 2023-07-16 09:12:00,966 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:12:00,966 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:12:00,966 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:00,966 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-16 09:12:00,966 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45437,1689498639234' in zk 2023-07-16 09:12:00,968 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-16 09:12:00,968 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:00,968 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:00,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:00,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:00,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:00,968 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-16 09:12:00,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:00,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:00,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:00,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:00,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:00,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:00,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:00,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:00,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:00,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,45437,1689498639234': 2023-07-16 09:12:00,982 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45437,1689498639234' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-16 09:12:00,982 INFO [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-16 09:12:00,982 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 09:12:00,982 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 09:12:00,982 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,982 INFO [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 09:12:00,989 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,989 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,989 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:00,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:00,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,989 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:00,989 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,989 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:00,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,989 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:00,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:00,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:00,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:00,990 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:00,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:00,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:00,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:00,991 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:00,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:00,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,991 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:00,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:00,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:00,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:00,994 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:00,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:00,994 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:00,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:00,995 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:00,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:00,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:00,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:00,999 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:00,999 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:00,999 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:00,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:00,999 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:00,999 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,999 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:00,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:00,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:00,999 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:00,999 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,999 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:01,000 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:00,999 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:00,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:00,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:01,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:00,999 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:01,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:01,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:01,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:01,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:01,000 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 09:12:01,000 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:01,003 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:01,003 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:01,003 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:01,003 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:01,003 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:01,004 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:01,004 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:01,004 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:01,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:01,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:01,004 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307167c01cb7bfc7b4c3aaae99e8792084e3e, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230716b40bc394d5af42c9b7779fcde7f52074] mob files 2023-07-16 09:12:01,005 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307167c01cb7bfc7b4c3aaae99e8792084e3e 2023-07-16 09:12:01,005 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230716b40bc394d5af42c9b7779fcde7f52074 2023-07-16 09:12:01,051 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:01,052 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:01,458 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:12:01,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 09:12:01,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:12:01,460 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-16 09:12:01,521 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:01,556 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-16 09:12:01,556 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:01,556 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:01,556 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689498720346Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689498721051 (+705 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689498721051Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689498721051Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689498721065 (+14 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689498721503 (+438 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689498721556 (+53 ms) 2023-07-16 09:12:01,559 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-16 09:12:01,560 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 1.2090 sec 2023-07-16 09:12:02,158 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647086_0004_000001 (auth:SIMPLE) 2023-07-16 09:12:02,460 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:12:02,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-16 09:12:02,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 09:12:02,527 DEBUG [Listener at jenkins-hbase4.apache.org/33381] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 09:12:02,533 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60700, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 09:12:02,535 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37709] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-16 09:12:02,537 DEBUG [Listener at jenkins-hbase4.apache.org/33381] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 09:12:02,545 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39292, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 09:12:02,545 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45437] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-16 09:12:02,546 DEBUG [Listener at jenkins-hbase4.apache.org/33381] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-16 09:12:02,551 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41820, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-16 09:12:02,551 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45805] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-16 09:12:02,554 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-16 09:12:02,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:02,567 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 09:12:02,567 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-16 09:12:02,568 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 09:12:02,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-16 09:12:02,582 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a8b9aa88a2bb6ac5dd1a514be3e1d562 2023-07-16 09:12:02,583 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a8b9aa88a2bb6ac5dd1a514be3e1d562 empty. 2023-07-16 09:12:02,583 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a8b9aa88a2bb6ac5dd1a514be3e1d562 2023-07-16 09:12:02,598 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b88e7c44108640d81a63d22ee4c2581 2023-07-16 09:12:02,614 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b88e7c44108640d81a63d22ee4c2581 empty. 2023-07-16 09:12:02,615 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b88e7c44108640d81a63d22ee4c2581 2023-07-16 09:12:02,615 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-16 09:12:02,636 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-16 09:12:02,637 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => a8b9aa88a2bb6ac5dd1a514be3e1d562, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722554.a8b9aa88a2bb6ac5dd1a514be3e1d562.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp 2023-07-16 09:12:02,639 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5b88e7c44108640d81a63d22ee4c2581, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498722554.5b88e7c44108640d81a63d22ee4c2581.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp 2023-07-16 09:12:02,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-16 09:12:02,707 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722554.a8b9aa88a2bb6ac5dd1a514be3e1d562.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:12:02,707 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing a8b9aa88a2bb6ac5dd1a514be3e1d562, disabling compactions & flushes 2023-07-16 09:12:02,707 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722554.a8b9aa88a2bb6ac5dd1a514be3e1d562. 2023-07-16 09:12:02,707 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722554.a8b9aa88a2bb6ac5dd1a514be3e1d562. 2023-07-16 09:12:02,707 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722554.a8b9aa88a2bb6ac5dd1a514be3e1d562. after waiting 0 ms 2023-07-16 09:12:02,707 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722554.a8b9aa88a2bb6ac5dd1a514be3e1d562. 2023-07-16 09:12:02,707 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722554.a8b9aa88a2bb6ac5dd1a514be3e1d562. 2023-07-16 09:12:02,707 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for a8b9aa88a2bb6ac5dd1a514be3e1d562: 2023-07-16 09:12:02,710 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498722554.5b88e7c44108640d81a63d22ee4c2581.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:12:02,710 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 5b88e7c44108640d81a63d22ee4c2581, disabling compactions & flushes 2023-07-16 09:12:02,710 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498722554.5b88e7c44108640d81a63d22ee4c2581. 2023-07-16 09:12:02,711 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498722554.5b88e7c44108640d81a63d22ee4c2581. 2023-07-16 09:12:02,711 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498722554.5b88e7c44108640d81a63d22ee4c2581. after waiting 0 ms 2023-07-16 09:12:02,711 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498722554.5b88e7c44108640d81a63d22ee4c2581. 2023-07-16 09:12:02,711 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498722554.5b88e7c44108640d81a63d22ee4c2581. 2023-07-16 09:12:02,711 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 5b88e7c44108640d81a63d22ee4c2581: 2023-07-16 09:12:02,713 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 09:12:02,715 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722554.a8b9aa88a2bb6ac5dd1a514be3e1d562.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689498722715"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498722715"}]},"ts":"1689498722715"} 2023-07-16 09:12:02,715 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498722554.5b88e7c44108640d81a63d22ee4c2581.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689498722715"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498722715"}]},"ts":"1689498722715"} 2023-07-16 09:12:02,718 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 09:12:02,719 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 09:12:02,719 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498722719"}]},"ts":"1689498722719"} 2023-07-16 09:12:02,721 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-16 09:12:02,727 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 09:12:02,728 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 09:12:02,728 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 09:12:02,728 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 09:12:02,728 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 09:12:02,729 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a8b9aa88a2bb6ac5dd1a514be3e1d562, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5b88e7c44108640d81a63d22ee4c2581, ASSIGN}] 2023-07-16 09:12:02,731 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5b88e7c44108640d81a63d22ee4c2581, ASSIGN 2023-07-16 09:12:02,731 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a8b9aa88a2bb6ac5dd1a514be3e1d562, ASSIGN 2023-07-16 09:12:02,732 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a8b9aa88a2bb6ac5dd1a514be3e1d562, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45805,1689498639118; forceNewPlan=false, retain=false 2023-07-16 09:12:02,732 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5b88e7c44108640d81a63d22ee4c2581, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37709,1689498639179; forceNewPlan=false, retain=false 2023-07-16 09:12:02,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-16 09:12:02,883 INFO [jenkins-hbase4:46005] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 09:12:02,886 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=5b88e7c44108640d81a63d22ee4c2581, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:02,887 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498722554.5b88e7c44108640d81a63d22ee4c2581.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689498722886"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498722886"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498722886"}]},"ts":"1689498722886"} 2023-07-16 09:12:02,886 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=a8b9aa88a2bb6ac5dd1a514be3e1d562, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:02,887 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722554.a8b9aa88a2bb6ac5dd1a514be3e1d562.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689498722886"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498722886"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498722886"}]},"ts":"1689498722886"} 2023-07-16 09:12:02,891 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 5b88e7c44108640d81a63d22ee4c2581, server=jenkins-hbase4.apache.org,37709,1689498639179}] 2023-07-16 09:12:02,893 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure a8b9aa88a2bb6ac5dd1a514be3e1d562, server=jenkins-hbase4.apache.org,45805,1689498639118}] 2023-07-16 09:12:03,047 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498722554.5b88e7c44108640d81a63d22ee4c2581. 2023-07-16 09:12:03,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5b88e7c44108640d81a63d22ee4c2581, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498722554.5b88e7c44108640d81a63d22ee4c2581.', STARTKEY => '2', ENDKEY => ''} 2023-07-16 09:12:03,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498722554.5b88e7c44108640d81a63d22ee4c2581. service=AccessControlService 2023-07-16 09:12:03,048 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:12:03,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 5b88e7c44108640d81a63d22ee4c2581 2023-07-16 09:12:03,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498722554.5b88e7c44108640d81a63d22ee4c2581.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:12:03,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5b88e7c44108640d81a63d22ee4c2581 2023-07-16 09:12:03,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5b88e7c44108640d81a63d22ee4c2581 2023-07-16 09:12:03,077 INFO [StoreOpener-5b88e7c44108640d81a63d22ee4c2581-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5b88e7c44108640d81a63d22ee4c2581 2023-07-16 09:12:03,079 DEBUG [StoreOpener-5b88e7c44108640d81a63d22ee4c2581-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b88e7c44108640d81a63d22ee4c2581/cf 2023-07-16 09:12:03,079 DEBUG [StoreOpener-5b88e7c44108640d81a63d22ee4c2581-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b88e7c44108640d81a63d22ee4c2581/cf 2023-07-16 09:12:03,079 INFO [StoreOpener-5b88e7c44108640d81a63d22ee4c2581-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5b88e7c44108640d81a63d22ee4c2581 columnFamilyName cf 2023-07-16 09:12:03,083 INFO [StoreOpener-5b88e7c44108640d81a63d22ee4c2581-1] regionserver.HStore(310): Store=5b88e7c44108640d81a63d22ee4c2581/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:12:03,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b88e7c44108640d81a63d22ee4c2581 2023-07-16 09:12:03,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b88e7c44108640d81a63d22ee4c2581 2023-07-16 09:12:03,086 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722554.a8b9aa88a2bb6ac5dd1a514be3e1d562. 2023-07-16 09:12:03,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a8b9aa88a2bb6ac5dd1a514be3e1d562, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722554.a8b9aa88a2bb6ac5dd1a514be3e1d562.', STARTKEY => '', ENDKEY => '2'} 2023-07-16 09:12:03,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722554.a8b9aa88a2bb6ac5dd1a514be3e1d562. service=AccessControlService 2023-07-16 09:12:03,087 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:12:03,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 a8b9aa88a2bb6ac5dd1a514be3e1d562 2023-07-16 09:12:03,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722554.a8b9aa88a2bb6ac5dd1a514be3e1d562.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:12:03,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a8b9aa88a2bb6ac5dd1a514be3e1d562 2023-07-16 09:12:03,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a8b9aa88a2bb6ac5dd1a514be3e1d562 2023-07-16 09:12:03,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5b88e7c44108640d81a63d22ee4c2581 2023-07-16 09:12:03,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b88e7c44108640d81a63d22ee4c2581/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 09:12:03,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5b88e7c44108640d81a63d22ee4c2581; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68477321, jitterRate=0.020391598343849182}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 09:12:03,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5b88e7c44108640d81a63d22ee4c2581: 2023-07-16 09:12:03,109 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498722554.5b88e7c44108640d81a63d22ee4c2581., pid=69, masterSystemTime=1689498723043 2023-07-16 09:12:03,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498722554.5b88e7c44108640d81a63d22ee4c2581. 2023-07-16 09:12:03,111 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498722554.5b88e7c44108640d81a63d22ee4c2581. 2023-07-16 09:12:03,112 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=5b88e7c44108640d81a63d22ee4c2581, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:03,112 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498722554.5b88e7c44108640d81a63d22ee4c2581.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689498723112"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689498723112"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689498723112"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689498723112"}]},"ts":"1689498723112"} 2023-07-16 09:12:03,116 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-16 09:12:03,116 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 5b88e7c44108640d81a63d22ee4c2581, server=jenkins-hbase4.apache.org,37709,1689498639179 in 223 msec 2023-07-16 09:12:03,118 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5b88e7c44108640d81a63d22ee4c2581, ASSIGN in 387 msec 2023-07-16 09:12:03,120 INFO [StoreOpener-a8b9aa88a2bb6ac5dd1a514be3e1d562-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a8b9aa88a2bb6ac5dd1a514be3e1d562 2023-07-16 09:12:03,127 DEBUG [StoreOpener-a8b9aa88a2bb6ac5dd1a514be3e1d562-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a8b9aa88a2bb6ac5dd1a514be3e1d562/cf 2023-07-16 09:12:03,127 DEBUG [StoreOpener-a8b9aa88a2bb6ac5dd1a514be3e1d562-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a8b9aa88a2bb6ac5dd1a514be3e1d562/cf 2023-07-16 09:12:03,128 INFO [StoreOpener-a8b9aa88a2bb6ac5dd1a514be3e1d562-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a8b9aa88a2bb6ac5dd1a514be3e1d562 columnFamilyName cf 2023-07-16 09:12:03,129 INFO [StoreOpener-a8b9aa88a2bb6ac5dd1a514be3e1d562-1] regionserver.HStore(310): Store=a8b9aa88a2bb6ac5dd1a514be3e1d562/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:12:03,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a8b9aa88a2bb6ac5dd1a514be3e1d562 2023-07-16 09:12:03,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a8b9aa88a2bb6ac5dd1a514be3e1d562 2023-07-16 09:12:03,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a8b9aa88a2bb6ac5dd1a514be3e1d562 2023-07-16 09:12:03,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a8b9aa88a2bb6ac5dd1a514be3e1d562/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 09:12:03,143 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a8b9aa88a2bb6ac5dd1a514be3e1d562; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75069160, jitterRate=0.11861765384674072}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 09:12:03,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a8b9aa88a2bb6ac5dd1a514be3e1d562: 2023-07-16 09:12:03,144 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722554.a8b9aa88a2bb6ac5dd1a514be3e1d562., pid=70, masterSystemTime=1689498723044 2023-07-16 09:12:03,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722554.a8b9aa88a2bb6ac5dd1a514be3e1d562. 2023-07-16 09:12:03,146 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722554.a8b9aa88a2bb6ac5dd1a514be3e1d562. 2023-07-16 09:12:03,147 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=a8b9aa88a2bb6ac5dd1a514be3e1d562, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:03,147 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722554.a8b9aa88a2bb6ac5dd1a514be3e1d562.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689498723146"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689498723146"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689498723146"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689498723146"}]},"ts":"1689498723146"} 2023-07-16 09:12:03,150 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-16 09:12:03,150 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure a8b9aa88a2bb6ac5dd1a514be3e1d562, server=jenkins-hbase4.apache.org,45805,1689498639118 in 255 msec 2023-07-16 09:12:03,152 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-16 09:12:03,152 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a8b9aa88a2bb6ac5dd1a514be3e1d562, ASSIGN in 421 msec 2023-07-16 09:12:03,161 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 09:12:03,161 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498723161"}]},"ts":"1689498723161"} 2023-07-16 09:12:03,163 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-16 09:12:03,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-16 09:12:03,220 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 09:12:03,221 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-16 09:12:03,223 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37709] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-16 09:12:03,273 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:03,273 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:03,273 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:03,273 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:03,320 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 09:12:03,320 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-16 09:12:03,321 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 09:12:03,321 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-16 09:12:03,321 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 09:12:03,321 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-16 09:12:03,322 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 09:12:03,322 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-16 09:12:03,324 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 765 msec 2023-07-16 09:12:03,662 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 09:12:03,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-16 09:12:03,677 INFO [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-16 09:12:03,739 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions a8b9aa88a2bb6ac5dd1a514be3e1d562, 5b88e7c44108640d81a63d22ee4c2581 2023-07-16 09:12:03,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a8b9aa88a2bb6ac5dd1a514be3e1d562, 5b88e7c44108640d81a63d22ee4c2581], force=true 2023-07-16 09:12:03,754 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a8b9aa88a2bb6ac5dd1a514be3e1d562, 5b88e7c44108640d81a63d22ee4c2581], force=true 2023-07-16 09:12:03,754 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a8b9aa88a2bb6ac5dd1a514be3e1d562, 5b88e7c44108640d81a63d22ee4c2581], force=true 2023-07-16 09:12:03,754 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a8b9aa88a2bb6ac5dd1a514be3e1d562, 5b88e7c44108640d81a63d22ee4c2581], force=true 2023-07-16 09:12:03,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-16 09:12:03,780 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a8b9aa88a2bb6ac5dd1a514be3e1d562, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5b88e7c44108640d81a63d22ee4c2581, UNASSIGN}] 2023-07-16 09:12:03,782 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5b88e7c44108640d81a63d22ee4c2581, UNASSIGN 2023-07-16 09:12:03,783 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a8b9aa88a2bb6ac5dd1a514be3e1d562, UNASSIGN 2023-07-16 09:12:03,784 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=5b88e7c44108640d81a63d22ee4c2581, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:03,784 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=a8b9aa88a2bb6ac5dd1a514be3e1d562, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:03,784 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498722554.5b88e7c44108640d81a63d22ee4c2581.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689498723784"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498723784"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498723784"}]},"ts":"1689498723784"} 2023-07-16 09:12:03,784 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722554.a8b9aa88a2bb6ac5dd1a514be3e1d562.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689498723784"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498723784"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498723784"}]},"ts":"1689498723784"} 2023-07-16 09:12:03,786 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 5b88e7c44108640d81a63d22ee4c2581, server=jenkins-hbase4.apache.org,37709,1689498639179}] 2023-07-16 09:12:03,789 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure a8b9aa88a2bb6ac5dd1a514be3e1d562, server=jenkins-hbase4.apache.org,45805,1689498639118}] 2023-07-16 09:12:03,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-16 09:12:03,939 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5b88e7c44108640d81a63d22ee4c2581 2023-07-16 09:12:03,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5b88e7c44108640d81a63d22ee4c2581, disabling compactions & flushes 2023-07-16 09:12:03,940 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498722554.5b88e7c44108640d81a63d22ee4c2581. 2023-07-16 09:12:03,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498722554.5b88e7c44108640d81a63d22ee4c2581. 2023-07-16 09:12:03,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498722554.5b88e7c44108640d81a63d22ee4c2581. after waiting 0 ms 2023-07-16 09:12:03,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498722554.5b88e7c44108640d81a63d22ee4c2581. 2023-07-16 09:12:03,941 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 5b88e7c44108640d81a63d22ee4c2581 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-16 09:12:03,941 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a8b9aa88a2bb6ac5dd1a514be3e1d562 2023-07-16 09:12:03,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a8b9aa88a2bb6ac5dd1a514be3e1d562, disabling compactions & flushes 2023-07-16 09:12:03,942 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722554.a8b9aa88a2bb6ac5dd1a514be3e1d562. 2023-07-16 09:12:03,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722554.a8b9aa88a2bb6ac5dd1a514be3e1d562. 2023-07-16 09:12:03,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722554.a8b9aa88a2bb6ac5dd1a514be3e1d562. after waiting 0 ms 2023-07-16 09:12:03,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722554.a8b9aa88a2bb6ac5dd1a514be3e1d562. 2023-07-16 09:12:03,943 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing a8b9aa88a2bb6ac5dd1a514be3e1d562 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-16 09:12:04,003 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a8b9aa88a2bb6ac5dd1a514be3e1d562/.tmp/cf/145c83ac23c54bed96ed8b2ecc4316ab 2023-07-16 09:12:04,007 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b88e7c44108640d81a63d22ee4c2581/.tmp/cf/fb40f90a852b43e98b871b23e0860552 2023-07-16 09:12:04,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a8b9aa88a2bb6ac5dd1a514be3e1d562/.tmp/cf/145c83ac23c54bed96ed8b2ecc4316ab as hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a8b9aa88a2bb6ac5dd1a514be3e1d562/cf/145c83ac23c54bed96ed8b2ecc4316ab 2023-07-16 09:12:04,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b88e7c44108640d81a63d22ee4c2581/.tmp/cf/fb40f90a852b43e98b871b23e0860552 as hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b88e7c44108640d81a63d22ee4c2581/cf/fb40f90a852b43e98b871b23e0860552 2023-07-16 09:12:04,022 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a8b9aa88a2bb6ac5dd1a514be3e1d562/cf/145c83ac23c54bed96ed8b2ecc4316ab, entries=1, sequenceid=5, filesize=4.7 K 2023-07-16 09:12:04,023 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for a8b9aa88a2bb6ac5dd1a514be3e1d562 in 80ms, sequenceid=5, compaction requested=false 2023-07-16 09:12:04,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-16 09:12:04,024 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b88e7c44108640d81a63d22ee4c2581/cf/fb40f90a852b43e98b871b23e0860552, entries=1, sequenceid=5, filesize=4.7 K 2023-07-16 09:12:04,025 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 5b88e7c44108640d81a63d22ee4c2581 in 84ms, sequenceid=5, compaction requested=false 2023-07-16 09:12:04,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-16 09:12:04,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a8b9aa88a2bb6ac5dd1a514be3e1d562/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-16 09:12:04,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b88e7c44108640d81a63d22ee4c2581/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-16 09:12:04,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:12:04,116 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722554.a8b9aa88a2bb6ac5dd1a514be3e1d562. 2023-07-16 09:12:04,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a8b9aa88a2bb6ac5dd1a514be3e1d562: 2023-07-16 09:12:04,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:12:04,118 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498722554.5b88e7c44108640d81a63d22ee4c2581. 2023-07-16 09:12:04,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5b88e7c44108640d81a63d22ee4c2581: 2023-07-16 09:12:04,119 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a8b9aa88a2bb6ac5dd1a514be3e1d562 2023-07-16 09:12:04,120 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=a8b9aa88a2bb6ac5dd1a514be3e1d562, regionState=CLOSED 2023-07-16 09:12:04,120 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722554.a8b9aa88a2bb6ac5dd1a514be3e1d562.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689498724120"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498724120"}]},"ts":"1689498724120"} 2023-07-16 09:12:04,120 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5b88e7c44108640d81a63d22ee4c2581 2023-07-16 09:12:04,120 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=5b88e7c44108640d81a63d22ee4c2581, regionState=CLOSED 2023-07-16 09:12:04,121 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498722554.5b88e7c44108640d81a63d22ee4c2581.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689498724120"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498724120"}]},"ts":"1689498724120"} 2023-07-16 09:12:04,124 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-16 09:12:04,124 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure a8b9aa88a2bb6ac5dd1a514be3e1d562, server=jenkins-hbase4.apache.org,45805,1689498639118 in 334 msec 2023-07-16 09:12:04,125 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-16 09:12:04,125 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 5b88e7c44108640d81a63d22ee4c2581, server=jenkins-hbase4.apache.org,37709,1689498639179 in 337 msec 2023-07-16 09:12:04,126 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a8b9aa88a2bb6ac5dd1a514be3e1d562, UNASSIGN in 347 msec 2023-07-16 09:12:04,127 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-16 09:12:04,127 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5b88e7c44108640d81a63d22ee4c2581, UNASSIGN in 345 msec 2023-07-16 09:12:04,221 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e65bfac9bb334e985398fef6fb6b8992/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-16 09:12:04,224 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722554.a8b9aa88a2bb6ac5dd1a514be3e1d562.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-16 09:12:04,224 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689498722554.5b88e7c44108640d81a63d22ee4c2581.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-16 09:12:04,224 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722555.e65bfac9bb334e985398fef6fb6b8992.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-16 09:12:04,280 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e65bfac9bb334e985398fef6fb6b8992, ASSIGN}] 2023-07-16 09:12:04,281 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e65bfac9bb334e985398fef6fb6b8992, ASSIGN 2023-07-16 09:12:04,282 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e65bfac9bb334e985398fef6fb6b8992, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,45805,1689498639118; forceNewPlan=false, retain=false 2023-07-16 09:12:04,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-16 09:12:04,432 INFO [jenkins-hbase4:46005] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-16 09:12:04,434 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=e65bfac9bb334e985398fef6fb6b8992, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:04,435 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722555.e65bfac9bb334e985398fef6fb6b8992.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689498724434"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498724434"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498724434"}]},"ts":"1689498724434"} 2023-07-16 09:12:04,436 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure e65bfac9bb334e985398fef6fb6b8992, server=jenkins-hbase4.apache.org,45805,1689498639118}] 2023-07-16 09:12:04,592 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722555.e65bfac9bb334e985398fef6fb6b8992. 2023-07-16 09:12:04,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e65bfac9bb334e985398fef6fb6b8992, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722555.e65bfac9bb334e985398fef6fb6b8992.', STARTKEY => '', ENDKEY => ''} 2023-07-16 09:12:04,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722555.e65bfac9bb334e985398fef6fb6b8992. service=AccessControlService 2023-07-16 09:12:04,593 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:12:04,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 e65bfac9bb334e985398fef6fb6b8992 2023-07-16 09:12:04,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722555.e65bfac9bb334e985398fef6fb6b8992.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:12:04,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e65bfac9bb334e985398fef6fb6b8992 2023-07-16 09:12:04,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e65bfac9bb334e985398fef6fb6b8992 2023-07-16 09:12:04,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e65bfac9bb334e985398fef6fb6b8992/.regioninfo 2023-07-16 09:12:04,675 INFO [StoreOpener-e65bfac9bb334e985398fef6fb6b8992-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e65bfac9bb334e985398fef6fb6b8992 2023-07-16 09:12:04,677 DEBUG [StoreOpener-e65bfac9bb334e985398fef6fb6b8992-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e65bfac9bb334e985398fef6fb6b8992/cf 2023-07-16 09:12:04,677 DEBUG [StoreOpener-e65bfac9bb334e985398fef6fb6b8992-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e65bfac9bb334e985398fef6fb6b8992/cf 2023-07-16 09:12:04,678 INFO [StoreOpener-e65bfac9bb334e985398fef6fb6b8992-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e65bfac9bb334e985398fef6fb6b8992 columnFamilyName cf 2023-07-16 09:12:04,715 DEBUG [StoreOpener-e65bfac9bb334e985398fef6fb6b8992-1] regionserver.HStore(539): loaded hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e65bfac9bb334e985398fef6fb6b8992/cf/145c83ac23c54bed96ed8b2ecc4316ab.a8b9aa88a2bb6ac5dd1a514be3e1d562->hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a8b9aa88a2bb6ac5dd1a514be3e1d562/cf/145c83ac23c54bed96ed8b2ecc4316ab-top 2023-07-16 09:12:04,732 DEBUG [StoreOpener-e65bfac9bb334e985398fef6fb6b8992-1] regionserver.HStore(539): loaded hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e65bfac9bb334e985398fef6fb6b8992/cf/fb40f90a852b43e98b871b23e0860552.5b88e7c44108640d81a63d22ee4c2581->hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b88e7c44108640d81a63d22ee4c2581/cf/fb40f90a852b43e98b871b23e0860552-top 2023-07-16 09:12:04,733 INFO [StoreOpener-e65bfac9bb334e985398fef6fb6b8992-1] regionserver.HStore(310): Store=e65bfac9bb334e985398fef6fb6b8992/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:12:04,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e65bfac9bb334e985398fef6fb6b8992 2023-07-16 09:12:04,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e65bfac9bb334e985398fef6fb6b8992 2023-07-16 09:12:04,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e65bfac9bb334e985398fef6fb6b8992 2023-07-16 09:12:04,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e65bfac9bb334e985398fef6fb6b8992; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60616623, jitterRate=-0.0967419296503067}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 09:12:04,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e65bfac9bb334e985398fef6fb6b8992: 2023-07-16 09:12:04,747 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722555.e65bfac9bb334e985398fef6fb6b8992., pid=77, masterSystemTime=1689498724588 2023-07-16 09:12:04,747 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722555.e65bfac9bb334e985398fef6fb6b8992.,because compaction is disabled. 2023-07-16 09:12:04,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722555.e65bfac9bb334e985398fef6fb6b8992. 2023-07-16 09:12:04,750 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722555.e65bfac9bb334e985398fef6fb6b8992. 2023-07-16 09:12:04,750 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=e65bfac9bb334e985398fef6fb6b8992, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:04,750 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722555.e65bfac9bb334e985398fef6fb6b8992.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689498724750"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689498724750"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689498724750"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689498724750"}]},"ts":"1689498724750"} 2023-07-16 09:12:04,755 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-16 09:12:04,755 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure e65bfac9bb334e985398fef6fb6b8992, server=jenkins-hbase4.apache.org,45805,1689498639118 in 316 msec 2023-07-16 09:12:04,758 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-16 09:12:04,758 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e65bfac9bb334e985398fef6fb6b8992, ASSIGN in 475 msec 2023-07-16 09:12:04,759 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a8b9aa88a2bb6ac5dd1a514be3e1d562, 5b88e7c44108640d81a63d22ee4c2581], force=true in 1.0140 sec 2023-07-16 09:12:04,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-16 09:12:04,868 INFO [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-16 09:12:04,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-16 09:12:04,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689498724869 (current time:1689498724869). 2023-07-16 09:12:04,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 09:12:04,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(139): Connect 0x4f57a7d3 to 127.0.0.1:64380 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:12:04,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59d0f030, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:12:04,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:12:04,891 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41836, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:12:04,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f57a7d3 to 127.0.0.1:64380 2023-07-16 09:12:04,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:12:04,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(139): Connect 0x130ba1ba to 127.0.0.1:64380 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:12:04,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6190f537, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:12:04,933 DEBUG [hconnection-0x3f1fc845-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:12:04,937 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41840, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:12:04,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:12:04,946 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60706, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:12:04,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x130ba1ba to 127.0.0.1:64380 2023-07-16 09:12:04,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:12:04,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-16 09:12:04,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 09:12:04,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-16 09:12:04,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-16 09:12:04,952 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-16 09:12:04,953 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689499324953 2023-07-16 09:12:04,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-16 09:12:04,953 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:04,957 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 09:12:04,957 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 09:12:04,959 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-16 09:12:04,960 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-16 09:12:04,963 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 10 msec 2023-07-16 09:12:04,964 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-16 09:12:04,964 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689499324964 2023-07-16 09:12:05,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,002 INFO [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-16 09:12:05,003 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:05,009 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-16 09:12:05,010 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-16 09:12:05,011 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,011 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,012 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:05,012 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:05,013 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:05,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:05,013 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:05,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:05,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:05,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:05,013 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:05,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,014 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 09:12:05,014 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,014 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-16 09:12:05,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-16 09:12:05,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,015 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-16 09:12:05,015 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-16 09:12:05,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:05,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:05,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,016 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-16 09:12:05,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,017 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-16 09:12:05,018 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,019 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-16 09:12:05,019 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:05,019 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,019 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,044 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-16 09:12:05,044 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-16 09:12:05,044 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-16 09:12:05,044 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-16 09:12:05,044 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:05,044 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45805,1689498639118' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-16 09:12:05,044 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:05,047 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-16 09:12:05,047 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-16 09:12:05,047 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-16 09:12:05,047 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-16 09:12:05,047 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37709,1689498639179' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-16 09:12:05,047 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45437,1689498639234' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-16 09:12:05,049 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,050 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:05,050 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:05,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:05,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:05,051 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,051 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:12:05,051 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,051 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:12:05,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:05,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:05,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:05,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:05,057 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:12:05,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:05,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-16 09:12:05,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:12:05,059 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45805,1689498639118' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-16 09:12:05,059 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,059 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-16 09:12:05,059 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,059 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4744af92[Count = 0] remaining members to acquire global barrier 2023-07-16 09:12:05,059 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 09:12:05,060 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,060 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:12:05,060 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,061 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,061 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,061 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-16 09:12:05,061 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-16 09:12:05,061 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-16 09:12:05,061 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-16 09:12:05,061 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:05,061 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-16 09:12:05,061 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 09:12:05,061 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,37709,1689498639179' in zk 2023-07-16 09:12:05,061 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,45437,1689498639234' in zk 2023-07-16 09:12:05,062 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:12:05,062 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:12:05,063 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722555.e65bfac9bb334e985398fef6fb6b8992. 2023-07-16 09:12:05,063 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722555.e65bfac9bb334e985398fef6fb6b8992. started... 2023-07-16 09:12:05,065 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e65bfac9bb334e985398fef6fb6b8992: 2023-07-16 09:12:05,065 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-16 09:12:05,065 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:05,065 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-16 09:12:05,065 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722555.e65bfac9bb334e985398fef6fb6b8992.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,067 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-16 09:12:05,067 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:05,067 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:12:05,067 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-16 09:12:05,071 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e65bfac9bb334e985398fef6fb6b8992/cf/145c83ac23c54bed96ed8b2ecc4316ab.a8b9aa88a2bb6ac5dd1a514be3e1d562->hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a8b9aa88a2bb6ac5dd1a514be3e1d562/cf/145c83ac23c54bed96ed8b2ecc4316ab-top, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e65bfac9bb334e985398fef6fb6b8992/cf/fb40f90a852b43e98b871b23e0860552.5b88e7c44108640d81a63d22ee4c2581->hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b88e7c44108640d81a63d22ee4c2581/cf/fb40f90a852b43e98b871b23e0860552-top] hfiles 2023-07-16 09:12:05,071 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e65bfac9bb334e985398fef6fb6b8992/cf/145c83ac23c54bed96ed8b2ecc4316ab.a8b9aa88a2bb6ac5dd1a514be3e1d562 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,072 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e65bfac9bb334e985398fef6fb6b8992/cf/fb40f90a852b43e98b871b23e0860552.5b88e7c44108640d81a63d22ee4c2581 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,087 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722555.e65bfac9bb334e985398fef6fb6b8992. completed. 2023-07-16 09:12:05,087 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722555.e65bfac9bb334e985398fef6fb6b8992. 2023-07-16 09:12:05,087 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:12:05,087 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:12:05,087 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:05,087 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-16 09:12:05,087 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,45805,1689498639118' in zk 2023-07-16 09:12:05,096 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:05,096 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-16 09:12:05,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:05,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:05,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:05,096 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:05,096 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-16 09:12:05,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:05,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:05,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:05,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:05,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:05,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:05,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:05,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:05,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:05,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,45805,1689498639118': 2023-07-16 09:12:05,102 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45805,1689498639118' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-16 09:12:05,102 INFO [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-16 09:12:05,102 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 09:12:05,102 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 09:12:05,102 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,102 INFO [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 09:12:05,104 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,104 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:05,105 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,104 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:05,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:05,104 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,107 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:05,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,107 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:05,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:05,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:05,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:05,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:05,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:05,111 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:05,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:05,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:05,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,112 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:05,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:05,112 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:05,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:05,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:05,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:05,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:05,116 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:05,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,116 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:05,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:05,117 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:05,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:05,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:05,121 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:05,121 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,121 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:05,121 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:05,121 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:05,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:05,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:05,121 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:05,121 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,121 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:05,121 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:05,121 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:05,122 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:05,122 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:05,122 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:05,122 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 because node does not exist (not an error) 2023-07-16 09:12:05,122 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:05,122 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:05,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:05,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:05,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:05,122 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:05,123 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,122 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:05,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:05,123 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,124 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,124 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:05,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:05,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:05,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:05,220 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,260 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:12:05,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-16 09:12:05,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:12:05,261 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 09:12:05,310 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-16 09:12:05,310 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,311 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,311 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689498724953Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689498725123 (+170 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689498725123Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689498725130 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689498725196 (+66 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689498725310 (+114 ms) 2023-07-16 09:12:05,314 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-16 09:12:05,316 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 357 msec 2023-07-16 09:12:05,561 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:12:05,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-16 09:12:05,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 09:12:05,563 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498725563 2023-07-16 09:12:05,563 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43477, tgtDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498725563, rawTgtDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498725563, srcFsUri=hdfs://localhost:43477, srcDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae 2023-07-16 09:12:05,584 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43477, inputRoot=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae 2023-07-16 09:12:05,584 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1808908919_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498725563, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498725563/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,584 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43477, inputRoot=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae, snapshotDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-16 09:12:05,593 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498725563/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:05,614 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:05,615 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:05,615 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:05,615 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:05,616 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:05,616 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:05,616 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:05,686 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/hadoop-609442330025717407.jar 2023-07-16 09:12:05,686 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:05,687 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:05,687 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:05,687 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:05,688 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:05,688 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:05,688 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 09:12:05,689 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 09:12:05,689 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 09:12:05,690 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 09:12:05,690 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 09:12:05,690 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 09:12:05,691 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 09:12:05,691 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 09:12:05,692 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 09:12:05,693 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 09:12:05,693 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:12:05,694 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:12:05,694 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 09:12:05,695 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:12:05,695 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:12:05,696 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 09:12:05,696 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 09:12:07,131 WARN [Listener at jenkins-hbase4.apache.org/33381] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 09:12:07,135 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-16 09:12:07,137 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-16 09:12:07,258 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 09:12:07,258 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 09:12:07,580 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647086_0005_000001 (auth:SIMPLE) 2023-07-16 09:12:08,552 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 09:12:13,868 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647086_0005_000001 (auth:SIMPLE) 2023-07-16 09:12:16,230 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647086_0005_000001 (auth:SIMPLE) 2023-07-16 09:12:20,819 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647086_0005_000001 (auth:SIMPLE) 2023-07-16 09:12:22,447 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 09:12:22,459 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 09:12:22,470 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:22,471 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 09:12:22,471 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 09:12:22,471 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_583604367_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:22,472 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(367): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-16 09:12:22,472 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(367): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-16 09:12:22,472 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_583604367_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498725563/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498725563/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:22,475 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(367): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498725563/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-16 09:12:22,475 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(367): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498725563/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-16 09:12:22,482 INFO [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:22,482 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:22,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:22,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-16 09:12:22,488 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498742488"}]},"ts":"1689498742488"} 2023-07-16 09:12:22,490 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-16 09:12:22,492 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-16 09:12:22,493 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e65bfac9bb334e985398fef6fb6b8992, UNASSIGN}] 2023-07-16 09:12:22,496 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e65bfac9bb334e985398fef6fb6b8992, UNASSIGN 2023-07-16 09:12:22,496 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=e65bfac9bb334e985398fef6fb6b8992, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:22,496 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722555.e65bfac9bb334e985398fef6fb6b8992.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689498742496"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498742496"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498742496"}]},"ts":"1689498742496"} 2023-07-16 09:12:22,498 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure e65bfac9bb334e985398fef6fb6b8992, server=jenkins-hbase4.apache.org,45805,1689498639118}] 2023-07-16 09:12:22,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-16 09:12:22,651 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e65bfac9bb334e985398fef6fb6b8992 2023-07-16 09:12:22,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e65bfac9bb334e985398fef6fb6b8992, disabling compactions & flushes 2023-07-16 09:12:22,652 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722555.e65bfac9bb334e985398fef6fb6b8992. 2023-07-16 09:12:22,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722555.e65bfac9bb334e985398fef6fb6b8992. 2023-07-16 09:12:22,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722555.e65bfac9bb334e985398fef6fb6b8992. after waiting 0 ms 2023-07-16 09:12:22,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722555.e65bfac9bb334e985398fef6fb6b8992. 2023-07-16 09:12:22,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e65bfac9bb334e985398fef6fb6b8992/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-16 09:12:22,689 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:12:22,696 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722555.e65bfac9bb334e985398fef6fb6b8992. 2023-07-16 09:12:22,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e65bfac9bb334e985398fef6fb6b8992: 2023-07-16 09:12:22,704 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e65bfac9bb334e985398fef6fb6b8992 2023-07-16 09:12:22,706 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=e65bfac9bb334e985398fef6fb6b8992, regionState=CLOSED 2023-07-16 09:12:22,706 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722555.e65bfac9bb334e985398fef6fb6b8992.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689498742706"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498742706"}]},"ts":"1689498742706"} 2023-07-16 09:12:22,711 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-16 09:12:22,711 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure e65bfac9bb334e985398fef6fb6b8992, server=jenkins-hbase4.apache.org,45805,1689498639118 in 210 msec 2023-07-16 09:12:22,713 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-16 09:12:22,713 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e65bfac9bb334e985398fef6fb6b8992, UNASSIGN in 218 msec 2023-07-16 09:12:22,714 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498742714"}]},"ts":"1689498742714"} 2023-07-16 09:12:22,716 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-16 09:12:22,720 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-16 09:12:22,722 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 238 msec 2023-07-16 09:12:22,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-16 09:12:22,791 INFO [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-16 09:12:22,792 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:22,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:22,796 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:22,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:22,797 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:22,799 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37709] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:22,802 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:22,802 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:22,802 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:22,802 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:22,802 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-16 09:12:22,803 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-16 09:12:22,805 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:22,805 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:22,805 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:22,805 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:22,805 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:22,806 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:22,806 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-16 09:12:22,806 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 09:12:22,806 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-16 09:12:22,806 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 09:12:22,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-16 09:12:22,807 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 09:12:22,810 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 09:12:22,810 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 09:12:22,810 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-16 09:12:22,820 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e65bfac9bb334e985398fef6fb6b8992 2023-07-16 09:12:22,820 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b88e7c44108640d81a63d22ee4c2581 2023-07-16 09:12:22,820 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a8b9aa88a2bb6ac5dd1a514be3e1d562 2023-07-16 09:12:22,823 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b88e7c44108640d81a63d22ee4c2581/cf, FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b88e7c44108640d81a63d22ee4c2581/recovered.edits] 2023-07-16 09:12:22,824 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e65bfac9bb334e985398fef6fb6b8992/cf, FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e65bfac9bb334e985398fef6fb6b8992/recovered.edits] 2023-07-16 09:12:22,824 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a8b9aa88a2bb6ac5dd1a514be3e1d562/cf, FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a8b9aa88a2bb6ac5dd1a514be3e1d562/recovered.edits] 2023-07-16 09:12:22,831 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b88e7c44108640d81a63d22ee4c2581/cf/fb40f90a852b43e98b871b23e0860552 to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b88e7c44108640d81a63d22ee4c2581/cf/fb40f90a852b43e98b871b23e0860552 2023-07-16 09:12:22,832 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a8b9aa88a2bb6ac5dd1a514be3e1d562/cf/145c83ac23c54bed96ed8b2ecc4316ab to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a8b9aa88a2bb6ac5dd1a514be3e1d562/cf/145c83ac23c54bed96ed8b2ecc4316ab 2023-07-16 09:12:22,832 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e65bfac9bb334e985398fef6fb6b8992/cf/145c83ac23c54bed96ed8b2ecc4316ab.a8b9aa88a2bb6ac5dd1a514be3e1d562 to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e65bfac9bb334e985398fef6fb6b8992/cf/145c83ac23c54bed96ed8b2ecc4316ab.a8b9aa88a2bb6ac5dd1a514be3e1d562 2023-07-16 09:12:22,835 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e65bfac9bb334e985398fef6fb6b8992/cf/fb40f90a852b43e98b871b23e0860552.5b88e7c44108640d81a63d22ee4c2581 to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e65bfac9bb334e985398fef6fb6b8992/cf/fb40f90a852b43e98b871b23e0860552.5b88e7c44108640d81a63d22ee4c2581 2023-07-16 09:12:22,839 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b88e7c44108640d81a63d22ee4c2581/recovered.edits/8.seqid to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b88e7c44108640d81a63d22ee4c2581/recovered.edits/8.seqid 2023-07-16 09:12:22,847 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a8b9aa88a2bb6ac5dd1a514be3e1d562/recovered.edits/8.seqid to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a8b9aa88a2bb6ac5dd1a514be3e1d562/recovered.edits/8.seqid 2023-07-16 09:12:22,847 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b88e7c44108640d81a63d22ee4c2581 2023-07-16 09:12:22,862 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a8b9aa88a2bb6ac5dd1a514be3e1d562 2023-07-16 09:12:22,868 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e65bfac9bb334e985398fef6fb6b8992/recovered.edits/12.seqid to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e65bfac9bb334e985398fef6fb6b8992/recovered.edits/12.seqid 2023-07-16 09:12:22,869 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e65bfac9bb334e985398fef6fb6b8992 2023-07-16 09:12:22,869 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-16 09:12:22,871 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:22,882 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-16 09:12:22,885 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-16 09:12:22,887 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:22,887 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-16 09:12:22,887 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722555.e65bfac9bb334e985398fef6fb6b8992.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689498742887"}]},"ts":"9223372036854775807"} 2023-07-16 09:12:22,895 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-16 09:12:22,895 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e65bfac9bb334e985398fef6fb6b8992, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689498722555.e65bfac9bb334e985398fef6fb6b8992.', STARTKEY => '', ENDKEY => ''}] 2023-07-16 09:12:22,895 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-16 09:12:22,896 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689498742895"}]},"ts":"9223372036854775807"} 2023-07-16 09:12:22,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-16 09:12:22,912 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-16 09:12:22,915 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:22,917 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 123 msec 2023-07-16 09:12:23,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-16 09:12:23,111 INFO [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-16 09:12:23,113 INFO [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:23,113 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:23,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:23,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-16 09:12:23,120 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498743119"}]},"ts":"1689498743119"} 2023-07-16 09:12:23,121 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-16 09:12:23,123 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-16 09:12:23,124 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=73cb92f4243ac87f0616f4d734709f0b, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b83872bd0bc99ab54da8c5b12b2a9067, UNASSIGN}] 2023-07-16 09:12:23,127 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=73cb92f4243ac87f0616f4d734709f0b, UNASSIGN 2023-07-16 09:12:23,127 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b83872bd0bc99ab54da8c5b12b2a9067, UNASSIGN 2023-07-16 09:12:23,128 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=b83872bd0bc99ab54da8c5b12b2a9067, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:23,128 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=73cb92f4243ac87f0616f4d734709f0b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:23,129 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689498718337.b83872bd0bc99ab54da8c5b12b2a9067.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689498743128"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498743128"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498743128"}]},"ts":"1689498743128"} 2023-07-16 09:12:23,129 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689498718337.73cb92f4243ac87f0616f4d734709f0b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689498743128"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498743128"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498743128"}]},"ts":"1689498743128"} 2023-07-16 09:12:23,131 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure b83872bd0bc99ab54da8c5b12b2a9067, server=jenkins-hbase4.apache.org,45437,1689498639234}] 2023-07-16 09:12:23,132 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure 73cb92f4243ac87f0616f4d734709f0b, server=jenkins-hbase4.apache.org,37709,1689498639179}] 2023-07-16 09:12:23,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-16 09:12:23,284 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b83872bd0bc99ab54da8c5b12b2a9067 2023-07-16 09:12:23,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b83872bd0bc99ab54da8c5b12b2a9067, disabling compactions & flushes 2023-07-16 09:12:23,285 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689498718337.b83872bd0bc99ab54da8c5b12b2a9067. 2023-07-16 09:12:23,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689498718337.b83872bd0bc99ab54da8c5b12b2a9067. 2023-07-16 09:12:23,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689498718337.b83872bd0bc99ab54da8c5b12b2a9067. after waiting 0 ms 2023-07-16 09:12:23,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689498718337.b83872bd0bc99ab54da8c5b12b2a9067. 2023-07-16 09:12:23,288 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 73cb92f4243ac87f0616f4d734709f0b 2023-07-16 09:12:23,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 73cb92f4243ac87f0616f4d734709f0b, disabling compactions & flushes 2023-07-16 09:12:23,290 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689498718337.73cb92f4243ac87f0616f4d734709f0b. 2023-07-16 09:12:23,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689498718337.73cb92f4243ac87f0616f4d734709f0b. 2023-07-16 09:12:23,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689498718337.73cb92f4243ac87f0616f4d734709f0b. after waiting 0 ms 2023-07-16 09:12:23,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689498718337.73cb92f4243ac87f0616f4d734709f0b. 2023-07-16 09:12:23,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion/b83872bd0bc99ab54da8c5b12b2a9067/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 09:12:23,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithMergeRegion/73cb92f4243ac87f0616f4d734709f0b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 09:12:23,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:12:23,305 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689498718337.b83872bd0bc99ab54da8c5b12b2a9067. 2023-07-16 09:12:23,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b83872bd0bc99ab54da8c5b12b2a9067: 2023-07-16 09:12:23,306 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:12:23,307 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689498718337.73cb92f4243ac87f0616f4d734709f0b. 2023-07-16 09:12:23,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 73cb92f4243ac87f0616f4d734709f0b: 2023-07-16 09:12:23,308 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b83872bd0bc99ab54da8c5b12b2a9067 2023-07-16 09:12:23,309 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=b83872bd0bc99ab54da8c5b12b2a9067, regionState=CLOSED 2023-07-16 09:12:23,309 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689498718337.b83872bd0bc99ab54da8c5b12b2a9067.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689498743309"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498743309"}]},"ts":"1689498743309"} 2023-07-16 09:12:23,309 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 73cb92f4243ac87f0616f4d734709f0b 2023-07-16 09:12:23,309 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=73cb92f4243ac87f0616f4d734709f0b, regionState=CLOSED 2023-07-16 09:12:23,310 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689498718337.73cb92f4243ac87f0616f4d734709f0b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689498743309"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498743309"}]},"ts":"1689498743309"} 2023-07-16 09:12:23,313 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-16 09:12:23,313 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure b83872bd0bc99ab54da8c5b12b2a9067, server=jenkins-hbase4.apache.org,45437,1689498639234 in 179 msec 2023-07-16 09:12:23,314 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-16 09:12:23,314 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure 73cb92f4243ac87f0616f4d734709f0b, server=jenkins-hbase4.apache.org,37709,1689498639179 in 179 msec 2023-07-16 09:12:23,314 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b83872bd0bc99ab54da8c5b12b2a9067, UNASSIGN in 189 msec 2023-07-16 09:12:23,316 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-16 09:12:23,316 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=73cb92f4243ac87f0616f4d734709f0b, UNASSIGN in 190 msec 2023-07-16 09:12:23,317 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498743316"}]},"ts":"1689498743316"} 2023-07-16 09:12:23,318 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-16 09:12:23,320 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-16 09:12:23,322 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 208 msec 2023-07-16 09:12:23,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-16 09:12:23,421 INFO [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-16 09:12:23,422 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:23,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:23,427 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:23,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:23,428 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:23,430 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37709] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:23,433 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:23,433 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:23,433 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:23,433 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:23,434 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/73cb92f4243ac87f0616f4d734709f0b 2023-07-16 09:12:23,434 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-16 09:12:23,434 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b83872bd0bc99ab54da8c5b12b2a9067 2023-07-16 09:12:23,434 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-16 09:12:23,435 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-16 09:12:23,435 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:23,435 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:23,435 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:23,435 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:23,435 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-16 09:12:23,436 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 09:12:23,436 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:23,436 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:23,436 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:23,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-16 09:12:23,438 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/73cb92f4243ac87f0616f4d734709f0b/cf, FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/73cb92f4243ac87f0616f4d734709f0b/recovered.edits] 2023-07-16 09:12:23,438 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b83872bd0bc99ab54da8c5b12b2a9067/cf, FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b83872bd0bc99ab54da8c5b12b2a9067/recovered.edits] 2023-07-16 09:12:23,445 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b83872bd0bc99ab54da8c5b12b2a9067/cf/972f0988d54b45a8b18ac0d837a9ee56 to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/b83872bd0bc99ab54da8c5b12b2a9067/cf/972f0988d54b45a8b18ac0d837a9ee56 2023-07-16 09:12:23,446 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/73cb92f4243ac87f0616f4d734709f0b/cf/f73528c587964868bf9dbef72b2a7216 to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/73cb92f4243ac87f0616f4d734709f0b/cf/f73528c587964868bf9dbef72b2a7216 2023-07-16 09:12:23,449 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b83872bd0bc99ab54da8c5b12b2a9067/recovered.edits/9.seqid to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/b83872bd0bc99ab54da8c5b12b2a9067/recovered.edits/9.seqid 2023-07-16 09:12:23,450 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b83872bd0bc99ab54da8c5b12b2a9067 2023-07-16 09:12:23,451 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/73cb92f4243ac87f0616f4d734709f0b/recovered.edits/9.seqid to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/73cb92f4243ac87f0616f4d734709f0b/recovered.edits/9.seqid 2023-07-16 09:12:23,453 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/73cb92f4243ac87f0616f4d734709f0b 2023-07-16 09:12:23,453 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-16 09:12:23,454 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-16 09:12:23,455 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-16 09:12:23,460 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307167c01cb7bfc7b4c3aaae99e8792084e3e to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307167c01cb7bfc7b4c3aaae99e8792084e3e 2023-07-16 09:12:23,463 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230716b40bc394d5af42c9b7779fcde7f52074 to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230716b40bc394d5af42c9b7779fcde7f52074 2023-07-16 09:12:23,464 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-16 09:12:23,467 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:23,470 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-16 09:12:23,472 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-16 09:12:23,473 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:23,473 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-16 09:12:23,473 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689498718337.73cb92f4243ac87f0616f4d734709f0b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689498743473"}]},"ts":"9223372036854775807"} 2023-07-16 09:12:23,473 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689498718337.b83872bd0bc99ab54da8c5b12b2a9067.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689498743473"}]},"ts":"9223372036854775807"} 2023-07-16 09:12:23,475 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 09:12:23,475 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 73cb92f4243ac87f0616f4d734709f0b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689498718337.73cb92f4243ac87f0616f4d734709f0b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b83872bd0bc99ab54da8c5b12b2a9067, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689498718337.b83872bd0bc99ab54da8c5b12b2a9067.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 09:12:23,475 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-16 09:12:23,475 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689498743475"}]},"ts":"9223372036854775807"} 2023-07-16 09:12:23,477 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-16 09:12:23,479 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:23,481 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 57 msec 2023-07-16 09:12:23,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-16 09:12:23,538 INFO [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-16 09:12:23,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-16 09:12:23,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:23,556 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-16 09:12:23,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-16 09:12:23,560 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-16 09:12:23,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-16 09:12:23,595 INFO [Listener at jenkins-hbase4.apache.org/33381] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=759 (was 744) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_143194379_1 at /127.0.0.1:54698 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1104155582) connection to jenkins-hbase4.apache.org/172.31.14.131:42909 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1104155582) connection to jenkins-hbase4.apache.org/172.31.14.131:33381 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_583604367_17 at /127.0.0.1:54722 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_583604367_17 at /127.0.0.1:48388 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x404319e1-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3992 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x404319e1-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x404319e1-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_143194379_1 at /127.0.0.1:51668 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_583604367_17 at /127.0.0.1:51708 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x404319e1-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x404319e1-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x404319e1-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=921 (was 899) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=719 (was 512) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 179) - ProcessCount LEAK? -, AvailableMemoryMB=2700 (was 3375) 2023-07-16 09:12:23,595 WARN [Listener at jenkins-hbase4.apache.org/33381] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-16 09:12:23,617 INFO [Listener at jenkins-hbase4.apache.org/33381] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=759, OpenFileDescriptor=921, MaxFileDescriptor=60000, SystemLoadAverage=719, ProcessCount=180, AvailableMemoryMB=2693 2023-07-16 09:12:23,618 WARN [Listener at jenkins-hbase4.apache.org/33381] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-16 09:12:23,620 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-16 09:12:23,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 09:12:23,623 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 09:12:23,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-16 09:12:23,624 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 09:12:23,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-16 09:12:23,626 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testEmptyExportFileSystemState/6d7b51394745622e8e0327780db1b37d 2023-07-16 09:12:23,626 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc4a786bd1b80161c7134ae38206c028 2023-07-16 09:12:23,627 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc4a786bd1b80161c7134ae38206c028 empty. 2023-07-16 09:12:23,627 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testEmptyExportFileSystemState/6d7b51394745622e8e0327780db1b37d empty. 2023-07-16 09:12:23,627 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc4a786bd1b80161c7134ae38206c028 2023-07-16 09:12:23,627 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testEmptyExportFileSystemState/6d7b51394745622e8e0327780db1b37d 2023-07-16 09:12:23,628 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-16 09:12:23,639 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-16 09:12:23,641 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6d7b51394745622e8e0327780db1b37d, NAME => 'testtb-testEmptyExportFileSystemState,,1689498743619.6d7b51394745622e8e0327780db1b37d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp 2023-07-16 09:12:23,641 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => cc4a786bd1b80161c7134ae38206c028, NAME => 'testtb-testEmptyExportFileSystemState,1,1689498743619.cc4a786bd1b80161c7134ae38206c028.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp 2023-07-16 09:12:23,681 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689498743619.cc4a786bd1b80161c7134ae38206c028.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:12:23,681 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing cc4a786bd1b80161c7134ae38206c028, disabling compactions & flushes 2023-07-16 09:12:23,681 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689498743619.cc4a786bd1b80161c7134ae38206c028. 2023-07-16 09:12:23,681 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689498743619.cc4a786bd1b80161c7134ae38206c028. 2023-07-16 09:12:23,681 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689498743619.cc4a786bd1b80161c7134ae38206c028. after waiting 0 ms 2023-07-16 09:12:23,681 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689498743619.cc4a786bd1b80161c7134ae38206c028. 2023-07-16 09:12:23,681 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689498743619.cc4a786bd1b80161c7134ae38206c028. 2023-07-16 09:12:23,681 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for cc4a786bd1b80161c7134ae38206c028: 2023-07-16 09:12:23,682 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689498743619.6d7b51394745622e8e0327780db1b37d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:12:23,682 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 6d7b51394745622e8e0327780db1b37d, disabling compactions & flushes 2023-07-16 09:12:23,682 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689498743619.6d7b51394745622e8e0327780db1b37d. 2023-07-16 09:12:23,682 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689498743619.6d7b51394745622e8e0327780db1b37d. 2023-07-16 09:12:23,682 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689498743619.6d7b51394745622e8e0327780db1b37d. after waiting 0 ms 2023-07-16 09:12:23,682 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689498743619.6d7b51394745622e8e0327780db1b37d. 2023-07-16 09:12:23,682 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689498743619.6d7b51394745622e8e0327780db1b37d. 2023-07-16 09:12:23,682 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 6d7b51394745622e8e0327780db1b37d: 2023-07-16 09:12:23,684 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 09:12:23,685 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689498743619.cc4a786bd1b80161c7134ae38206c028.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689498743685"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498743685"}]},"ts":"1689498743685"} 2023-07-16 09:12:23,685 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689498743619.6d7b51394745622e8e0327780db1b37d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689498743685"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498743685"}]},"ts":"1689498743685"} 2023-07-16 09:12:23,687 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 09:12:23,688 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 09:12:23,688 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498743688"}]},"ts":"1689498743688"} 2023-07-16 09:12:23,690 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-16 09:12:23,698 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 09:12:23,699 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 09:12:23,699 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 09:12:23,699 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 09:12:23,700 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 09:12:23,700 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6d7b51394745622e8e0327780db1b37d, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cc4a786bd1b80161c7134ae38206c028, ASSIGN}] 2023-07-16 09:12:23,704 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cc4a786bd1b80161c7134ae38206c028, ASSIGN 2023-07-16 09:12:23,704 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6d7b51394745622e8e0327780db1b37d, ASSIGN 2023-07-16 09:12:23,709 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cc4a786bd1b80161c7134ae38206c028, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45437,1689498639234; forceNewPlan=false, retain=false 2023-07-16 09:12:23,709 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6d7b51394745622e8e0327780db1b37d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45805,1689498639118; forceNewPlan=false, retain=false 2023-07-16 09:12:23,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-16 09:12:23,859 INFO [jenkins-hbase4:46005] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 09:12:23,862 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=6d7b51394745622e8e0327780db1b37d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:23,862 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=cc4a786bd1b80161c7134ae38206c028, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:23,862 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689498743619.6d7b51394745622e8e0327780db1b37d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689498743862"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498743862"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498743862"}]},"ts":"1689498743862"} 2023-07-16 09:12:23,862 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689498743619.cc4a786bd1b80161c7134ae38206c028.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689498743862"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498743862"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498743862"}]},"ts":"1689498743862"} 2023-07-16 09:12:23,864 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 6d7b51394745622e8e0327780db1b37d, server=jenkins-hbase4.apache.org,45805,1689498639118}] 2023-07-16 09:12:23,867 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure cc4a786bd1b80161c7134ae38206c028, server=jenkins-hbase4.apache.org,45437,1689498639234}] 2023-07-16 09:12:23,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-16 09:12:24,022 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689498743619.6d7b51394745622e8e0327780db1b37d. 2023-07-16 09:12:24,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6d7b51394745622e8e0327780db1b37d, NAME => 'testtb-testEmptyExportFileSystemState,,1689498743619.6d7b51394745622e8e0327780db1b37d.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 09:12:24,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689498743619.6d7b51394745622e8e0327780db1b37d. service=AccessControlService 2023-07-16 09:12:24,023 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:12:24,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 6d7b51394745622e8e0327780db1b37d 2023-07-16 09:12:24,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689498743619.6d7b51394745622e8e0327780db1b37d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:12:24,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6d7b51394745622e8e0327780db1b37d 2023-07-16 09:12:24,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6d7b51394745622e8e0327780db1b37d 2023-07-16 09:12:24,028 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689498743619.cc4a786bd1b80161c7134ae38206c028. 2023-07-16 09:12:24,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cc4a786bd1b80161c7134ae38206c028, NAME => 'testtb-testEmptyExportFileSystemState,1,1689498743619.cc4a786bd1b80161c7134ae38206c028.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 09:12:24,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689498743619.cc4a786bd1b80161c7134ae38206c028. service=AccessControlService 2023-07-16 09:12:24,029 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:12:24,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState cc4a786bd1b80161c7134ae38206c028 2023-07-16 09:12:24,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689498743619.cc4a786bd1b80161c7134ae38206c028.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:12:24,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cc4a786bd1b80161c7134ae38206c028 2023-07-16 09:12:24,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cc4a786bd1b80161c7134ae38206c028 2023-07-16 09:12:24,039 INFO [StoreOpener-6d7b51394745622e8e0327780db1b37d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6d7b51394745622e8e0327780db1b37d 2023-07-16 09:12:24,041 DEBUG [StoreOpener-6d7b51394745622e8e0327780db1b37d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testEmptyExportFileSystemState/6d7b51394745622e8e0327780db1b37d/cf 2023-07-16 09:12:24,041 DEBUG [StoreOpener-6d7b51394745622e8e0327780db1b37d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testEmptyExportFileSystemState/6d7b51394745622e8e0327780db1b37d/cf 2023-07-16 09:12:24,042 INFO [StoreOpener-6d7b51394745622e8e0327780db1b37d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6d7b51394745622e8e0327780db1b37d columnFamilyName cf 2023-07-16 09:12:24,047 INFO [StoreOpener-6d7b51394745622e8e0327780db1b37d-1] regionserver.HStore(310): Store=6d7b51394745622e8e0327780db1b37d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:12:24,047 INFO [StoreOpener-cc4a786bd1b80161c7134ae38206c028-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cc4a786bd1b80161c7134ae38206c028 2023-07-16 09:12:24,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testEmptyExportFileSystemState/6d7b51394745622e8e0327780db1b37d 2023-07-16 09:12:24,048 DEBUG [StoreOpener-cc4a786bd1b80161c7134ae38206c028-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testEmptyExportFileSystemState/cc4a786bd1b80161c7134ae38206c028/cf 2023-07-16 09:12:24,048 DEBUG [StoreOpener-cc4a786bd1b80161c7134ae38206c028-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testEmptyExportFileSystemState/cc4a786bd1b80161c7134ae38206c028/cf 2023-07-16 09:12:24,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testEmptyExportFileSystemState/6d7b51394745622e8e0327780db1b37d 2023-07-16 09:12:24,049 INFO [StoreOpener-cc4a786bd1b80161c7134ae38206c028-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cc4a786bd1b80161c7134ae38206c028 columnFamilyName cf 2023-07-16 09:12:24,050 INFO [StoreOpener-cc4a786bd1b80161c7134ae38206c028-1] regionserver.HStore(310): Store=cc4a786bd1b80161c7134ae38206c028/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:12:24,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testEmptyExportFileSystemState/cc4a786bd1b80161c7134ae38206c028 2023-07-16 09:12:24,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testEmptyExportFileSystemState/cc4a786bd1b80161c7134ae38206c028 2023-07-16 09:12:24,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6d7b51394745622e8e0327780db1b37d 2023-07-16 09:12:24,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testEmptyExportFileSystemState/6d7b51394745622e8e0327780db1b37d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 09:12:24,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cc4a786bd1b80161c7134ae38206c028 2023-07-16 09:12:24,056 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6d7b51394745622e8e0327780db1b37d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64518084, jitterRate=-0.03860563039779663}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 09:12:24,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6d7b51394745622e8e0327780db1b37d: 2023-07-16 09:12:24,057 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689498743619.6d7b51394745622e8e0327780db1b37d., pid=93, masterSystemTime=1689498744018 2023-07-16 09:12:24,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689498743619.6d7b51394745622e8e0327780db1b37d. 2023-07-16 09:12:24,060 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689498743619.6d7b51394745622e8e0327780db1b37d. 2023-07-16 09:12:24,060 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=6d7b51394745622e8e0327780db1b37d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:24,060 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689498743619.6d7b51394745622e8e0327780db1b37d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689498744060"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689498744060"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689498744060"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689498744060"}]},"ts":"1689498744060"} 2023-07-16 09:12:24,064 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-16 09:12:24,064 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 6d7b51394745622e8e0327780db1b37d, server=jenkins-hbase4.apache.org,45805,1689498639118 in 198 msec 2023-07-16 09:12:24,066 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6d7b51394745622e8e0327780db1b37d, ASSIGN in 365 msec 2023-07-16 09:12:24,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testEmptyExportFileSystemState/cc4a786bd1b80161c7134ae38206c028/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 09:12:24,074 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cc4a786bd1b80161c7134ae38206c028; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62060497, jitterRate=-0.07522653043270111}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 09:12:24,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cc4a786bd1b80161c7134ae38206c028: 2023-07-16 09:12:24,075 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689498743619.cc4a786bd1b80161c7134ae38206c028., pid=94, masterSystemTime=1689498744020 2023-07-16 09:12:24,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689498743619.cc4a786bd1b80161c7134ae38206c028. 2023-07-16 09:12:24,076 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689498743619.cc4a786bd1b80161c7134ae38206c028. 2023-07-16 09:12:24,077 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=cc4a786bd1b80161c7134ae38206c028, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:24,077 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689498743619.cc4a786bd1b80161c7134ae38206c028.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689498744077"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689498744077"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689498744077"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689498744077"}]},"ts":"1689498744077"} 2023-07-16 09:12:24,081 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-16 09:12:24,081 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure cc4a786bd1b80161c7134ae38206c028, server=jenkins-hbase4.apache.org,45437,1689498639234 in 211 msec 2023-07-16 09:12:24,083 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-16 09:12:24,083 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cc4a786bd1b80161c7134ae38206c028, ASSIGN in 381 msec 2023-07-16 09:12:24,084 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 09:12:24,084 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498744084"}]},"ts":"1689498744084"} 2023-07-16 09:12:24,086 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-16 09:12:24,089 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 09:12:24,090 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-16 09:12:24,092 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37709] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 09:12:24,094 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:24,094 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:24,094 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:24,094 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:24,098 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 09:12:24,098 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 09:12:24,098 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 09:12:24,098 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-16 09:12:24,101 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 478 msec 2023-07-16 09:12:24,186 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-16 09:12:24,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-16 09:12:24,230 INFO [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-16 09:12:24,232 DEBUG [Listener at jenkins-hbase4.apache.org/33381] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-16 09:12:24,232 DEBUG [Listener at jenkins-hbase4.apache.org/33381] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689498743619.6d7b51394745622e8e0327780db1b37d. 2023-07-16 09:12:24,234 INFO [Listener at jenkins-hbase4.apache.org/33381] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 09:12:24,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 09:12:24,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689498744269 (current time:1689498744269). 2023-07-16 09:12:24,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 09:12:24,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(139): Connect 0x778ff483 to 127.0.0.1:64380 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:12:24,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3672d0b5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:12:24,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:12:24,297 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49850, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:12:24,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x778ff483 to 127.0.0.1:64380 2023-07-16 09:12:24,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:12:24,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(139): Connect 0x4a86ef89 to 127.0.0.1:64380 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:12:24,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@422521b6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:12:24,316 DEBUG [hconnection-0x62f2b63f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:12:24,320 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49862, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:12:24,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:12:24,330 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57800, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:12:24,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4a86ef89 to 127.0.0.1:64380 2023-07-16 09:12:24,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:12:24,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 09:12:24,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 09:12:24,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 09:12:24,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 09:12:24,339 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 09:12:24,340 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689499344340 2023-07-16 09:12:24,340 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-16 09:12:24,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 09:12:24,343 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 09:12:24,343 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 09:12:24,344 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 09:12:24,346 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 09:12:24,348 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-07-16 09:12:24,353 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 09:12:24,355 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689499344355 2023-07-16 09:12:24,373 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,374 INFO [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-16 09:12:24,374 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:24,377 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-16 09:12:24,377 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-16 09:12:24,378 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,378 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,383 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:24,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:24,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:24,386 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:24,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:24,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:24,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,387 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:24,386 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:24,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:24,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:24,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,388 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,388 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-16 09:12:24,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,389 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,389 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 09:12:24,389 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,390 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 09:12:24,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-16 09:12:24,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,390 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:24,390 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 09:12:24,390 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,415 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 09:12:24,415 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:24,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-16 09:12:24,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,415 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 09:12:24,406 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:24,404 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 09:12:24,415 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:24,416 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 09:12:24,416 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45805,1689498639118' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 09:12:24,416 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:24,416 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 09:12:24,418 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:24,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:24,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:24,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:24,418 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,418 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,418 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:12:24,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:24,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:24,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:24,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:24,421 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45805,1689498639118' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-16 09:12:24,421 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49f21b15[Count = 1] remaining members to acquire global barrier 2023-07-16 09:12:24,431 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,432 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 09:12:24,432 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:24,434 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 09:12:24,434 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 09:12:24,434 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 09:12:24,434 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45437,1689498639234' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 09:12:24,434 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 09:12:24,434 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37709,1689498639179' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 09:12:24,437 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,439 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,439 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:24,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:24,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:24,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:24,439 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,439 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:12:24,439 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,439 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:12:24,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:24,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:24,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:24,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:24,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:24,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:24,442 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45437,1689498639234' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-16 09:12:24,442 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49f21b15[Count = 0] remaining members to acquire global barrier 2023-07-16 09:12:24,442 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-16 09:12:24,442 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,443 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,443 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,443 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,443 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:12:24,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,444 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 09:12:24,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,444 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 09:12:24,444 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:12:24,444 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:24,444 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:12:24,445 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:12:24,445 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689498743619.6d7b51394745622e8e0327780db1b37d. 2023-07-16 09:12:24,444 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:12:24,445 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689498743619.6d7b51394745622e8e0327780db1b37d. started... 2023-07-16 09:12:24,445 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689498743619.cc4a786bd1b80161c7134ae38206c028. 2023-07-16 09:12:24,445 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689498743619.cc4a786bd1b80161c7134ae38206c028. started... 2023-07-16 09:12:24,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,445 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6d7b51394745622e8e0327780db1b37d: 2023-07-16 09:12:24,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 09:12:24,445 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:24,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:12:24,447 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 09:12:24,447 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 09:12:24,447 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cc4a786bd1b80161c7134ae38206c028: 2023-07-16 09:12:24,447 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37709,1689498639179' in zk 2023-07-16 09:12:24,447 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689498743619.6d7b51394745622e8e0327780db1b37d.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,448 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 09:12:24,447 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 09:12:24,448 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:12:24,448 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689498743619.cc4a786bd1b80161c7134ae38206c028.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,448 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 09:12:24,448 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:12:24,448 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 09:12:24,451 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 09:12:24,451 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:24,451 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 09:12:24,469 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689498743619.cc4a786bd1b80161c7134ae38206c028. completed. 2023-07-16 09:12:24,469 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689498743619.cc4a786bd1b80161c7134ae38206c028. 2023-07-16 09:12:24,469 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:12:24,469 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:12:24,469 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:24,469 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 09:12:24,469 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45437,1689498639234' in zk 2023-07-16 09:12:24,471 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689498743619.6d7b51394745622e8e0327780db1b37d. completed. 2023-07-16 09:12:24,471 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689498743619.6d7b51394745622e8e0327780db1b37d. 2023-07-16 09:12:24,471 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:12:24,471 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:12:24,471 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:24,471 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 09:12:24,472 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45805,1689498639118' in zk 2023-07-16 09:12:24,474 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:24,474 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 09:12:24,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:24,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:24,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:24,474 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:24,474 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 09:12:24,476 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 09:12:24,477 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:24,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:24,477 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:24,477 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 09:12:24,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:24,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:24,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:24,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:24,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:24,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:24,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:24,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:24,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45437,1689498639234': 2023-07-16 09:12:24,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45437,1689498639234' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-16 09:12:24,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:24,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:24,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:24,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:24,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:24,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:24,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:24,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:24,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:24,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:24,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:24,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:24,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45805,1689498639118': 2023-07-16 09:12:24,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45805,1689498639118' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-16 09:12:24,489 INFO [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-16 09:12:24,489 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 09:12:24,489 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 09:12:24,489 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,489 INFO [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 09:12:24,491 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,491 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,491 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,491 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:24,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:24,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,491 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:24,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,491 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:24,491 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:24,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:24,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:24,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:24,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:24,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:24,493 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:24,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,493 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:24,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:24,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:24,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,493 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:24,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:24,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:24,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:24,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:24,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:24,495 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:24,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,496 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:24,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:24,496 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:24,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:24,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:24,500 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:24,500 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:24,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:24,500 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,500 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:24,500 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:24,500 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:24,500 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:24,500 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:24,502 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-16 09:12:24,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:24,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:24,502 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:24,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:24,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:24,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:24,500 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:24,500 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:24,503 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,503 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:24,503 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,503 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:24,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:24,502 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:24,502 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:24,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:24,503 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:24,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:24,503 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,503 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 09:12:24,503 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:24,504 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-16 09:12:24,513 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,514 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:24,648 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:12:24,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 09:12:24,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:12:24,650 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 09:12:24,950 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:12:24,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 09:12:24,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:12:24,951 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-16 09:12:24,951 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,000 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-16 09:12:25,000 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,000 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,000 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689498744340Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689498744513 (+173 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689498744513Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689498744513Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689498744521 (+8 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689498744940 (+419 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689498745000 (+60 ms) 2023-07-16 09:12:25,004 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 09:12:25,005 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 662 msec 2023-07-16 09:12:25,451 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:12:25,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 09:12:25,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 09:12:25,460 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45805] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689498743619.6d7b51394745622e8e0327780db1b37d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 09:12:25,461 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45437] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689498743619.cc4a786bd1b80161c7134ae38206c028. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 09:12:25,466 DEBUG [Listener at jenkins-hbase4.apache.org/33381] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-16 09:12:25,466 DEBUG [Listener at jenkins-hbase4.apache.org/33381] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689498743619.6d7b51394745622e8e0327780db1b37d. 2023-07-16 09:12:25,466 INFO [Listener at jenkins-hbase4.apache.org/33381] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 09:12:25,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 09:12:25,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689498745477 (current time:1689498745477). 2023-07-16 09:12:25,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 09:12:25,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(139): Connect 0x43fde690 to 127.0.0.1:64380 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:12:25,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@34c9e39e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:12:25,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:12:25,502 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49872, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:12:25,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x43fde690 to 127.0.0.1:64380 2023-07-16 09:12:25,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:12:25,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(139): Connect 0x7335d431 to 127.0.0.1:64380 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:12:25,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f5075a1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:12:25,625 DEBUG [hconnection-0x24fea8c6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:12:25,626 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49884, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:12:25,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:12:25,637 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57802, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:12:25,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7335d431 to 127.0.0.1:64380 2023-07-16 09:12:25,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:12:25,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-16 09:12:25,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 09:12:25,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 09:12:25,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 09:12:25,644 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 09:12:25,645 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689499345645 2023-07-16 09:12:25,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-16 09:12:25,645 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-16 09:12:25,647 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 09:12:25,647 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 09:12:25,649 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-16 09:12:25,649 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 09:12:25,650 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-16 09:12:25,651 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 09:12:25,652 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689499345652 2023-07-16 09:12:25,684 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,685 INFO [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-16 09:12:25,685 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:25,686 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-16 09:12:25,686 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-16 09:12:25,687 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,687 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,688 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:25,688 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:25,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:25,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:25,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:25,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:25,689 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:25,689 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:25,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:25,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:25,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,689 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:25,689 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:25,689 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,690 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,690 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:25,690 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 09:12:25,690 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-16 09:12:25,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-16 09:12:25,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-16 09:12:25,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,690 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 09:12:25,690 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 09:12:25,690 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-16 09:12:25,691 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,691 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,691 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 09:12:25,691 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 09:12:25,691 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:25,691 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:25,694 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,696 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-16 09:12:25,696 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 09:12:25,697 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 09:12:25,696 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 09:12:25,697 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45437,1689498639234' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 09:12:25,696 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:25,697 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 09:12:25,700 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-16 09:12:25,701 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-16 09:12:25,700 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37709,1689498639179' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 09:12:25,701 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45805,1689498639118' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-16 09:12:25,702 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:25,702 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:25,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:25,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:25,703 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:25,703 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,703 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:12:25,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:25,703 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,707 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,707 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,707 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:12:25,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:25,707 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,707 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:12:25,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:25,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:25,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:25,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:25,709 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45437,1689498639234' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-16 09:12:25,709 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@768e69d6[Count = 1] remaining members to acquire global barrier 2023-07-16 09:12:25,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:25,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:25,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:25,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:25,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:25,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:25,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:25,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:25,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:25,711 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45805,1689498639118' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-16 09:12:25,712 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@768e69d6[Count = 0] remaining members to acquire global barrier 2023-07-16 09:12:25,712 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-16 09:12:25,712 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,716 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,716 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,716 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,716 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 09:12:25,716 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 09:12:25,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,716 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 09:12:25,716 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-16 09:12:25,716 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37709,1689498639179' in zk 2023-07-16 09:12:25,716 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:12:25,716 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:12:25,716 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:25,716 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689498743619.cc4a786bd1b80161c7134ae38206c028. 2023-07-16 09:12:25,716 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689498743619.cc4a786bd1b80161c7134ae38206c028. started... 2023-07-16 09:12:25,717 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:25,717 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 09:12:25,717 INFO [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cc4a786bd1b80161c7134ae38206c028 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-16 09:12:25,718 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 09:12:25,718 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:25,718 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 09:12:25,720 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:12:25,720 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:12:25,720 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689498743619.6d7b51394745622e8e0327780db1b37d. 2023-07-16 09:12:25,720 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689498743619.6d7b51394745622e8e0327780db1b37d. started... 2023-07-16 09:12:25,720 INFO [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6d7b51394745622e8e0327780db1b37d 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-16 09:12:25,747 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:12:25,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 09:12:25,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:12:25,749 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 09:12:25,770 INFO [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307167337b36b8608474d8836ac93a14a80bf to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307167337b36b8608474d8836ac93a14a80bf 2023-07-16 09:12:25,773 INFO [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230716ebe8cb86c3cd4d939694f353aea7037f to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230716ebe8cb86c3cd4d939694f353aea7037f 2023-07-16 09:12:25,811 INFO [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testEmptyExportFileSystemState/cc4a786bd1b80161c7134ae38206c028/.tmp/cf/71122eaa04b14a8f81575e6b3af10085 2023-07-16 09:12:25,822 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testEmptyExportFileSystemState/cc4a786bd1b80161c7134ae38206c028/.tmp/cf/71122eaa04b14a8f81575e6b3af10085 as hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testEmptyExportFileSystemState/cc4a786bd1b80161c7134ae38206c028/cf/71122eaa04b14a8f81575e6b3af10085 2023-07-16 09:12:25,826 INFO [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testEmptyExportFileSystemState/6d7b51394745622e8e0327780db1b37d/.tmp/cf/f19bcfab366241f7b22f0e6126ae77a7 2023-07-16 09:12:25,829 INFO [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testEmptyExportFileSystemState/cc4a786bd1b80161c7134ae38206c028/cf/71122eaa04b14a8f81575e6b3af10085, entries=44, sequenceid=6, filesize=12.6 K 2023-07-16 09:12:25,830 INFO [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for cc4a786bd1b80161c7134ae38206c028 in 113ms, sequenceid=6, compaction requested=false 2023-07-16 09:12:25,834 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cc4a786bd1b80161c7134ae38206c028: 2023-07-16 09:12:25,835 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689498743619.cc4a786bd1b80161c7134ae38206c028.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,835 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:12:25,835 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testEmptyExportFileSystemState/cc4a786bd1b80161c7134ae38206c028/cf/71122eaa04b14a8f81575e6b3af10085] hfiles 2023-07-16 09:12:25,835 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testEmptyExportFileSystemState/cc4a786bd1b80161c7134ae38206c028/cf/71122eaa04b14a8f81575e6b3af10085 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,836 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testEmptyExportFileSystemState/6d7b51394745622e8e0327780db1b37d/.tmp/cf/f19bcfab366241f7b22f0e6126ae77a7 as hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testEmptyExportFileSystemState/6d7b51394745622e8e0327780db1b37d/cf/f19bcfab366241f7b22f0e6126ae77a7 2023-07-16 09:12:25,841 INFO [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testEmptyExportFileSystemState/6d7b51394745622e8e0327780db1b37d/cf/f19bcfab366241f7b22f0e6126ae77a7, entries=6, sequenceid=6, filesize=5.9 K 2023-07-16 09:12:25,842 INFO [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 6d7b51394745622e8e0327780db1b37d in 122ms, sequenceid=6, compaction requested=false 2023-07-16 09:12:25,842 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6d7b51394745622e8e0327780db1b37d: 2023-07-16 09:12:25,843 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689498743619.6d7b51394745622e8e0327780db1b37d.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,848 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:12:25,848 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testEmptyExportFileSystemState/6d7b51394745622e8e0327780db1b37d/cf/f19bcfab366241f7b22f0e6126ae77a7] hfiles 2023-07-16 09:12:25,848 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testEmptyExportFileSystemState/6d7b51394745622e8e0327780db1b37d/cf/f19bcfab366241f7b22f0e6126ae77a7 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,871 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689498743619.cc4a786bd1b80161c7134ae38206c028. completed. 2023-07-16 09:12:25,871 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689498743619.cc4a786bd1b80161c7134ae38206c028. 2023-07-16 09:12:25,871 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:12:25,871 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:12:25,871 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:25,871 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 09:12:25,871 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45437,1689498639234' in zk 2023-07-16 09:12:25,877 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:25,877 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 09:12:25,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:25,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:25,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:25,877 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:25,877 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 09:12:25,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:25,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:25,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:25,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:25,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:25,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:25,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:25,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:25,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45437,1689498639234': 2023-07-16 09:12:25,882 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45437,1689498639234' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-16 09:12:25,910 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689498743619.6d7b51394745622e8e0327780db1b37d. completed. 2023-07-16 09:12:25,910 DEBUG [rs(jenkins-hbase4.apache.org,45805,1689498639118)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689498743619.6d7b51394745622e8e0327780db1b37d. 2023-07-16 09:12:25,910 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:12:25,910 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:12:25,910 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:25,910 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-16 09:12:25,910 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45805,1689498639118' in zk 2023-07-16 09:12:25,913 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:25,913 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-16 09:12:25,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:25,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:25,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:25,913 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:25,913 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-16 09:12:25,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:25,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:25,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:25,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:25,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:25,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:25,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:25,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:25,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:25,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45805,1689498639118': 2023-07-16 09:12:25,931 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45805,1689498639118' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-16 09:12:25,931 INFO [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-16 09:12:25,931 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 09:12:25,931 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 09:12:25,931 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,931 INFO [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 09:12:25,934 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,934 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,934 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,934 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:25,934 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,934 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:25,934 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:25,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:25,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:25,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:25,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:25,935 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:25,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:25,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:25,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:25,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:25,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:25,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,936 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:25,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,937 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:25,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:25,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:25,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:25,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:25,940 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:25,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:25,949 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:12:25,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 09:12:25,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:12:25,951 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 09:12:25,952 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:25,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,953 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:25,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:25,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:25,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:25,960 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:25,960 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:25,960 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:25,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:25,960 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,960 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:25,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:25,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:25,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:25,960 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:25,961 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:25,961 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,961 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:25,961 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,961 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:25,961 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:25,961 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,961 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:25,960 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,960 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:25,960 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:25,960 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:25,961 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-16 09:12:25,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:25,964 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,964 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 09:12:25,961 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:25,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:25,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:25,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:25,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:25,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:25,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:25,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307167337b36b8608474d8836ac93a14a80bf, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230716ebe8cb86c3cd4d939694f353aea7037f] mob files 2023-07-16 09:12:25,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307167337b36b8608474d8836ac93a14a80bf 2023-07-16 09:12:25,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230716ebe8cb86c3cd4d939694f353aea7037f 2023-07-16 09:12:25,983 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:25,983 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:26,047 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:26,091 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-16 09:12:26,091 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:26,091 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:26,091 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689498745645Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689498745983 (+338 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689498745983Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689498745983Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689498745997 (+14 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689498746029 (+32 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689498746091 (+62 ms) 2023-07-16 09:12:26,094 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-16 09:12:26,100 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 447 msec 2023-07-16 09:12:26,251 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:12:26,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-16 09:12:26,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 09:12:26,252 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498746252 2023-07-16 09:12:26,253 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43477, tgtDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498746252, rawTgtDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498746252, srcFsUri=hdfs://localhost:43477, srcDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae 2023-07-16 09:12:26,287 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43477, inputRoot=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae 2023-07-16 09:12:26,287 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2022184796_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498746252, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498746252/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:26,287 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43477, inputRoot=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae, snapshotDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-16 09:12:26,300 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498746252/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:26,378 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:26,378 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:26,379 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:26,379 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:26,379 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:26,379 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:26,380 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:26,470 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/hadoop-1555769031799473340.jar 2023-07-16 09:12:26,470 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:26,471 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:26,471 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:26,472 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:26,472 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:26,473 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:26,473 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 09:12:26,475 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 09:12:26,475 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 09:12:26,476 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 09:12:26,477 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 09:12:26,477 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 09:12:26,478 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 09:12:26,478 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 09:12:26,482 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 09:12:26,483 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 09:12:26,483 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:12:26,484 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:12:26,485 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 09:12:26,485 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:12:26,485 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:12:26,486 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 09:12:26,486 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 09:12:27,105 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647086_0005_000001 (auth:SIMPLE) 2023-07-16 09:12:27,525 WARN [Listener at jenkins-hbase4.apache.org/33381] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 09:12:27,528 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-16 09:12:27,729 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 09:12:27,729 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 09:12:28,084 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647086_0006_000001 (auth:SIMPLE) 2023-07-16 09:12:28,373 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 09:12:33,699 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647086_0006_000001 (auth:SIMPLE) 2023-07-16 09:12:36,076 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 09:12:36,077 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 09:12:36,086 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:36,086 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 09:12:36,087 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 09:12:36,087 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_583604367_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:36,087 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(367): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-16 09:12:36,088 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(367): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-16 09:12:36,088 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_583604367_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498746252/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498746252/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:36,088 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(367): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498746252/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-16 09:12:36,088 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(367): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498746252/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-16 09:12:36,102 INFO [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-16 09:12:36,103 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-16 09:12:36,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 09:12:36,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-16 09:12:36,109 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498756109"}]},"ts":"1689498756109"} 2023-07-16 09:12:36,110 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-16 09:12:36,112 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-16 09:12:36,114 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6d7b51394745622e8e0327780db1b37d, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cc4a786bd1b80161c7134ae38206c028, UNASSIGN}] 2023-07-16 09:12:36,115 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cc4a786bd1b80161c7134ae38206c028, UNASSIGN 2023-07-16 09:12:36,120 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6d7b51394745622e8e0327780db1b37d, UNASSIGN 2023-07-16 09:12:36,121 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=cc4a786bd1b80161c7134ae38206c028, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:36,121 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689498743619.cc4a786bd1b80161c7134ae38206c028.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689498756121"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498756121"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498756121"}]},"ts":"1689498756121"} 2023-07-16 09:12:36,122 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=6d7b51394745622e8e0327780db1b37d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:36,122 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689498743619.6d7b51394745622e8e0327780db1b37d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689498756122"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498756122"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498756122"}]},"ts":"1689498756122"} 2023-07-16 09:12:36,126 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure cc4a786bd1b80161c7134ae38206c028, server=jenkins-hbase4.apache.org,45437,1689498639234}] 2023-07-16 09:12:36,126 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 6d7b51394745622e8e0327780db1b37d, server=jenkins-hbase4.apache.org,45805,1689498639118}] 2023-07-16 09:12:36,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-16 09:12:36,281 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cc4a786bd1b80161c7134ae38206c028 2023-07-16 09:12:36,282 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cc4a786bd1b80161c7134ae38206c028, disabling compactions & flushes 2023-07-16 09:12:36,282 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689498743619.cc4a786bd1b80161c7134ae38206c028. 2023-07-16 09:12:36,282 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689498743619.cc4a786bd1b80161c7134ae38206c028. 2023-07-16 09:12:36,282 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689498743619.cc4a786bd1b80161c7134ae38206c028. after waiting 0 ms 2023-07-16 09:12:36,282 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689498743619.cc4a786bd1b80161c7134ae38206c028. 2023-07-16 09:12:36,282 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6d7b51394745622e8e0327780db1b37d 2023-07-16 09:12:36,282 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6d7b51394745622e8e0327780db1b37d, disabling compactions & flushes 2023-07-16 09:12:36,283 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689498743619.6d7b51394745622e8e0327780db1b37d. 2023-07-16 09:12:36,283 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689498743619.6d7b51394745622e8e0327780db1b37d. 2023-07-16 09:12:36,283 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689498743619.6d7b51394745622e8e0327780db1b37d. after waiting 0 ms 2023-07-16 09:12:36,283 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689498743619.6d7b51394745622e8e0327780db1b37d. 2023-07-16 09:12:36,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testEmptyExportFileSystemState/cc4a786bd1b80161c7134ae38206c028/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 09:12:36,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:12:36,315 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689498743619.cc4a786bd1b80161c7134ae38206c028. 2023-07-16 09:12:36,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cc4a786bd1b80161c7134ae38206c028: 2023-07-16 09:12:36,317 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cc4a786bd1b80161c7134ae38206c028 2023-07-16 09:12:36,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testEmptyExportFileSystemState/6d7b51394745622e8e0327780db1b37d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 09:12:36,318 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=cc4a786bd1b80161c7134ae38206c028, regionState=CLOSED 2023-07-16 09:12:36,318 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689498743619.cc4a786bd1b80161c7134ae38206c028.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689498756318"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498756318"}]},"ts":"1689498756318"} 2023-07-16 09:12:36,319 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:12:36,323 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689498743619.6d7b51394745622e8e0327780db1b37d. 2023-07-16 09:12:36,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6d7b51394745622e8e0327780db1b37d: 2023-07-16 09:12:36,325 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6d7b51394745622e8e0327780db1b37d 2023-07-16 09:12:36,328 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=6d7b51394745622e8e0327780db1b37d, regionState=CLOSED 2023-07-16 09:12:36,328 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689498743619.6d7b51394745622e8e0327780db1b37d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689498756328"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498756328"}]},"ts":"1689498756328"} 2023-07-16 09:12:36,328 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-16 09:12:36,328 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure cc4a786bd1b80161c7134ae38206c028, server=jenkins-hbase4.apache.org,45437,1689498639234 in 201 msec 2023-07-16 09:12:36,330 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cc4a786bd1b80161c7134ae38206c028, UNASSIGN in 214 msec 2023-07-16 09:12:36,332 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-16 09:12:36,332 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 6d7b51394745622e8e0327780db1b37d, server=jenkins-hbase4.apache.org,45805,1689498639118 in 203 msec 2023-07-16 09:12:36,335 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-16 09:12:36,335 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6d7b51394745622e8e0327780db1b37d, UNASSIGN in 218 msec 2023-07-16 09:12:36,336 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498756336"}]},"ts":"1689498756336"} 2023-07-16 09:12:36,338 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-16 09:12:36,340 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-16 09:12:36,348 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 242 msec 2023-07-16 09:12:36,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-16 09:12:36,413 INFO [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-16 09:12:36,414 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-16 09:12:36,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 09:12:36,418 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 09:12:36,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-16 09:12:36,421 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37709] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-16 09:12:36,425 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 09:12:36,426 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 09:12:36,426 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 09:12:36,426 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 09:12:36,426 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 09:12:36,426 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-16 09:12:36,426 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-16 09:12:36,426 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-16 09:12:36,426 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-16 09:12:36,428 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 09:12:36,428 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 09:12:36,428 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:36,428 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 09:12:36,428 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:36,428 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-16 09:12:36,428 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:36,428 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:36,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-16 09:12:36,431 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc4a786bd1b80161c7134ae38206c028 2023-07-16 09:12:36,431 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testEmptyExportFileSystemState/6d7b51394745622e8e0327780db1b37d 2023-07-16 09:12:36,433 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc4a786bd1b80161c7134ae38206c028/cf, FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc4a786bd1b80161c7134ae38206c028/recovered.edits] 2023-07-16 09:12:36,434 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testEmptyExportFileSystemState/6d7b51394745622e8e0327780db1b37d/cf, FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testEmptyExportFileSystemState/6d7b51394745622e8e0327780db1b37d/recovered.edits] 2023-07-16 09:12:36,439 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testEmptyExportFileSystemState/6d7b51394745622e8e0327780db1b37d/cf/f19bcfab366241f7b22f0e6126ae77a7 to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testEmptyExportFileSystemState/6d7b51394745622e8e0327780db1b37d/cf/f19bcfab366241f7b22f0e6126ae77a7 2023-07-16 09:12:36,441 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc4a786bd1b80161c7134ae38206c028/cf/71122eaa04b14a8f81575e6b3af10085 to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testEmptyExportFileSystemState/cc4a786bd1b80161c7134ae38206c028/cf/71122eaa04b14a8f81575e6b3af10085 2023-07-16 09:12:36,442 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testEmptyExportFileSystemState/6d7b51394745622e8e0327780db1b37d/recovered.edits/9.seqid to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testEmptyExportFileSystemState/6d7b51394745622e8e0327780db1b37d/recovered.edits/9.seqid 2023-07-16 09:12:36,443 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testEmptyExportFileSystemState/6d7b51394745622e8e0327780db1b37d 2023-07-16 09:12:36,446 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc4a786bd1b80161c7134ae38206c028/recovered.edits/9.seqid to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testEmptyExportFileSystemState/cc4a786bd1b80161c7134ae38206c028/recovered.edits/9.seqid 2023-07-16 09:12:36,447 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc4a786bd1b80161c7134ae38206c028 2023-07-16 09:12:36,447 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-16 09:12:36,447 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-16 09:12:36,448 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-16 09:12:36,451 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307167337b36b8608474d8836ac93a14a80bf to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307167337b36b8608474d8836ac93a14a80bf 2023-07-16 09:12:36,452 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230716ebe8cb86c3cd4d939694f353aea7037f to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230716ebe8cb86c3cd4d939694f353aea7037f 2023-07-16 09:12:36,454 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-16 09:12:36,460 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 09:12:36,464 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-16 09:12:36,466 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-16 09:12:36,472 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 09:12:36,472 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-16 09:12:36,473 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689498743619.6d7b51394745622e8e0327780db1b37d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689498756472"}]},"ts":"9223372036854775807"} 2023-07-16 09:12:36,473 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689498743619.cc4a786bd1b80161c7134ae38206c028.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689498756472"}]},"ts":"9223372036854775807"} 2023-07-16 09:12:36,474 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 09:12:36,475 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6d7b51394745622e8e0327780db1b37d, NAME => 'testtb-testEmptyExportFileSystemState,,1689498743619.6d7b51394745622e8e0327780db1b37d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => cc4a786bd1b80161c7134ae38206c028, NAME => 'testtb-testEmptyExportFileSystemState,1,1689498743619.cc4a786bd1b80161c7134ae38206c028.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 09:12:36,475 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-16 09:12:36,475 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689498756475"}]},"ts":"9223372036854775807"} 2023-07-16 09:12:36,476 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-16 09:12:36,478 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-16 09:12:36,479 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 64 msec 2023-07-16 09:12:36,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-16 09:12:36,531 INFO [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-16 09:12:36,538 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-16 09:12:36,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:36,542 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-16 09:12:36,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-16 09:12:36,579 INFO [Listener at jenkins-hbase4.apache.org/33381] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=762 (was 759) Potentially hanging thread: hconnection-0x404319e1-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_583604367_17 at /127.0.0.1:32852 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x404319e1-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1104155582) connection to jenkins-hbase4.apache.org/172.31.14.131:44269 from appattempt_1689498647086_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2058127501_1 at /127.0.0.1:32818 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1104155582) connection to jenkins-hbase4.apache.org/172.31.14.131:37615 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x404319e1-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_583604367_17 at /127.0.0.1:44252 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1104155582) connection to jenkins-hbase4.apache.org/172.31.14.131:44269 from appattempt_1689498647086_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2058127501_1 at /127.0.0.1:34036 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_583604367_17 at /127.0.0.1:34050 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4796 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x404319e1-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1104155582) connection to jenkins-hbase4.apache.org/172.31.14.131:34731 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=931 (was 921) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=792 (was 719) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 180) - ProcessCount LEAK? -, AvailableMemoryMB=1552 (was 2693) 2023-07-16 09:12:36,579 WARN [Listener at jenkins-hbase4.apache.org/33381] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-16 09:12:36,607 INFO [Listener at jenkins-hbase4.apache.org/33381] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=762, OpenFileDescriptor=931, MaxFileDescriptor=60000, SystemLoadAverage=792, ProcessCount=183, AvailableMemoryMB=1931 2023-07-16 09:12:36,607 WARN [Listener at jenkins-hbase4.apache.org/33381] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-16 09:12:36,609 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-16 09:12:36,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:36,615 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-16 09:12:36,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-16 09:12:36,616 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-16 09:12:36,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-16 09:12:36,621 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b363d265aea035b1addfb128695dddb 2023-07-16 09:12:36,621 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/973b8185b34d26793718641952bf6c11 2023-07-16 09:12:36,622 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b363d265aea035b1addfb128695dddb empty. 2023-07-16 09:12:36,622 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/973b8185b34d26793718641952bf6c11 empty. 2023-07-16 09:12:36,623 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b363d265aea035b1addfb128695dddb 2023-07-16 09:12:36,623 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/973b8185b34d26793718641952bf6c11 2023-07-16 09:12:36,623 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-16 09:12:36,638 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-16 09:12:36,640 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9b363d265aea035b1addfb128695dddb, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689498756609.9b363d265aea035b1addfb128695dddb.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp 2023-07-16 09:12:36,640 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 973b8185b34d26793718641952bf6c11, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689498756609.973b8185b34d26793718641952bf6c11.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp 2023-07-16 09:12:36,655 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689498756609.9b363d265aea035b1addfb128695dddb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:12:36,655 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 9b363d265aea035b1addfb128695dddb, disabling compactions & flushes 2023-07-16 09:12:36,655 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689498756609.9b363d265aea035b1addfb128695dddb. 2023-07-16 09:12:36,656 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689498756609.9b363d265aea035b1addfb128695dddb. 2023-07-16 09:12:36,656 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689498756609.9b363d265aea035b1addfb128695dddb. after waiting 0 ms 2023-07-16 09:12:36,656 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689498756609.9b363d265aea035b1addfb128695dddb. 2023-07-16 09:12:36,656 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689498756609.9b363d265aea035b1addfb128695dddb. 2023-07-16 09:12:36,656 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 9b363d265aea035b1addfb128695dddb: 2023-07-16 09:12:36,661 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689498756609.973b8185b34d26793718641952bf6c11.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:12:36,661 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 973b8185b34d26793718641952bf6c11, disabling compactions & flushes 2023-07-16 09:12:36,661 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689498756609.973b8185b34d26793718641952bf6c11. 2023-07-16 09:12:36,661 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689498756609.973b8185b34d26793718641952bf6c11. 2023-07-16 09:12:36,661 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689498756609.973b8185b34d26793718641952bf6c11. after waiting 0 ms 2023-07-16 09:12:36,661 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689498756609.973b8185b34d26793718641952bf6c11. 2023-07-16 09:12:36,661 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689498756609.973b8185b34d26793718641952bf6c11. 2023-07-16 09:12:36,661 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 973b8185b34d26793718641952bf6c11: 2023-07-16 09:12:36,664 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-16 09:12:36,666 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689498756609.9b363d265aea035b1addfb128695dddb.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689498756665"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498756665"}]},"ts":"1689498756665"} 2023-07-16 09:12:36,666 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689498756609.973b8185b34d26793718641952bf6c11.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689498756665"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498756665"}]},"ts":"1689498756665"} 2023-07-16 09:12:36,671 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-16 09:12:36,677 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-16 09:12:36,677 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498756677"}]},"ts":"1689498756677"} 2023-07-16 09:12:36,678 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-16 09:12:36,681 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-16 09:12:36,683 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-16 09:12:36,683 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-16 09:12:36,683 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-16 09:12:36,683 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-16 09:12:36,683 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9b363d265aea035b1addfb128695dddb, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=973b8185b34d26793718641952bf6c11, ASSIGN}] 2023-07-16 09:12:36,686 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=973b8185b34d26793718641952bf6c11, ASSIGN 2023-07-16 09:12:36,686 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9b363d265aea035b1addfb128695dddb, ASSIGN 2023-07-16 09:12:36,687 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=973b8185b34d26793718641952bf6c11, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45437,1689498639234; forceNewPlan=false, retain=false 2023-07-16 09:12:36,687 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9b363d265aea035b1addfb128695dddb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37709,1689498639179; forceNewPlan=false, retain=false 2023-07-16 09:12:36,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-16 09:12:36,837 INFO [jenkins-hbase4:46005] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-16 09:12:36,840 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=973b8185b34d26793718641952bf6c11, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:36,840 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=9b363d265aea035b1addfb128695dddb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:36,841 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689498756609.973b8185b34d26793718641952bf6c11.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689498756840"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498756840"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498756840"}]},"ts":"1689498756840"} 2023-07-16 09:12:36,841 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689498756609.9b363d265aea035b1addfb128695dddb.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689498756840"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498756840"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498756840"}]},"ts":"1689498756840"} 2023-07-16 09:12:36,842 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 973b8185b34d26793718641952bf6c11, server=jenkins-hbase4.apache.org,45437,1689498639234}] 2023-07-16 09:12:36,843 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 9b363d265aea035b1addfb128695dddb, server=jenkins-hbase4.apache.org,37709,1689498639179}] 2023-07-16 09:12:36,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-16 09:12:37,002 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689498756609.973b8185b34d26793718641952bf6c11. 2023-07-16 09:12:37,002 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689498756609.9b363d265aea035b1addfb128695dddb. 2023-07-16 09:12:37,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 973b8185b34d26793718641952bf6c11, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689498756609.973b8185b34d26793718641952bf6c11.', STARTKEY => '1', ENDKEY => ''} 2023-07-16 09:12:37,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9b363d265aea035b1addfb128695dddb, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689498756609.9b363d265aea035b1addfb128695dddb.', STARTKEY => '', ENDKEY => '1'} 2023-07-16 09:12:37,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689498756609.973b8185b34d26793718641952bf6c11. service=AccessControlService 2023-07-16 09:12:37,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689498756609.9b363d265aea035b1addfb128695dddb. service=AccessControlService 2023-07-16 09:12:37,003 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:12:37,003 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-16 09:12:37,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 973b8185b34d26793718641952bf6c11 2023-07-16 09:12:37,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 9b363d265aea035b1addfb128695dddb 2023-07-16 09:12:37,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689498756609.973b8185b34d26793718641952bf6c11.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:12:37,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689498756609.9b363d265aea035b1addfb128695dddb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-16 09:12:37,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 973b8185b34d26793718641952bf6c11 2023-07-16 09:12:37,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9b363d265aea035b1addfb128695dddb 2023-07-16 09:12:37,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 973b8185b34d26793718641952bf6c11 2023-07-16 09:12:37,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9b363d265aea035b1addfb128695dddb 2023-07-16 09:12:37,004 INFO [StoreOpener-973b8185b34d26793718641952bf6c11-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 973b8185b34d26793718641952bf6c11 2023-07-16 09:12:37,004 INFO [StoreOpener-9b363d265aea035b1addfb128695dddb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9b363d265aea035b1addfb128695dddb 2023-07-16 09:12:37,006 DEBUG [StoreOpener-973b8185b34d26793718641952bf6c11-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithSkipTmp/973b8185b34d26793718641952bf6c11/cf 2023-07-16 09:12:37,006 DEBUG [StoreOpener-9b363d265aea035b1addfb128695dddb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b363d265aea035b1addfb128695dddb/cf 2023-07-16 09:12:37,006 DEBUG [StoreOpener-973b8185b34d26793718641952bf6c11-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithSkipTmp/973b8185b34d26793718641952bf6c11/cf 2023-07-16 09:12:37,006 DEBUG [StoreOpener-9b363d265aea035b1addfb128695dddb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b363d265aea035b1addfb128695dddb/cf 2023-07-16 09:12:37,006 INFO [StoreOpener-973b8185b34d26793718641952bf6c11-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 973b8185b34d26793718641952bf6c11 columnFamilyName cf 2023-07-16 09:12:37,006 INFO [StoreOpener-9b363d265aea035b1addfb128695dddb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9b363d265aea035b1addfb128695dddb columnFamilyName cf 2023-07-16 09:12:37,008 INFO [StoreOpener-9b363d265aea035b1addfb128695dddb-1] regionserver.HStore(310): Store=9b363d265aea035b1addfb128695dddb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:12:37,008 INFO [StoreOpener-973b8185b34d26793718641952bf6c11-1] regionserver.HStore(310): Store=973b8185b34d26793718641952bf6c11/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-16 09:12:37,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithSkipTmp/973b8185b34d26793718641952bf6c11 2023-07-16 09:12:37,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b363d265aea035b1addfb128695dddb 2023-07-16 09:12:37,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithSkipTmp/973b8185b34d26793718641952bf6c11 2023-07-16 09:12:37,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b363d265aea035b1addfb128695dddb 2023-07-16 09:12:37,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 973b8185b34d26793718641952bf6c11 2023-07-16 09:12:37,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithSkipTmp/973b8185b34d26793718641952bf6c11/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 09:12:37,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9b363d265aea035b1addfb128695dddb 2023-07-16 09:12:37,015 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 973b8185b34d26793718641952bf6c11; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64798193, jitterRate=-0.03443168103694916}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 09:12:37,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 973b8185b34d26793718641952bf6c11: 2023-07-16 09:12:37,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b363d265aea035b1addfb128695dddb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-16 09:12:37,018 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9b363d265aea035b1addfb128695dddb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68600953, jitterRate=0.022233858704566956}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-16 09:12:37,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9b363d265aea035b1addfb128695dddb: 2023-07-16 09:12:37,019 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689498756609.9b363d265aea035b1addfb128695dddb., pid=109, masterSystemTime=1689498756996 2023-07-16 09:12:37,020 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689498756609.973b8185b34d26793718641952bf6c11., pid=108, masterSystemTime=1689498756996 2023-07-16 09:12:37,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689498756609.9b363d265aea035b1addfb128695dddb. 2023-07-16 09:12:37,021 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689498756609.9b363d265aea035b1addfb128695dddb. 2023-07-16 09:12:37,022 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=9b363d265aea035b1addfb128695dddb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:37,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689498756609.973b8185b34d26793718641952bf6c11. 2023-07-16 09:12:37,022 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689498756609.973b8185b34d26793718641952bf6c11. 2023-07-16 09:12:37,022 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689498756609.9b363d265aea035b1addfb128695dddb.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689498757022"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689498757022"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689498757022"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689498757022"}]},"ts":"1689498757022"} 2023-07-16 09:12:37,022 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=973b8185b34d26793718641952bf6c11, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:37,023 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689498756609.973b8185b34d26793718641952bf6c11.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689498757022"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689498757022"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689498757022"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689498757022"}]},"ts":"1689498757022"} 2023-07-16 09:12:37,026 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-16 09:12:37,026 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 9b363d265aea035b1addfb128695dddb, server=jenkins-hbase4.apache.org,37709,1689498639179 in 181 msec 2023-07-16 09:12:37,027 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-16 09:12:37,027 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 973b8185b34d26793718641952bf6c11, server=jenkins-hbase4.apache.org,45437,1689498639234 in 183 msec 2023-07-16 09:12:37,028 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9b363d265aea035b1addfb128695dddb, ASSIGN in 343 msec 2023-07-16 09:12:37,029 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-16 09:12:37,029 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=973b8185b34d26793718641952bf6c11, ASSIGN in 344 msec 2023-07-16 09:12:37,029 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-16 09:12:37,030 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498757029"}]},"ts":"1689498757029"} 2023-07-16 09:12:37,031 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-16 09:12:37,033 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-16 09:12:37,034 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-16 09:12:37,035 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37709] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-16 09:12:37,038 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:37,038 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:37,038 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:37,038 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:37,040 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-16 09:12:37,040 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-16 09:12:37,040 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-16 09:12:37,040 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-16 09:12:37,041 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 429 msec 2023-07-16 09:12:37,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-16 09:12:37,223 INFO [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-16 09:12:37,226 DEBUG [Listener at jenkins-hbase4.apache.org/33381] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,226 DEBUG [Listener at jenkins-hbase4.apache.org/33381] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689498756609.9b363d265aea035b1addfb128695dddb. 2023-07-16 09:12:37,228 INFO [Listener at jenkins-hbase4.apache.org/33381] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 09:12:37,240 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 09:12:37,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689498757240 (current time:1689498757240). 2023-07-16 09:12:37,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 09:12:37,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(139): Connect 0x55bdbd1d to 127.0.0.1:64380 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:12:37,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@472168a5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:12:37,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:12:37,254 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54978, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:12:37,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x55bdbd1d to 127.0.0.1:64380 2023-07-16 09:12:37,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:12:37,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(139): Connect 0x5aab255c to 127.0.0.1:64380 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:12:37,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62463e41, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:12:37,265 DEBUG [hconnection-0x2e6e16ec-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:12:37,268 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54986, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:12:37,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:12:37,274 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49932, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:12:37,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5aab255c to 127.0.0.1:64380 2023-07-16 09:12:37,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:12:37,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-16 09:12:37,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 09:12:37,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 09:12:37,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 09:12:37,280 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 09:12:37,281 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689499357281 2023-07-16 09:12:37,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 09:12:37,281 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,281 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 09:12:37,282 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 09:12:37,283 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 09:12:37,284 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 09:12:37,286 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-07-16 09:12:37,287 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 09:12:37,288 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689499357288 2023-07-16 09:12:37,298 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,299 INFO [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-16 09:12:37,299 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:37,300 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-16 09:12:37,300 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-16 09:12:37,301 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,301 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,302 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:37,302 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:37,302 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:37,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:37,302 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:37,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:37,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:37,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:37,302 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:37,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:37,303 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:37,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:37,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,303 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:37,303 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 09:12:37,303 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,303 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,303 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-16 09:12:37,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,304 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 09:12:37,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-16 09:12:37,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-16 09:12:37,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,304 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 09:12:37,304 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 09:12:37,304 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,304 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,304 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,304 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 09:12:37,304 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 09:12:37,305 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:37,304 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 09:12:37,305 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:37,306 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 09:12:37,305 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:37,307 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 09:12:37,308 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 09:12:37,309 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 09:12:37,307 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 09:12:37,309 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 09:12:37,309 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45437,1689498639234' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 09:12:37,309 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37709,1689498639179' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 09:12:37,308 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45805,1689498639118' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 09:12:37,322 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:37,322 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:37,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:37,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:37,322 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,322 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:37,322 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:37,322 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,323 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:12:37,323 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:37,323 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,323 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:12:37,323 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:12:37,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:37,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:37,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:37,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:37,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45437,1689498639234' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-16 09:12:37,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15080ffb[Count = 1] remaining members to acquire global barrier 2023-07-16 09:12:37,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:37,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:37,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:37,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:37,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:37,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:37,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:37,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:37,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:37,328 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37709,1689498639179' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-16 09:12:37,328 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15080ffb[Count = 0] remaining members to acquire global barrier 2023-07-16 09:12:37,328 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-16 09:12:37,328 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,329 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,329 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,329 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,330 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 09:12:37,330 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 09:12:37,330 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 09:12:37,330 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45805,1689498639118' in zk 2023-07-16 09:12:37,330 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:12:37,330 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:12:37,330 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 09:12:37,330 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689498756609.973b8185b34d26793718641952bf6c11. 2023-07-16 09:12:37,330 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:12:37,330 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:12:37,330 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689498756609.973b8185b34d26793718641952bf6c11. started... 2023-07-16 09:12:37,330 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689498756609.9b363d265aea035b1addfb128695dddb. 2023-07-16 09:12:37,331 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689498756609.9b363d265aea035b1addfb128695dddb. started... 2023-07-16 09:12:37,331 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:37,333 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 973b8185b34d26793718641952bf6c11: 2023-07-16 09:12:37,333 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:37,333 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 09:12:37,333 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689498756609.973b8185b34d26793718641952bf6c11.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,333 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9b363d265aea035b1addfb128695dddb: 2023-07-16 09:12:37,333 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:12:37,333 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 09:12:37,333 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689498756609.9b363d265aea035b1addfb128695dddb.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,333 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:12:37,333 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-16 09:12:37,336 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 09:12:37,336 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:37,337 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 09:12:37,359 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689498756609.9b363d265aea035b1addfb128695dddb. completed. 2023-07-16 09:12:37,359 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689498756609.9b363d265aea035b1addfb128695dddb. 2023-07-16 09:12:37,359 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:12:37,360 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:12:37,360 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:37,359 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689498756609.973b8185b34d26793718641952bf6c11. completed. 2023-07-16 09:12:37,360 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 09:12:37,360 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689498756609.973b8185b34d26793718641952bf6c11. 2023-07-16 09:12:37,360 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37709,1689498639179' in zk 2023-07-16 09:12:37,360 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:12:37,360 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:12:37,360 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:37,360 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 09:12:37,360 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45437,1689498639234' in zk 2023-07-16 09:12:37,362 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:37,362 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 09:12:37,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:37,362 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:37,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:37,362 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 09:12:37,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:37,364 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 09:12:37,364 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:37,364 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:37,364 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 09:12:37,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:37,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:37,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:37,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:37,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:37,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:37,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:37,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:37,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:37,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,45437,1689498639234': 2023-07-16 09:12:37,369 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45437,1689498639234' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-16 09:12:37,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:37,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:37,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:37,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:37,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:37,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:37,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:37,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:37,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:37,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:37,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:37,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:37,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,37709,1689498639179': 2023-07-16 09:12:37,374 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37709,1689498639179' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-16 09:12:37,374 INFO [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-16 09:12:37,374 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 09:12:37,375 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 09:12:37,375 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,375 INFO [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 09:12:37,377 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,377 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,377 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,377 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:37,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:37,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,377 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:37,377 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:37,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,377 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:37,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:37,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:37,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:37,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:37,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:37,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:37,378 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:37,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:37,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,379 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:37,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:37,381 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:37,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:37,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:37,382 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:12:37,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:37,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 09:12:37,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:12:37,384 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 09:12:37,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:37,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,384 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:37,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:37,385 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:37,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:37,385 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:37,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:37,391 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:37,392 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:37,392 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:37,392 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,392 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:37,392 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:37,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:37,392 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:37,392 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:37,392 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:37,392 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:37,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:37,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:37,392 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:37,392 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:37,392 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,392 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:37,394 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:37,394 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:37,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:37,394 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:37,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:37,394 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 09:12:37,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:37,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:37,395 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:37,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:37,395 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:37,395 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,395 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,395 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-16 09:12:37,424 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,425 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,519 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,554 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-16 09:12:37,554 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,555 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,555 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689498757281Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689498757424 (+143 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689498757424Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689498757425 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689498757447 (+22 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689498757507 (+60 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689498757554 (+47 ms) 2023-07-16 09:12:37,559 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 09:12:37,561 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 277 msec 2023-07-16 09:12:37,584 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:12:37,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 09:12:37,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 09:12:37,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37709] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689498756609.9b363d265aea035b1addfb128695dddb. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 09:12:37,590 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45437] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689498756609.973b8185b34d26793718641952bf6c11. with WAL disabled. Data may be lost in the event of a crash. 2023-07-16 09:12:37,600 DEBUG [Listener at jenkins-hbase4.apache.org/33381] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,600 DEBUG [Listener at jenkins-hbase4.apache.org/33381] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689498756609.9b363d265aea035b1addfb128695dddb. 2023-07-16 09:12:37,600 INFO [Listener at jenkins-hbase4.apache.org/33381] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-16 09:12:37,616 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 09:12:37,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689498757616 (current time:1689498757616). 2023-07-16 09:12:37,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-16 09:12:37,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(139): Connect 0x699dcc0f to 127.0.0.1:64380 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:12:37,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@371a7ea6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:12:37,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:12:37,631 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54996, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:12:37,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x699dcc0f to 127.0.0.1:64380 2023-07-16 09:12:37,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:12:37,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(139): Connect 0x26948dc9 to 127.0.0.1:64380 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-16 09:12:37,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@216ec0a0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-16 09:12:37,644 DEBUG [hconnection-0x45e56565-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:12:37,648 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55012, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:12:37,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-16 09:12:37,659 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49936, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-16 09:12:37,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x26948dc9 to 127.0.0.1:64380 2023-07-16 09:12:37,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:12:37,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-16 09:12:37,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-16 09:12:37,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 09:12:37,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 09:12:37,665 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 09:12:37,667 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689499357667 2023-07-16 09:12:37,667 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-16 09:12:37,669 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 09:12:37,670 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-16 09:12:37,671 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-16 09:12:37,671 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-16 09:12:37,671 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-07-16 09:12:37,672 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 09:12:37,673 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689499357673 2023-07-16 09:12:37,685 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,685 INFO [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-16 09:12:37,685 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:37,687 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-16 09:12:37,687 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-16 09:12:37,771 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:12:37,771 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,772 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 09:12:37,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:12:37,773 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-16 09:12:37,775 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:37,775 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:37,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:37,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:37,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:37,775 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:37,775 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:37,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:37,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:37,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:37,776 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:37,776 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:37,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,776 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,776 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:37,776 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-16 09:12:37,776 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,777 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-16 09:12:37,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,777 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 09:12:37,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-16 09:12:37,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-16 09:12:37,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,777 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,777 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 09:12:37,778 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 09:12:37,778 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-16 09:12:37,778 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:37,792 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 09:12:37,792 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 09:12:37,792 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,792 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 09:12:37,792 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:37,792 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37709,1689498639179' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 09:12:37,794 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:37,794 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:37,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:37,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:37,795 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,795 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:12:37,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:37,797 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 09:12:37,797 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,797 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 09:12:37,798 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-16 09:12:37,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:37,798 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-16 09:12:37,798 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45805,1689498639118' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 09:12:37,799 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-16 09:12:37,799 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-16 09:12:37,799 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45437,1689498639234' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-16 09:12:37,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,801 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:37,801 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,803 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,803 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,803 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:12:37,803 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,803 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-16 09:12:37,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:37,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:37,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:37,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:37,808 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37709,1689498639179' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-16 09:12:37,809 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@77520af7[Count = 1] remaining members to acquire global barrier 2023-07-16 09:12:37,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:37,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:37,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:37,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:37,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:37,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:37,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:37,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:37,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:37,812 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45437,1689498639234' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-16 09:12:37,812 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@77520af7[Count = 0] remaining members to acquire global barrier 2023-07-16 09:12:37,812 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-16 09:12:37,812 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,820 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,820 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,821 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,821 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 09:12:37,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,821 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:37,821 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 09:12:37,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,821 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45805,1689498639118' in zk 2023-07-16 09:12:37,821 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 09:12:37,821 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-16 09:12:37,821 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:37,821 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-16 09:12:37,821 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:12:37,821 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:12:37,822 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689498756609.973b8185b34d26793718641952bf6c11. 2023-07-16 09:12:37,822 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689498756609.973b8185b34d26793718641952bf6c11. started... 2023-07-16 09:12:37,822 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-16 09:12:37,822 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-16 09:12:37,822 INFO [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 973b8185b34d26793718641952bf6c11 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-16 09:12:37,822 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689498756609.9b363d265aea035b1addfb128695dddb. 2023-07-16 09:12:37,823 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689498756609.9b363d265aea035b1addfb128695dddb. started... 2023-07-16 09:12:37,823 INFO [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9b363d265aea035b1addfb128695dddb 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-16 09:12:37,824 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 09:12:37,824 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:37,824 DEBUG [member: 'jenkins-hbase4.apache.org,45805,1689498639118' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 09:12:37,890 INFO [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230716bef2a36f9b95448bb8f48017ce8b6c62 to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230716bef2a36f9b95448bb8f48017ce8b6c62 2023-07-16 09:12:37,892 INFO [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230716f03442e07f0d4f1f8061168c11507356 to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230716f03442e07f0d4f1f8061168c11507356 2023-07-16 09:12:37,940 INFO [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithSkipTmp/973b8185b34d26793718641952bf6c11/.tmp/cf/e58411ae74c74590a251df93309b9278 2023-07-16 09:12:37,946 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithSkipTmp/973b8185b34d26793718641952bf6c11/.tmp/cf/e58411ae74c74590a251df93309b9278 as hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithSkipTmp/973b8185b34d26793718641952bf6c11/cf/e58411ae74c74590a251df93309b9278 2023-07-16 09:12:37,952 INFO [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithSkipTmp/973b8185b34d26793718641952bf6c11/cf/e58411ae74c74590a251df93309b9278, entries=47, sequenceid=6, filesize=13.4 K 2023-07-16 09:12:37,953 INFO [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 973b8185b34d26793718641952bf6c11 in 131ms, sequenceid=6, compaction requested=false 2023-07-16 09:12:37,953 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-16 09:12:37,954 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 973b8185b34d26793718641952bf6c11: 2023-07-16 09:12:37,954 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689498756609.973b8185b34d26793718641952bf6c11.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,954 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:12:37,954 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithSkipTmp/973b8185b34d26793718641952bf6c11/cf/e58411ae74c74590a251df93309b9278] hfiles 2023-07-16 09:12:37,954 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithSkipTmp/973b8185b34d26793718641952bf6c11/cf/e58411ae74c74590a251df93309b9278 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,955 INFO [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b363d265aea035b1addfb128695dddb/.tmp/cf/1e8b0af2c24e40a1a32d7ae16ea1789c 2023-07-16 09:12:37,962 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b363d265aea035b1addfb128695dddb/.tmp/cf/1e8b0af2c24e40a1a32d7ae16ea1789c as hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b363d265aea035b1addfb128695dddb/cf/1e8b0af2c24e40a1a32d7ae16ea1789c 2023-07-16 09:12:37,970 INFO [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b363d265aea035b1addfb128695dddb/cf/1e8b0af2c24e40a1a32d7ae16ea1789c, entries=3, sequenceid=6, filesize=5.4 K 2023-07-16 09:12:37,971 INFO [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 9b363d265aea035b1addfb128695dddb in 148ms, sequenceid=6, compaction requested=false 2023-07-16 09:12:37,973 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9b363d265aea035b1addfb128695dddb: 2023-07-16 09:12:37,973 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689498756609.9b363d265aea035b1addfb128695dddb.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,973 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-16 09:12:37,973 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b363d265aea035b1addfb128695dddb/cf/1e8b0af2c24e40a1a32d7ae16ea1789c] hfiles 2023-07-16 09:12:37,973 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b363d265aea035b1addfb128695dddb/cf/1e8b0af2c24e40a1a32d7ae16ea1789c for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,973 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:12:37,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 09:12:37,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-16 09:12:37,975 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-16 09:12:37,980 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689498756609.973b8185b34d26793718641952bf6c11. completed. 2023-07-16 09:12:37,980 DEBUG [rs(jenkins-hbase4.apache.org,45437,1689498639234)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689498756609.973b8185b34d26793718641952bf6c11. 2023-07-16 09:12:37,980 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:12:37,980 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:12:37,981 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:37,981 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 09:12:37,981 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45437,1689498639234' in zk 2023-07-16 09:12:37,982 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:37,983 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 09:12:37,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:37,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:37,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:37,983 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:37,983 DEBUG [member: 'jenkins-hbase4.apache.org,45437,1689498639234' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 09:12:37,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:37,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:37,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:37,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:37,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:37,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:37,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:37,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:37,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:37,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,45437,1689498639234': 2023-07-16 09:12:37,990 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45437,1689498639234' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-16 09:12:38,002 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689498756609.9b363d265aea035b1addfb128695dddb. completed. 2023-07-16 09:12:38,002 DEBUG [rs(jenkins-hbase4.apache.org,37709,1689498639179)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689498756609.9b363d265aea035b1addfb128695dddb. 2023-07-16 09:12:38,002 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-16 09:12:38,002 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-16 09:12:38,002 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:38,002 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-16 09:12:38,002 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37709,1689498639179' in zk 2023-07-16 09:12:38,008 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-16 09:12:38,008 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:38,008 DEBUG [member: 'jenkins-hbase4.apache.org,37709,1689498639179' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-16 09:12:38,008 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:38,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:38,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:38,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:38,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:38,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:38,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:38,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:38,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:38,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:38,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:38,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:38,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:38,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:38,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:38,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,37709,1689498639179': 2023-07-16 09:12:38,015 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37709,1689498639179' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-16 09:12:38,015 INFO [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-16 09:12:38,015 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-16 09:12:38,015 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-16 09:12:38,015 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:38,015 INFO [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-16 09:12:38,017 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:38,017 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:38,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:38,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:38,017 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:38,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:38,017 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:38,017 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:38,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:38,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:38,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:38,017 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:38,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-16 09:12:38,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-16 09:12:38,017 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:38,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:38,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:38,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:38,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:38,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:38,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-16 09:12:38,018 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:38,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:38,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:38,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:38,019 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:38,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:38,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:38,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:38,020 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:38,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-16 09:12:38,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:38,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:38,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:38,023 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:38,023 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:38,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:38,023 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:38,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-16 09:12:38,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:38,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:38,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:38,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:38,028 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:38,028 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:38,028 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:38,028 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:38,028 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:38,028 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:38,029 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:38,029 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:12:38,029 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:38,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:38,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:38,029 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:38,029 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:38,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:38,029 DEBUG [(jenkins-hbase4.apache.org,46005,1689498637607)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-16 09:12:38,029 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:38,029 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:38,031 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:38,031 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:38,031 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-16 09:12:38,029 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:38,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:38,031 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:38,032 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:38,031 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-16 09:12:38,032 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-16 09:12:38,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-16 09:12:38,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-16 09:12:38,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:38,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:38,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:38,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:38,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-16 09:12:38,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-16 09:12:38,034 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230716bef2a36f9b95448bb8f48017ce8b6c62, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230716f03442e07f0d4f1f8061168c11507356] mob files 2023-07-16 09:12:38,034 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230716bef2a36f9b95448bb8f48017ce8b6c62 2023-07-16 09:12:38,034 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230716f03442e07f0d4f1f8061168c11507356 2023-07-16 09:12:38,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:38,054 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:38,107 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:38,157 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-16 09:12:38,157 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:38,158 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:38,158 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689498757667Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689498758053 (+386 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689498758053Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689498758053Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689498758070 (+17 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689498758095 (+25 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689498758157 (+62 ms) 2023-07-16 09:12:38,162 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-16 09:12:38,163 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 494 msec 2023-07-16 09:12:38,275 DEBUG [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-16 09:12:38,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-16 09:12:38,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-16 09:12:38,276 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498758276 2023-07-16 09:12:38,277 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43477, tgtDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498758276, rawTgtDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498758276, srcFsUri=hdfs://localhost:43477, srcDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae 2023-07-16 09:12:38,307 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43477, inputRoot=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae 2023-07-16 09:12:38,307 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_892415820_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498758276, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498758276/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:38,307 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43477, inputRoot=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae, snapshotDir=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-16 09:12:38,337 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498758276/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:38,406 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:38,406 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:38,407 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:38,407 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:38,407 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:38,407 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:38,408 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:38,484 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/hadoop-3425706168214508576.jar 2023-07-16 09:12:38,485 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:38,485 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:38,486 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:38,486 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:38,486 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:38,486 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-16 09:12:38,487 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-16 09:12:38,487 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-16 09:12:38,488 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-16 09:12:38,488 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-16 09:12:38,488 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-16 09:12:38,489 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-16 09:12:38,489 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-16 09:12:38,489 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-16 09:12:38,489 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-16 09:12:38,490 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-16 09:12:38,490 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:12:38,491 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:12:38,491 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 09:12:38,491 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:12:38,491 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-16 09:12:38,492 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 09:12:38,492 DEBUG [Listener at jenkins-hbase4.apache.org/33381] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-16 09:12:39,602 WARN [Listener at jenkins-hbase4.apache.org/33381] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-16 09:12:39,605 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-16 09:12:39,607 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-16 09:12:41,096 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 09:12:41,097 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-16 09:12:41,100 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647086_0006_000001 (auth:SIMPLE) 2023-07-16 09:12:41,701 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647086_0007_000001 (auth:SIMPLE) 2023-07-16 09:12:41,900 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 09:12:47,137 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647086_0007_000001 (auth:SIMPLE) 2023-07-16 09:12:49,435 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647086_0007_000001 (auth:SIMPLE) 2023-07-16 09:12:52,732 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689498647086_0007_000001 (auth:SIMPLE) 2023-07-16 09:12:53,926 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-16 09:12:53,926 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-16 09:12:53,968 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:53,968 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-16 09:12:53,969 INFO [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-16 09:12:53,969 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_583604367_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:53,969 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(367): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-16 09:12:53,970 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(367): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-16 09:12:53,970 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_583604367_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498758276/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498758276/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:53,970 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(367): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498758276/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-16 09:12:53,970 DEBUG [Listener at jenkins-hbase4.apache.org/33381] snapshot.TestExportSnapshot(367): hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/export-test/export-1689498758276/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-16 09:12:53,995 INFO [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:53,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:53,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:54,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-16 09:12:54,001 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498774001"}]},"ts":"1689498774001"} 2023-07-16 09:12:54,003 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-16 09:12:54,004 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-16 09:12:54,005 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9b363d265aea035b1addfb128695dddb, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=973b8185b34d26793718641952bf6c11, UNASSIGN}] 2023-07-16 09:12:54,008 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9b363d265aea035b1addfb128695dddb, UNASSIGN 2023-07-16 09:12:54,009 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=973b8185b34d26793718641952bf6c11, UNASSIGN 2023-07-16 09:12:54,009 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=973b8185b34d26793718641952bf6c11, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:12:54,009 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=9b363d265aea035b1addfb128695dddb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:12:54,010 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689498756609.973b8185b34d26793718641952bf6c11.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689498774009"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498774009"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498774009"}]},"ts":"1689498774009"} 2023-07-16 09:12:54,010 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689498756609.9b363d265aea035b1addfb128695dddb.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689498774009"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689498774009"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689498774009"}]},"ts":"1689498774009"} 2023-07-16 09:12:54,014 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure 973b8185b34d26793718641952bf6c11, server=jenkins-hbase4.apache.org,45437,1689498639234}] 2023-07-16 09:12:54,015 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure 9b363d265aea035b1addfb128695dddb, server=jenkins-hbase4.apache.org,37709,1689498639179}] 2023-07-16 09:12:54,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-16 09:12:54,167 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 973b8185b34d26793718641952bf6c11 2023-07-16 09:12:54,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 973b8185b34d26793718641952bf6c11, disabling compactions & flushes 2023-07-16 09:12:54,167 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689498756609.973b8185b34d26793718641952bf6c11. 2023-07-16 09:12:54,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689498756609.973b8185b34d26793718641952bf6c11. 2023-07-16 09:12:54,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689498756609.973b8185b34d26793718641952bf6c11. after waiting 0 ms 2023-07-16 09:12:54,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689498756609.973b8185b34d26793718641952bf6c11. 2023-07-16 09:12:54,168 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9b363d265aea035b1addfb128695dddb 2023-07-16 09:12:54,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9b363d265aea035b1addfb128695dddb, disabling compactions & flushes 2023-07-16 09:12:54,172 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689498756609.9b363d265aea035b1addfb128695dddb. 2023-07-16 09:12:54,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689498756609.9b363d265aea035b1addfb128695dddb. 2023-07-16 09:12:54,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689498756609.9b363d265aea035b1addfb128695dddb. after waiting 0 ms 2023-07-16 09:12:54,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689498756609.9b363d265aea035b1addfb128695dddb. 2023-07-16 09:12:54,190 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithSkipTmp/973b8185b34d26793718641952bf6c11/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 09:12:54,192 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:12:54,194 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689498756609.973b8185b34d26793718641952bf6c11. 2023-07-16 09:12:54,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 973b8185b34d26793718641952bf6c11: 2023-07-16 09:12:54,195 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b363d265aea035b1addfb128695dddb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 09:12:54,197 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:12:54,197 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 973b8185b34d26793718641952bf6c11 2023-07-16 09:12:54,198 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689498756609.9b363d265aea035b1addfb128695dddb. 2023-07-16 09:12:54,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9b363d265aea035b1addfb128695dddb: 2023-07-16 09:12:54,198 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=973b8185b34d26793718641952bf6c11, regionState=CLOSED 2023-07-16 09:12:54,198 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689498756609.973b8185b34d26793718641952bf6c11.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689498774198"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498774198"}]},"ts":"1689498774198"} 2023-07-16 09:12:54,199 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9b363d265aea035b1addfb128695dddb 2023-07-16 09:12:54,200 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=9b363d265aea035b1addfb128695dddb, regionState=CLOSED 2023-07-16 09:12:54,200 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689498756609.9b363d265aea035b1addfb128695dddb.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689498774200"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689498774200"}]},"ts":"1689498774200"} 2023-07-16 09:12:54,202 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-16 09:12:54,202 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure 973b8185b34d26793718641952bf6c11, server=jenkins-hbase4.apache.org,45437,1689498639234 in 186 msec 2023-07-16 09:12:54,203 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=973b8185b34d26793718641952bf6c11, UNASSIGN in 197 msec 2023-07-16 09:12:54,203 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-16 09:12:54,203 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure 9b363d265aea035b1addfb128695dddb, server=jenkins-hbase4.apache.org,37709,1689498639179 in 186 msec 2023-07-16 09:12:54,205 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-16 09:12:54,205 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9b363d265aea035b1addfb128695dddb, UNASSIGN in 198 msec 2023-07-16 09:12:54,205 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689498774205"}]},"ts":"1689498774205"} 2023-07-16 09:12:54,206 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-16 09:12:54,208 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-16 09:12:54,209 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 213 msec 2023-07-16 09:12:54,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-16 09:12:54,304 INFO [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-16 09:12:54,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:54,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:54,308 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:54,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:54,309 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:54,311 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37709] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:54,314 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b363d265aea035b1addfb128695dddb 2023-07-16 09:12:54,314 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:54,314 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:54,314 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:54,315 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:54,315 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-16 09:12:54,315 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-16 09:12:54,315 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-16 09:12:54,318 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:54,318 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:54,318 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:54,318 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:54,319 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:54,319 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:54,319 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-16 09:12:54,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-16 09:12:54,320 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-16 09:12:54,320 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-16 09:12:54,322 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/973b8185b34d26793718641952bf6c11 2023-07-16 09:12:54,323 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b363d265aea035b1addfb128695dddb/cf, FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b363d265aea035b1addfb128695dddb/recovered.edits] 2023-07-16 09:12:54,326 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/973b8185b34d26793718641952bf6c11/cf, FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/973b8185b34d26793718641952bf6c11/recovered.edits] 2023-07-16 09:12:54,337 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b363d265aea035b1addfb128695dddb/cf/1e8b0af2c24e40a1a32d7ae16ea1789c to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b363d265aea035b1addfb128695dddb/cf/1e8b0af2c24e40a1a32d7ae16ea1789c 2023-07-16 09:12:54,337 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/973b8185b34d26793718641952bf6c11/cf/e58411ae74c74590a251df93309b9278 to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/973b8185b34d26793718641952bf6c11/cf/e58411ae74c74590a251df93309b9278 2023-07-16 09:12:54,345 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/973b8185b34d26793718641952bf6c11/recovered.edits/9.seqid to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/973b8185b34d26793718641952bf6c11/recovered.edits/9.seqid 2023-07-16 09:12:54,345 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b363d265aea035b1addfb128695dddb/recovered.edits/9.seqid to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b363d265aea035b1addfb128695dddb/recovered.edits/9.seqid 2023-07-16 09:12:54,345 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/973b8185b34d26793718641952bf6c11 2023-07-16 09:12:54,345 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9b363d265aea035b1addfb128695dddb 2023-07-16 09:12:54,346 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-16 09:12:54,346 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-16 09:12:54,347 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-16 09:12:54,352 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230716bef2a36f9b95448bb8f48017ce8b6c62 to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230716bef2a36f9b95448bb8f48017ce8b6c62 2023-07-16 09:12:54,355 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230716f03442e07f0d4f1f8061168c11507356 to hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230716f03442e07f0d4f1f8061168c11507356 2023-07-16 09:12:54,356 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-16 09:12:54,363 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:54,371 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-16 09:12:54,376 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-16 09:12:54,378 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:54,378 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-16 09:12:54,378 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689498756609.9b363d265aea035b1addfb128695dddb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689498774378"}]},"ts":"9223372036854775807"} 2023-07-16 09:12:54,378 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689498756609.973b8185b34d26793718641952bf6c11.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689498774378"}]},"ts":"9223372036854775807"} 2023-07-16 09:12:54,380 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-16 09:12:54,380 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9b363d265aea035b1addfb128695dddb, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689498756609.9b363d265aea035b1addfb128695dddb.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 973b8185b34d26793718641952bf6c11, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689498756609.973b8185b34d26793718641952bf6c11.', STARTKEY => '1', ENDKEY => ''}] 2023-07-16 09:12:54,380 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-16 09:12:54,380 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689498774380"}]},"ts":"9223372036854775807"} 2023-07-16 09:12:54,382 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-16 09:12:54,385 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:54,389 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 80 msec 2023-07-16 09:12:54,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-16 09:12:54,423 INFO [Listener at jenkins-hbase4.apache.org/33381] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-16 09:12:54,432 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-16 09:12:54,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:54,436 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-16 09:12:54,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46005] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-16 09:12:54,469 INFO [Listener at jenkins-hbase4.apache.org/33381] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=762 (was 762), OpenFileDescriptor=904 (was 931), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=819 (was 792) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 183), AvailableMemoryMB=1513 (was 1931) 2023-07-16 09:12:54,469 WARN [Listener at jenkins-hbase4.apache.org/33381] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-16 09:12:54,469 INFO [Listener at jenkins-hbase4.apache.org/33381] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-16 09:12:54,492 INFO [Listener at jenkins-hbase4.apache.org/33381] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-16 09:12:54,616 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689498647086_0007_01_000001 is : 143 2023-07-16 09:12:59,794 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-16 09:13:08,627 INFO [Listener at jenkins-hbase4.apache.org/33381] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-16 09:13:22,761 ERROR [Thread[Thread-408,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-16 09:13:22,762 INFO [Listener at jenkins-hbase4.apache.org/33381] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-16 09:13:22,882 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-16 09:13:22,895 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-16 09:13:22,896 ERROR [Thread[Thread-418,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-16 09:13:22,911 INFO [Listener at jenkins-hbase4.apache.org/33381] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-16 09:13:23,015 ERROR [Thread[Thread-383,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-16 09:13:23,016 INFO [Listener at jenkins-hbase4.apache.org/33381] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-16 09:13:23,016 INFO [Listener at jenkins-hbase4.apache.org/33381] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-16 09:13:23,016 INFO [Listener at jenkins-hbase4.apache.org/33381] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-16 09:13:23,016 DEBUG [Listener at jenkins-hbase4.apache.org/33381] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e1990f9 to 127.0.0.1:64380 2023-07-16 09:13:23,016 DEBUG [Listener at jenkins-hbase4.apache.org/33381] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:13:23,016 DEBUG [Listener at jenkins-hbase4.apache.org/33381] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-16 09:13:23,016 DEBUG [Listener at jenkins-hbase4.apache.org/33381] util.JVMClusterUtil(257): Found active master hash=1975035530, stopped=false 2023-07-16 09:13:23,016 DEBUG [Listener at jenkins-hbase4.apache.org/33381] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:13:23,017 DEBUG [Listener at jenkins-hbase4.apache.org/33381] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-16 09:13:23,017 INFO [Listener at jenkins-hbase4.apache.org/33381] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,46005,1689498637607 2023-07-16 09:13:23,018 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-16 09:13:23,018 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-16 09:13:23,018 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-16 09:13:23,018 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-16 09:13:23,018 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 09:13:23,019 INFO [Listener at jenkins-hbase4.apache.org/33381] procedure2.ProcedureExecutor(629): Stopping 2023-07-16 09:13:23,019 DEBUG [Listener at jenkins-hbase4.apache.org/33381] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x519832e7 to 127.0.0.1:64380 2023-07-16 09:13:23,019 DEBUG [Listener at jenkins-hbase4.apache.org/33381] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:13:23,019 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 09:13:23,019 INFO [Listener at jenkins-hbase4.apache.org/33381] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45805,1689498639118' ***** 2023-07-16 09:13:23,019 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 09:13:23,019 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 09:13:23,020 DEBUG [Listener at jenkins-hbase4.apache.org/33381] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:13:23,020 INFO [Listener at jenkins-hbase4.apache.org/33381] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-16 09:13:23,020 INFO [Listener at jenkins-hbase4.apache.org/33381] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37709,1689498639179' ***** 2023-07-16 09:13:23,020 DEBUG [Listener at jenkins-hbase4.apache.org/33381] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:13:23,020 INFO [Listener at jenkins-hbase4.apache.org/33381] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-16 09:13:23,020 INFO [RS:0;jenkins-hbase4:45805] regionserver.HeapMemoryManager(220): Stopping 2023-07-16 09:13:23,020 INFO [Listener at jenkins-hbase4.apache.org/33381] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45437,1689498639234' ***** 2023-07-16 09:13:23,020 INFO [RS:1;jenkins-hbase4:37709] regionserver.HeapMemoryManager(220): Stopping 2023-07-16 09:13:23,020 INFO [RS:1;jenkins-hbase4:37709] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-16 09:13:23,020 DEBUG [Listener at jenkins-hbase4.apache.org/33381] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:13:23,020 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-16 09:13:23,020 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-16 09:13:23,020 INFO [RS:1;jenkins-hbase4:37709] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-16 09:13:23,020 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-16 09:13:23,020 INFO [RS:0;jenkins-hbase4:45805] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-16 09:13:23,021 INFO [RS:0;jenkins-hbase4:45805] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-16 09:13:23,020 INFO [Listener at jenkins-hbase4.apache.org/33381] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-16 09:13:23,021 INFO [RS:1;jenkins-hbase4:37709] regionserver.HRegionServer(3305): Received CLOSE for dc50139a54969c5b0d84afa719bd5e04 2023-07-16 09:13:23,021 INFO [RS:0;jenkins-hbase4:45805] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:13:23,021 DEBUG [RS:0;jenkins-hbase4:45805] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x674848ed to 127.0.0.1:64380 2023-07-16 09:13:23,021 DEBUG [RS:0;jenkins-hbase4:45805] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:13:23,021 INFO [RS:2;jenkins-hbase4:45437] regionserver.HeapMemoryManager(220): Stopping 2023-07-16 09:13:23,024 INFO [RS:2;jenkins-hbase4:45437] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-16 09:13:23,024 INFO [RS:2;jenkins-hbase4:45437] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-16 09:13:23,024 INFO [RS:1;jenkins-hbase4:37709] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:13:23,025 DEBUG [RS:1;jenkins-hbase4:37709] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6992be8e to 127.0.0.1:64380 2023-07-16 09:13:23,025 DEBUG [RS:1;jenkins-hbase4:37709] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:13:23,025 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-16 09:13:23,025 INFO [RS:0;jenkins-hbase4:45805] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-16 09:13:23,025 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dc50139a54969c5b0d84afa719bd5e04, disabling compactions & flushes 2023-07-16 09:13:23,028 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689498642973.dc50139a54969c5b0d84afa719bd5e04. 2023-07-16 09:13:23,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689498642973.dc50139a54969c5b0d84afa719bd5e04. 2023-07-16 09:13:23,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689498642973.dc50139a54969c5b0d84afa719bd5e04. after waiting 0 ms 2023-07-16 09:13:23,029 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689498642973.dc50139a54969c5b0d84afa719bd5e04. 2023-07-16 09:13:23,029 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing dc50139a54969c5b0d84afa719bd5e04 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-16 09:13:23,028 INFO [RS:2;jenkins-hbase4:45437] regionserver.HRegionServer(3305): Received CLOSE for f7ad2e339a72ba504e143898f86e18f5 2023-07-16 09:13:23,026 INFO [RS:1;jenkins-hbase4:37709] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-16 09:13:23,029 DEBUG [RS:1;jenkins-hbase4:37709] regionserver.HRegionServer(1478): Online Regions={dc50139a54969c5b0d84afa719bd5e04=hbase:acl,,1689498642973.dc50139a54969c5b0d84afa719bd5e04.} 2023-07-16 09:13:23,026 INFO [RS:0;jenkins-hbase4:45805] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-16 09:13:23,036 INFO [RS:0;jenkins-hbase4:45805] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-16 09:13:23,036 INFO [RS:0;jenkins-hbase4:45805] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-16 09:13:23,036 INFO [RS:0;jenkins-hbase4:45805] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-16 09:13:23,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f7ad2e339a72ba504e143898f86e18f5, disabling compactions & flushes 2023-07-16 09:13:23,036 DEBUG [RS:0;jenkins-hbase4:45805] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-16 09:13:23,037 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689498642083.f7ad2e339a72ba504e143898f86e18f5. 2023-07-16 09:13:23,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689498642083.f7ad2e339a72ba504e143898f86e18f5. 2023-07-16 09:13:23,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689498642083.f7ad2e339a72ba504e143898f86e18f5. after waiting 0 ms 2023-07-16 09:13:23,037 DEBUG [RS:0;jenkins-hbase4:45805] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-16 09:13:23,029 INFO [RS:2;jenkins-hbase4:45437] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:13:23,037 DEBUG [RS:2;jenkins-hbase4:45437] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x450bb0f6 to 127.0.0.1:64380 2023-07-16 09:13:23,037 DEBUG [RS:2;jenkins-hbase4:45437] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:13:23,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689498642083.f7ad2e339a72ba504e143898f86e18f5. 2023-07-16 09:13:23,036 DEBUG [RS:1;jenkins-hbase4:37709] regionserver.HRegionServer(1504): Waiting on dc50139a54969c5b0d84afa719bd5e04 2023-07-16 09:13:23,037 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing f7ad2e339a72ba504e143898f86e18f5 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-16 09:13:23,039 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-16 09:13:23,039 INFO [RS:2;jenkins-hbase4:45437] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-16 09:13:23,039 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-16 09:13:23,039 DEBUG [RS:2;jenkins-hbase4:45437] regionserver.HRegionServer(1478): Online Regions={f7ad2e339a72ba504e143898f86e18f5=hbase:namespace,,1689498642083.f7ad2e339a72ba504e143898f86e18f5.} 2023-07-16 09:13:23,039 DEBUG [RS:2;jenkins-hbase4:45437] regionserver.HRegionServer(1504): Waiting on f7ad2e339a72ba504e143898f86e18f5 2023-07-16 09:13:23,039 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-16 09:13:23,040 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-16 09:13:23,040 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-16 09:13:23,041 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-16 09:13:23,083 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-16 09:13:23,085 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-16 09:13:23,103 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/acl/dc50139a54969c5b0d84afa719bd5e04/.tmp/l/da871fbc36bf4864a209cf1338bc469f 2023-07-16 09:13:23,108 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-16 09:13:23,114 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/namespace/f7ad2e339a72ba504e143898f86e18f5/.tmp/info/083463e9ff9248009b9cb1aa4c62e325 2023-07-16 09:13:23,127 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/meta/1588230740/.tmp/info/b2edf19eb99140098b9a456cb5cb60f6 2023-07-16 09:13:23,131 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for da871fbc36bf4864a209cf1338bc469f 2023-07-16 09:13:23,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/acl/dc50139a54969c5b0d84afa719bd5e04/.tmp/l/da871fbc36bf4864a209cf1338bc469f as hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/acl/dc50139a54969c5b0d84afa719bd5e04/l/da871fbc36bf4864a209cf1338bc469f 2023-07-16 09:13:23,133 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b2edf19eb99140098b9a456cb5cb60f6 2023-07-16 09:13:23,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/namespace/f7ad2e339a72ba504e143898f86e18f5/.tmp/info/083463e9ff9248009b9cb1aa4c62e325 as hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/namespace/f7ad2e339a72ba504e143898f86e18f5/info/083463e9ff9248009b9cb1aa4c62e325 2023-07-16 09:13:23,138 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for da871fbc36bf4864a209cf1338bc469f 2023-07-16 09:13:23,138 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/acl/dc50139a54969c5b0d84afa719bd5e04/l/da871fbc36bf4864a209cf1338bc469f, entries=7, sequenceid=18, filesize=5.2 K 2023-07-16 09:13:23,139 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for dc50139a54969c5b0d84afa719bd5e04 in 110ms, sequenceid=18, compaction requested=false 2023-07-16 09:13:23,156 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/namespace/f7ad2e339a72ba504e143898f86e18f5/info/083463e9ff9248009b9cb1aa4c62e325, entries=2, sequenceid=6, filesize=4.8 K 2023-07-16 09:13:23,157 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for f7ad2e339a72ba504e143898f86e18f5 in 120ms, sequenceid=6, compaction requested=false 2023-07-16 09:13:23,179 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/meta/1588230740/.tmp/rep_barrier/85912bd67c244f2c88dcf6a6a18eae30 2023-07-16 09:13:23,185 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 85912bd67c244f2c88dcf6a6a18eae30 2023-07-16 09:13:23,192 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/acl/dc50139a54969c5b0d84afa719bd5e04/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-16 09:13:23,197 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:13:23,198 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689498642973.dc50139a54969c5b0d84afa719bd5e04. 2023-07-16 09:13:23,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dc50139a54969c5b0d84afa719bd5e04: 2023-07-16 09:13:23,199 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689498642973.dc50139a54969c5b0d84afa719bd5e04. 2023-07-16 09:13:23,207 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/namespace/f7ad2e339a72ba504e143898f86e18f5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-16 09:13:23,207 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:13:23,208 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689498642083.f7ad2e339a72ba504e143898f86e18f5. 2023-07-16 09:13:23,208 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f7ad2e339a72ba504e143898f86e18f5: 2023-07-16 09:13:23,208 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689498642083.f7ad2e339a72ba504e143898f86e18f5. 2023-07-16 09:13:23,212 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/meta/1588230740/.tmp/table/b1f8f5790ada4ddf9b81c032824f7a72 2023-07-16 09:13:23,217 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b1f8f5790ada4ddf9b81c032824f7a72 2023-07-16 09:13:23,218 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/meta/1588230740/.tmp/info/b2edf19eb99140098b9a456cb5cb60f6 as hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/meta/1588230740/info/b2edf19eb99140098b9a456cb5cb60f6 2023-07-16 09:13:23,224 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b2edf19eb99140098b9a456cb5cb60f6 2023-07-16 09:13:23,224 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/meta/1588230740/info/b2edf19eb99140098b9a456cb5cb60f6, entries=48, sequenceid=131, filesize=10.3 K 2023-07-16 09:13:23,225 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/meta/1588230740/.tmp/rep_barrier/85912bd67c244f2c88dcf6a6a18eae30 as hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/meta/1588230740/rep_barrier/85912bd67c244f2c88dcf6a6a18eae30 2023-07-16 09:13:23,230 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 85912bd67c244f2c88dcf6a6a18eae30 2023-07-16 09:13:23,230 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/meta/1588230740/rep_barrier/85912bd67c244f2c88dcf6a6a18eae30, entries=13, sequenceid=131, filesize=6.4 K 2023-07-16 09:13:23,231 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/meta/1588230740/.tmp/table/b1f8f5790ada4ddf9b81c032824f7a72 as hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/meta/1588230740/table/b1f8f5790ada4ddf9b81c032824f7a72 2023-07-16 09:13:23,237 DEBUG [RS:0;jenkins-hbase4:45805] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-16 09:13:23,237 INFO [RS:1;jenkins-hbase4:37709] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37709,1689498639179; all regions closed. 2023-07-16 09:13:23,240 INFO [RS:2;jenkins-hbase4:45437] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45437,1689498639234; all regions closed. 2023-07-16 09:13:23,249 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b1f8f5790ada4ddf9b81c032824f7a72 2023-07-16 09:13:23,249 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/meta/1588230740/table/b1f8f5790ada4ddf9b81c032824f7a72, entries=24, sequenceid=131, filesize=6.9 K 2023-07-16 09:13:23,250 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 210ms, sequenceid=131, compaction requested=false 2023-07-16 09:13:23,260 DEBUG [RS:1;jenkins-hbase4:37709] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/oldWALs 2023-07-16 09:13:23,260 INFO [RS:1;jenkins-hbase4:37709] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37709%2C1689498639179:(num 1689498641492) 2023-07-16 09:13:23,260 DEBUG [RS:1;jenkins-hbase4:37709] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:13:23,260 INFO [RS:1;jenkins-hbase4:37709] regionserver.LeaseManager(133): Closed leases 2023-07-16 09:13:23,261 INFO [RS:1;jenkins-hbase4:37709] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-16 09:13:23,261 INFO [RS:1;jenkins-hbase4:37709] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-16 09:13:23,261 INFO [RS:1;jenkins-hbase4:37709] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-16 09:13:23,261 INFO [RS:1;jenkins-hbase4:37709] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-16 09:13:23,267 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-16 09:13:23,267 INFO [RS:1;jenkins-hbase4:37709] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37709 2023-07-16 09:13:23,280 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 09:13:23,280 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:13:23,280 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 09:13:23,280 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:13:23,280 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 09:13:23,281 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37709,1689498639179 2023-07-16 09:13:23,281 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 09:13:23,282 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37709,1689498639179] 2023-07-16 09:13:23,282 DEBUG [RS:2;jenkins-hbase4:45437] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/oldWALs 2023-07-16 09:13:23,283 INFO [RS:2;jenkins-hbase4:45437] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45437%2C1689498639234:(num 1689498641513) 2023-07-16 09:13:23,283 DEBUG [RS:2;jenkins-hbase4:45437] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:13:23,283 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37709,1689498639179; numProcessing=1 2023-07-16 09:13:23,283 INFO [RS:2;jenkins-hbase4:45437] regionserver.LeaseManager(133): Closed leases 2023-07-16 09:13:23,284 INFO [RS:2;jenkins-hbase4:45437] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-16 09:13:23,284 INFO [RS:2;jenkins-hbase4:45437] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-16 09:13:23,285 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-16 09:13:23,285 INFO [RS:2;jenkins-hbase4:45437] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-16 09:13:23,285 INFO [RS:2;jenkins-hbase4:45437] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-16 09:13:23,285 INFO [RS:2;jenkins-hbase4:45437] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45437 2023-07-16 09:13:23,286 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37709,1689498639179 already deleted, retry=false 2023-07-16 09:13:23,286 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37709,1689498639179 expired; onlineServers=2 2023-07-16 09:13:23,287 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:13:23,287 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 09:13:23,287 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45437,1689498639234 2023-07-16 09:13:23,289 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45437,1689498639234] 2023-07-16 09:13:23,289 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45437,1689498639234; numProcessing=2 2023-07-16 09:13:23,290 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45437,1689498639234 already deleted, retry=false 2023-07-16 09:13:23,290 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45437,1689498639234 expired; onlineServers=1 2023-07-16 09:13:23,305 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-16 09:13:23,306 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-16 09:13:23,306 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-16 09:13:23,307 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-16 09:13:23,307 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-16 09:13:23,307 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-16 09:13:23,308 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-16 09:13:23,310 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-16 09:13:23,384 INFO [RS:1;jenkins-hbase4:37709] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37709,1689498639179; zookeeper connection closed. 2023-07-16 09:13:23,384 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 09:13:23,384 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:37709-0x1016d65d4800002, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 09:13:23,384 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6a701c16] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6a701c16 2023-07-16 09:13:23,437 INFO [RS:0;jenkins-hbase4:45805] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45805,1689498639118; all regions closed. 2023-07-16 09:13:23,478 DEBUG [RS:0;jenkins-hbase4:45805] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/oldWALs 2023-07-16 09:13:23,478 INFO [RS:0;jenkins-hbase4:45805] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45805%2C1689498639118.meta:.meta(num 1689498641682) 2023-07-16 09:13:23,484 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 09:13:23,484 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45437-0x1016d65d4800003, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 09:13:23,484 INFO [RS:2;jenkins-hbase4:45437] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45437,1689498639234; zookeeper connection closed. 2023-07-16 09:13:23,485 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@912e0f7] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@912e0f7 2023-07-16 09:13:23,488 DEBUG [RS:0;jenkins-hbase4:45805] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/oldWALs 2023-07-16 09:13:23,488 INFO [RS:0;jenkins-hbase4:45805] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45805%2C1689498639118:(num 1689498641521) 2023-07-16 09:13:23,488 DEBUG [RS:0;jenkins-hbase4:45805] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:13:23,488 INFO [RS:0;jenkins-hbase4:45805] regionserver.LeaseManager(133): Closed leases 2023-07-16 09:13:23,488 INFO [RS:0;jenkins-hbase4:45805] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-16 09:13:23,488 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-16 09:13:23,491 INFO [RS:0;jenkins-hbase4:45805] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45805 2023-07-16 09:13:23,493 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45805,1689498639118 2023-07-16 09:13:23,493 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-16 09:13:23,494 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45805,1689498639118] 2023-07-16 09:13:23,494 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45805,1689498639118; numProcessing=3 2023-07-16 09:13:23,495 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45805,1689498639118 already deleted, retry=false 2023-07-16 09:13:23,495 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45805,1689498639118 expired; onlineServers=0 2023-07-16 09:13:23,495 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46005,1689498637607' ***** 2023-07-16 09:13:23,495 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-16 09:13:23,496 DEBUG [M:0;jenkins-hbase4:46005] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3485acb1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-16 09:13:23,496 INFO [M:0;jenkins-hbase4:46005] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46005,1689498637607 2023-07-16 09:13:23,496 INFO [M:0;jenkins-hbase4:46005] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46005,1689498637607; all regions closed. 2023-07-16 09:13:23,496 DEBUG [M:0;jenkins-hbase4:46005] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-16 09:13:23,496 DEBUG [M:0;jenkins-hbase4:46005] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-16 09:13:23,496 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-16 09:13:23,496 DEBUG [M:0;jenkins-hbase4:46005] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-16 09:13:23,496 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689498640932] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689498640932,5,FailOnTimeoutGroup] 2023-07-16 09:13:23,496 INFO [M:0;jenkins-hbase4:46005] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-16 09:13:23,496 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689498640940] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689498640940,5,FailOnTimeoutGroup] 2023-07-16 09:13:23,496 INFO [M:0;jenkins-hbase4:46005] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-16 09:13:23,496 INFO [M:0;jenkins-hbase4:46005] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-16 09:13:23,496 DEBUG [M:0;jenkins-hbase4:46005] master.HMaster(1512): Stopping service threads 2023-07-16 09:13:23,496 INFO [M:0;jenkins-hbase4:46005] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-16 09:13:23,497 ERROR [M:0;jenkins-hbase4:46005] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-16 09:13:23,498 INFO [M:0;jenkins-hbase4:46005] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-16 09:13:23,498 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-16 09:13:23,498 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-16 09:13:23,499 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-16 09:13:23,499 DEBUG [M:0;jenkins-hbase4:46005] zookeeper.ZKUtil(398): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-16 09:13:23,499 WARN [M:0;jenkins-hbase4:46005] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-16 09:13:23,499 INFO [M:0;jenkins-hbase4:46005] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-16 09:13:23,499 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-16 09:13:23,500 INFO [M:0;jenkins-hbase4:46005] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-16 09:13:23,500 DEBUG [M:0;jenkins-hbase4:46005] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-16 09:13:23,500 INFO [M:0;jenkins-hbase4:46005] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 09:13:23,500 DEBUG [M:0;jenkins-hbase4:46005] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 09:13:23,500 DEBUG [M:0;jenkins-hbase4:46005] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-16 09:13:23,500 DEBUG [M:0;jenkins-hbase4:46005] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 09:13:23,501 INFO [M:0;jenkins-hbase4:46005] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.89 KB heapSize=452.11 KB 2023-07-16 09:13:23,521 INFO [M:0;jenkins-hbase4:46005] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.89 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/5a49a2172c2c47139b7d6361e9b825ab 2023-07-16 09:13:23,526 INFO [M:0;jenkins-hbase4:46005] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5a49a2172c2c47139b7d6361e9b825ab 2023-07-16 09:13:23,527 DEBUG [M:0;jenkins-hbase4:46005] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/5a49a2172c2c47139b7d6361e9b825ab as hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/5a49a2172c2c47139b7d6361e9b825ab 2023-07-16 09:13:23,532 INFO [M:0;jenkins-hbase4:46005] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5a49a2172c2c47139b7d6361e9b825ab 2023-07-16 09:13:23,532 INFO [M:0;jenkins-hbase4:46005] regionserver.HStore(1080): Added hdfs://localhost:43477/user/jenkins/test-data/d7c4c70a-0a54-b9be-b1f3-a9bd96423eae/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/5a49a2172c2c47139b7d6361e9b825ab, entries=119, sequenceid=899, filesize=28.7 K 2023-07-16 09:13:23,533 INFO [M:0;jenkins-hbase4:46005] regionserver.HRegion(2948): Finished flush of dataSize ~375.89 KB/384909, heapSize ~452.09 KB/462944, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 32ms, sequenceid=899, compaction requested=false 2023-07-16 09:13:23,536 INFO [M:0;jenkins-hbase4:46005] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-16 09:13:23,536 DEBUG [M:0;jenkins-hbase4:46005] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-16 09:13:23,541 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-16 09:13:23,542 INFO [M:0;jenkins-hbase4:46005] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-16 09:13:23,543 INFO [M:0;jenkins-hbase4:46005] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46005 2023-07-16 09:13:23,545 DEBUG [M:0;jenkins-hbase4:46005] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,46005,1689498637607 already deleted, retry=false 2023-07-16 09:13:23,594 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 09:13:23,594 INFO [RS:0;jenkins-hbase4:45805] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45805,1689498639118; zookeeper connection closed. 2023-07-16 09:13:23,595 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): regionserver:45805-0x1016d65d4800001, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 09:13:23,599 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@c67d254] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@c67d254 2023-07-16 09:13:23,599 INFO [Listener at jenkins-hbase4.apache.org/33381] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-16 09:13:23,695 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 09:13:23,695 INFO [M:0;jenkins-hbase4:46005] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46005,1689498637607; zookeeper connection closed. 2023-07-16 09:13:23,695 DEBUG [Listener at localhost/39411-EventThread] zookeeper.ZKWatcher(600): master:46005-0x1016d65d4800000, quorum=127.0.0.1:64380, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-16 09:13:23,697 WARN [Listener at jenkins-hbase4.apache.org/33381] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-16 09:13:23,713 INFO [Listener at jenkins-hbase4.apache.org/33381] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-16 09:13:23,821 WARN [BP-111473309-172.31.14.131-1689498633573 heartbeating to localhost/127.0.0.1:43477] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-16 09:13:23,822 WARN [BP-111473309-172.31.14.131-1689498633573 heartbeating to localhost/127.0.0.1:43477] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-111473309-172.31.14.131-1689498633573 (Datanode Uuid c908d5ed-fa9f-4707-98c1-faa58dbd9580) service to localhost/127.0.0.1:43477 2023-07-16 09:13:23,824 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/cluster_b4b9d27b-ece6-8fd0-070d-ff06f0633057/dfs/data/data5/current/BP-111473309-172.31.14.131-1689498633573] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 09:13:23,824 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/cluster_b4b9d27b-ece6-8fd0-070d-ff06f0633057/dfs/data/data6/current/BP-111473309-172.31.14.131-1689498633573] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 09:13:23,829 WARN [Listener at jenkins-hbase4.apache.org/33381] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-16 09:13:23,861 INFO [Listener at jenkins-hbase4.apache.org/33381] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-16 09:13:23,867 WARN [BP-111473309-172.31.14.131-1689498633573 heartbeating to localhost/127.0.0.1:43477] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-16 09:13:23,867 WARN [BP-111473309-172.31.14.131-1689498633573 heartbeating to localhost/127.0.0.1:43477] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-111473309-172.31.14.131-1689498633573 (Datanode Uuid 87ddf0fe-2473-42e8-aa36-00fc502b4dbf) service to localhost/127.0.0.1:43477 2023-07-16 09:13:23,868 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/cluster_b4b9d27b-ece6-8fd0-070d-ff06f0633057/dfs/data/data3/current/BP-111473309-172.31.14.131-1689498633573] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 09:13:23,869 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/cluster_b4b9d27b-ece6-8fd0-070d-ff06f0633057/dfs/data/data4/current/BP-111473309-172.31.14.131-1689498633573] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 09:13:23,870 WARN [Listener at jenkins-hbase4.apache.org/33381] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-16 09:13:23,884 INFO [Listener at jenkins-hbase4.apache.org/33381] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-16 09:13:23,989 WARN [BP-111473309-172.31.14.131-1689498633573 heartbeating to localhost/127.0.0.1:43477] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-16 09:13:23,989 WARN [BP-111473309-172.31.14.131-1689498633573 heartbeating to localhost/127.0.0.1:43477] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-111473309-172.31.14.131-1689498633573 (Datanode Uuid 97143709-4ac0-42dc-8bf4-4db3a889ac23) service to localhost/127.0.0.1:43477 2023-07-16 09:13:23,990 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/cluster_b4b9d27b-ece6-8fd0-070d-ff06f0633057/dfs/data/data1/current/BP-111473309-172.31.14.131-1689498633573] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 09:13:23,990 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f6e4692a-2ab1-e6b8-d57e-6bcd71d9cfa9/cluster_b4b9d27b-ece6-8fd0-070d-ff06f0633057/dfs/data/data2/current/BP-111473309-172.31.14.131-1689498633573] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-16 09:13:24,024 INFO [Listener at jenkins-hbase4.apache.org/33381] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-16 09:13:24,158 INFO [Listener at jenkins-hbase4.apache.org/33381] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-16 09:13:24,287 INFO [Listener at jenkins-hbase4.apache.org/33381] hbase.HBaseTestingUtility(1293): Minicluster is down